Adaptive Newton-based multivariate smoothed functional algorithms for simulation optimization

Bhatnagar, Shalabh (2007) Adaptive Newton-based multivariate smoothed functional algorithms for simulation optimization ACM Transactions on Modeling and Computer Simulation, 18 (1). pp. 1-35. ISSN 1049-3301

Full text not available from this repository.

Official URL: http://doi.org/10.1145/1315575.1315577

Related URL: http://dx.doi.org/10.1145/1315575.1315577

Abstract

In this article, we present three smoothed functional (SF) algorithms for simulation optimization. While one of these estimates only the gradient by using a finite difference approximation with two parallel simulations, the other two are adaptive Newton-based stochastic approximation algorithms that estimate both the gradient and Hessian. One of the Newton-based algorithms uses only one simulation and has a one-sided estimate in both the gradient and Hessian, while the other uses two-sided estimates in both quantities and requires two simulations. For obtaining gradient and Hessian estimates, we perturb each parameter component randomly using independent and identically distributed (i.i.d) Gaussian random variates. The earlier SF algorithms in the literature only estimate the gradient of the objective function. Using similar techniques, we derive two unbiased SF-based estimators for the Hessian and develop suitable three-timescale stochastic approximation procedures for simulation optimization. We present a detailed convergence analysis of our algorithms and show numerical experiments with parameters of dimension 50 on a setting involving a network of M/G/1 queues with feedback. We compare the performance of our algorithms with related algorithms in the literature. While our two-simulation Newton-based algorithm shows the best results overall, our one-simulation algorithm shows better performance compared to other one-simulation algorithms.

Item Type:Article
Source:Copyright of this article belongs to Association for Computing Machinery.
Keywords:Algorithms; Performance; Theory; Smoothed Functional Algorithms; Three-Timescale Stochastic Approximation; Simulation Optimization; Gaussian Perturbations; Newton-Based Algorithms.
ID Code:116559
Deposited On:12 Apr 2021 06:49
Last Modified:12 Apr 2021 06:49

Repository Staff Only: item control page