Gradient-Based Adaptive Stochastic Search for Simulation Optimization Over Continuous Space

Zhou, Enlu ; Bhatnagar, Shalabh (2018) Gradient-Based Adaptive Stochastic Search for Simulation Optimization Over Continuous Space INFORMS Journal on Computing, 30 (1). pp. 154-167. ISSN 1091-9856

Full text not available from this repository.

Official URL: http://doi.org/10.1287/ijoc.2017.0771

Related URL: http://dx.doi.org/10.1287/ijoc.2017.0771

Abstract

We extend the idea of model-based algorithms for deterministic optimization to simulation optimization over continuous space. Model-based algorithms iteratively generate a population of candidate solutions from a sampling distribution and use the performance of the candidate solutions to update the sampling distribution. By viewing the original simulation optimization problem as another optimization problem over the parameter space of the sampling distribution, we propose to use a direct gradient search on the parameter space to update the sampling distribution. To improve the computational efficiency, we further develop a two-timescale updating scheme that updates the parameter on a slow timescale and estimates the quantities involved in the parameter updating on the fast timescale. We analyze the convergence properties of our algorithms through techniques from stochastic approximation, and demonstrate the good empirical performance by comparing with two state-of-the-art model-based simulation optimization methods.

Item Type:Article
Source:Copyright of this article belongs to The Institute for Operations Research and the Management Sciences.
Keywords:Simulation Optimization; Model-based Optimization; Two-Timescale Stochastic Approximation.
ID Code:116463
Deposited On:12 Apr 2021 05:57
Last Modified:12 Apr 2021 05:57

Repository Staff Only: item control page