Advanced SearchSearch Tips
Efficiency and Robustness of Fully Adaptive Simulated Maximum Likelihood Method
facebook(new window)  Pirnt(new window) E-mail(new window) Excel Download
 Title & Authors
Efficiency and Robustness of Fully Adaptive Simulated Maximum Likelihood Method
Oh, Man-Suk; Kim, Dai-Gyoung;
  PDF(new window)
When a part of data is unobserved the marginal likelihood of parameters given the observed data often involves analytically intractable high dimensional integral and hence it is hard to find the maximum likelihood estimate of the parameters. Simulated maximum likelihood(SML) method which estimates the marginal likelihood via Monte Carlo importance sampling and optimize the estimated marginal likelihood has been used in many applications. A key issue in SML is to find a good proposal density from which Monte Carlo samples are generated. The optimal proposal density is the conditional density of the unobserved data given the parameters and the observed data, and attempts have been given to find a good approximation to the optimal proposal density. Algorithms which adaptively improve the proposal density have been widely used due to its simplicity and efficiency. In this paper, we describe a fully adaptive algorithm which has been used by some practitioners but has not been well recognized in statistical literature, and evaluate its estimation performance and robustness via a simulation study. The simulation study shows a great improvement in the order of magnitudes in the mean squared error, compared to non-adaptive or partially adaptive SML methods. Also, it is shown that the fully adaptive SML is robust in a sense that it is insensitive to the starting points in the optimization routine.
Monte Carlo;importance sampling;marginal likelihood;missing;
 Cited by
Brinch, C. N. (2008). Simulated maximum likelihood using tilted importance sampling, Statistics Norway, Research Department, Discussion papers No. 540

Crepon, B. and Duguet, E. (1997). Research and development, competition and innovation pseudo-maximum likelihood and simulated maximum likelihood methods applied to count data models with heterogeneity, Journal of Econometrics, 79, 355-378 crossref(new window)

Danielsson, J. (1994). Stochastic volatility in asset prices estimation with simulated maximum likeli-hood, Journal of Econometrics, 64, 375-400 crossref(new window)

Durbin, J. and Koopman, S. J. (1997). Monte Carlo maximum likelihood estimation for non-Gaussian state space models, Biometrika, 84, 669-684 crossref(new window)

Durbin, J. and Koopman, S. J. (2000). Time series analysis of non-Gaussian observations based on state space models from both classical and Bayesian perspectives, Journal of the Royal Statistical Society, Series B, 62, 3-56 crossref(new window)

Hurn, A. S., Lindsay, K. A. and Martin, V. L. (2003). On the efficacy of simulated maximum like-lihood for estimating the parameters of stochastic differential equations, Journal of Time Series Analysis, 24, 45-63 crossref(new window)

IMSL (1989). User's Manual, IMSL, Houston, Texas

Jank, W. (2006). Efficient simulated maximum likelihood with an application to online retailing, Satistics and Computing, 16, 111-124 crossref(new window)

Jank, W. and Booth, J. (2003). Efficiency of Monte Carlo EM and simulated maximum likelihood in two-stage hierarchical models, Journal of Computational and Graphical Statistics, 12, 214-229 crossref(new window)

Kao, C., Lee, L. F. and Pitt, M. M. (2001). Simulated maximum likelihood estimation of the linear expenditure system with binding non-negativity constraints, Annals of Economics and Finance, 2, 203-223

Lee, L. F. (1995). Asymptotic bias in simulated maximum likelihood estimation of discrete choice models, Econometric Theory, 11, 437-483 crossref(new window)

Lee, L. F. (1997). Simulated maximum likelihood estimation of dynamic discrete choice statistical models some Monte Carlo results, Journal of Econometrics, 82, 1-35 crossref(new window)

McCulloch, C. E. (1997). Maximum likelihood algorithms for generalized linear mixed models, Journal of the American Statistical Association, 92, 162-170 crossref(new window)

Munkin, M. K. and Trivedi, P. K. (1999). Simulated maximum likelihood estimation of multivariate mixed-Poisson regression models, with application, Econometrics Journal, 2, 29-48 crossref(new window)

Oh, M. S. and Berger, J. O. (1992). Adaptive importance sampling in monte carlo integration, Journal of Statistical Computation and Simulation, 41, 143-168 crossref(new window)

Richard, J. F. and Zhang, W. (2007). Efficient high-dimensional importance sampling, Journal of Econometrics, 141, 1385-1411 crossref(new window)

Stern, S. (1997). Simulation-based estimation, Journal of Econometric Literature, 35, 2006-2039

Zhang, P. (1996). Nonparametric importance sampling, Journal of the American Statistical Association, 91, 1245-1253 crossref(new window)