The Federal Reserve Board eagle logo links to Board's home page

International Finance Discussion Papers
The International Finance Discussion Papers logo links to the International Finance Discussion Papers home page Post-Stimulation Analysis of Monte Carlo Experiments: Interpreting Pesaran's (1974) Study of Non-Nested Hypothesis Test Statistics
Neil R. Ericsson
1986-276  (March 1986)

Abstract:  "Monte Carlo experimentation in econometrics helps 'solve' deterministic problems by simulating stochastic analogues in which the analytical unknowns are reformulated as parameters to be estimated." (Hendry (1980) With that in mind, Monte Carlo studies may be divided operationally into three phases: design, simulation, and post-simulation analysis. This paper provides a guide to the last of those three, post-simulation analysis, given the design and simulation of a Monte Carlo study, and uses Pesaran's (1974) study of statistics for testing non-nested hypotheses to illustrate the techniques described. A statistic is derived for testing for significant deviations between the asymptotic and (observed) finite sample properties. Further, that statistic provides the basis for analyzing discrepancies between the finite sample and asymptotic properties using response surfaces. The results for Pesaran's study indicate the value of asymptotic theory in interpreting finite sample properties and certain limitations for doing so. Finally, a method is proposed for adjusting the finite sample sizes of different test statistics so that comparisons of their power may be made. Extensions to other finite sample properties are indicated.

Full paper(571 KB PDF)

PDF files: Adobe Acrobat Reader   ZIP files: PKWARE


Home | IFDPs | List of 1986 IFDPs
Accessibility | Contact Us
Last update: December 9, 2008