Comparing probability forecasts in Markov regime switching business cycle methods

Smith, Daniel R. and Layton, Allan P. (2007) Comparing probability forecasts in Markov regime switching business cycle methods. Journal of Business Cycle Measurement and Analysis, 3 (1). pp. 79-98. ISSN 1729-3618


We evaluate techniques for comparing the ability of Markov regime switching (MRS) models to fit underlying regimes of a series of interest. This is particularly important in the business cycle literature where one may be interested in determining whether using leading indicators to allow transition probabilities to vary improves the ability of MRS models to fit the NBER business cycle chronology. This is typically done using the quadratic probability score, or QPS (Diebold and Rudebusch (1989)). Although it is possible to statistically compare the QPS statistics for two MRS models using the Diebold and Mariano (1995) (DM) test statistic for comparing forecasts, we find using a Monte Carlo experiment that the DM statistic tends to under-reject (the null of “no difference in forecast accuracy”) when comparing MRS models. This we believe is because of the strong non-normality of the forecast errors of such models. Furthermore, using simulation-based inference we demonstrate that leading indicators improve the fit of an MRS model of the US business cycle chronology by 24 percent, such improvement having a p-value of 0.001.

Statistics for USQ ePrint 2715
Statistics for this ePrint Item
Item Type: Article (Commonwealth Reporting Category C)
Refereed: Yes
Item Status: Live Archive
Faculty / Department / School: Historic - Faculty of Business - No Department
Date Deposited: 22 Nov 2007 22:30
Last Modified: 02 Jul 2013 22:46
Uncontrolled Keywords: Markov regime switching; Diebold and Mariano statistic; quadratic probability score; Monte Carlo; business cycle
Fields of Research : 01 Mathematical Sciences > 0104 Statistics > 010404 Probability Theory
14 Economics > 1401 Economic Theory > 140102 Macroeconomic Theory
14 Economics > 1403 Econometrics > 140303 Economic Models and Forecasting
Socio-Economic Objective: B Economic Development > 91 Economic Framework > 9102 Microeconomics > 910206 Market-Based Mechanisms
Identification Number or DOI: 10.1787/jbcma-v2007-art4-en

Actions (login required)

View Item Archive Repository Staff Only