Frank Batchelder and Miriam Yenkin are analysts for Bishop Econometrics. Batchelder and Yenkin are discussing the models they use to forecast changes in China’s GDP and how they can compare the forecasting accuracy of each model. Batchelder states, “The root mean squared error (RMSE) criterion is typically used to evaluate the in-sample forecast accuracy of autoregressive models.” Yenkin replies, “If we use the RMSE criterion, the model with the largest RMSE is the one we should judge as the most accurate.”
With regard to their statements about using the RMSE criterion:
A) |
Batchelder is correct; Yenkin is incorrect. | |
B) |
Batchelder is incorrect; Yenkin is correct. | |
C) |
Batchelder is incorrect; Yenkin is incorrect. | |
The root mean squared error (RMSE) criterion is used to compare the accuracy of autoregressive models in forecasting out-of-sample values (not in-sample values). Batchelder is incorrect. Out-of-sample forecast accuracy is important because the future is always out of sample, and therefore out-of-sample performance of a model is critical for evaluating real world performance. Yenkin is also incorrect. The RMSE criterion takes the square root of the average squared errors from each model. The model with the smallest RMSE is judged the most accurate. |