Variation Comparison of OLS and GLS Estimators using Monte Carlo Simulation of Linear Regression Model with Autoregressive Scheme
Keywords:OLS, GLS, MONTE CARLO
In this research we discusses to Ordinary Least Squares and Generalized Least Squares techniques and estimate with First Order Autoregressive scheme from different correlation levels by using simple linear regression model. A comparison has been made between these two methods on the basis of variances results. For the purpose of comparison, we use simulation of Monte Carlo study and the experiment is repeated 5000 times. We use sample sizes 50, 100, 200, 300 and 500, and observe the influence of different sample sizes on the estimators.
By comparing variances of OLS and GLS at different values of sample sizes and correlation levels with , we found that variance of ( ) at sample size 500, OLS and GLS gives similar results but at sample size 50 variance of GLS ( ) has minimum values as compared to OLS. So it is clear that variance of GLS ( ) is best. Similarly variance of ( ) from OLS and GLS at sample size 500 and correlation -0.05 with , GLS give minimum value as compared to all other sample sizes and correlations.
By comparing overall results of Ordinary Least Squares (OLS) and Generalized Least Squares (GLS), we conclude that in large samples both are gives similar results but small samples GLS is best fitted as compared to OLS.
Aitken, A. C. (1935). On Least Squares and Linear Combinations of Observations. Proceedings of the Royal Statistical Society , 55, 42-48.
Akpan, E. A., & Moffat, I. U. (2018). Modeling the Autocorrelated Errors in Time Series Regression: A Generalized Least Squares Approach. Journal of Advances in Mathematics and Computer Science , 26 (4), 1-15.
Chang, X. W., & Peloquin, D. T. (2020). An Improved Algorithm for Generalized Least Squares Estimation. Numerical Algebra, Control and Optimization , 10 (4), 451-461.
Kassab, M. M., & Awjar, M. Q. (2020). A Monte Carlo Comparison between Least Squares and the New Ridge Regression Parameters. Advances and Applications in Statistics , 62 (1), 97-105.
Kibria, B. M., & Lukman, A. F. (2020). A New Ridge-Type Estimator for the Linear Regression Model: Simulations and Applications. Scientifica , 1-16.
Liu, K. (1993). A New Class of Biased Estimate in Linear Regression. Communication in Statistics- Theory and Methods , 22, 393-402.
Moon, T. K., & Gunther, J. H. (2020). Estimation of Autoregressive Parameters from Noisy Observations Using Iterated Covariance Updates. Entropy , 1-26.
Safi, S. K., & Saif, E. A. (2014). Using GLS to Generate Forecasts in Regression Models with Auto-Correlated Disturbances with Simulation and Palestinian Market Index Data. American Journal of Theoretical and Applied Statistics , 3 (1), 6-17.
Safi, S., & White, A. (2006). The Efficiency of OLS in the Presence of Auto-Correlated Disturbances in Regression Models. Journal of Modern Applied Statistical Methods , 5 (1), 133-143.
Virgantari, F., Wijayanti, H., & Koeshendrajana, S. (2018). Aitken's Generalized Least Square Method for Estimating Parameter of Demand Function of Animal Protein in Indonesia. International Conference on Mathematics and Natural Sciences (pp. 1-8). Journal of Physics.
Wenning, Z., & Valenci, E. (2019). A Monte Carlo Simulation Study on the Power of Autocorrelation Tests for ARMA Models. American Journal of Undergraduate Research , 16 (3), 59-67.
How to Cite
Copyright (c) 2021 Qubahan Academic Journal
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.