Home Arrow Icon Knowledge base Arrow Icon Global Arrow Icon How does the complexity of ARIMA models compare to the simplicity of historical averages


How does the complexity of ARIMA models compare to the simplicity of historical averages


The complexity of ARIMA models compared to the simplicity of historical averages can be summarized as follows:

Complexity of ARIMA Models

1. Autoregressive (AR) Component: ARIMA models include an autoregressive component that captures the linear relationship between the current value and past values. This component can be complex, especially when dealing with non-stationary data.

2. Integrated (I) Component: The integrated component in ARIMA models involves differencing the data to make it stationary. This can be computationally intensive and may require careful handling of the differencing process.

3. Moving Average (MA) Component: The moving average component in ARIMA models captures the linear relationship between the current value and past residuals. This component can be complex, especially when dealing with non-linear relationships.

4. Model Parameters: ARIMA models have several parameters to be estimated, such as the order of the AR and MA components, which can make the model more complex.

Simplicity of Historical Averages

1. Simple Calculation: Historical averages are calculated by simply averaging the past values of the time series. This is a straightforward and simple process.

2. No Parameters: Historical averages do not require any parameters to be estimated, making them simpler compared to ARIMA models.

3. No Non-Linear Relationships: Historical averages do not capture non-linear relationships in the data, which can make them less effective for certain types of time series.

Comparison

In summary, ARIMA models are generally more complex than historical averages due to the following reasons:

- More Parameters: ARIMA models have more parameters to be estimated compared to historical averages.
- Non-Linear Relationships: ARIMA models can capture non-linear relationships in the data, which can make them more effective for certain types of time series.
- Computational Complexity: ARIMA models can be computationally intensive, especially when dealing with large datasets or complex non-stationary data.

On the other hand, historical averages are simpler and easier to calculate, but they may not capture complex patterns or non-linear relationships in the data.

Citations:
[1] https://par.nsf.gov/servlets/purl/10186768
[2] https://ieeexplore.ieee.org/document/8614252/
[3] https://iopscience.iop.org/article/10.1088/1742-6596/1631/1/012141/meta
[4] https://www.predicthq.com/events/lstm-time-series-forecasting
[5] https://towardsdatascience.com/exploring-the-lstm-neural-network-model-for-time-series-8b7685aa8cf?gi=d893680f73de