Moving average

From Wikipedia, the free encyclopedia

For other uses, see Moving average (disambiguation).

In statistics, a moving average, also called a rolling average and sometimes a running average, refers to a statistical technique used to analyze a set of data points by creating an average of one subset of the full data set at a time with each number in the subset given an equal statistical weight. So a moving average is not a single number, but it is a set of numbers, each of which is the average of the corresponding subset of a larger set of data points. A simple example is if you had a data set with 100 data points, the first value of the moving average might be the arithmetic mean (one simple type of average) of data points 1 through 25. The next value would be this simple average of data points 2 through 26, and so forth, until the final value, which would be the same simple average of data points 76 through 100.

The size of the subset being averaged is often constant, as in the previous example, but need not be. In particular, a cumulative average is a type of moving average where each value is the average of all previous data points in the full data set. So the size of the subset being averaged grows by one as each new value of the moving average is calculated. A moving average could also use a weighted average instead of a simple average, perhaps in order to place more emphasis on more recent data points than on other data points longer ago in time.

A moving average can be applied to any data set, but is perhaps most commonly used with time series data to smooth out short-term fluctuations and highlight longer-term trends or cycles. The threshold between short-term and long-term depends on the application, and the parameters of the moving average will be set accordingly. For example, it is often used in technical analysis of financial data, like stock prices, returns or trading volumes. It is also used in economics to examine gross domestic product, employment or other macroeconomic time series. Mathematically, a moving average is a type of convolution and so it is also similar to the low-pass filter used in signal processing. When used with non-time series data, a moving average simply acts as a generic smoothing operation without any specific connection to time, although typically some kind of ordering is implied.

1 Simple moving average
- 1.1 Prior moving average
- 1.2 Central moving average
2 Cumulative moving average
3 Weighted moving average
4 Exponential moving average
- 4.1 Application of exponential moving average to OS performance metrics
5 Other weightings
6 See also
7 Notes and references
8 Further reading
9 External links

[edit] Simple moving average

[edit] Prior moving average

A simple moving average (SMA) is the unweighted mean of the previous n data points. For example, a 10-day simple moving average of closing price is the mean of the previous 10 days' closing prices. If those prices are $p_M, p_{M-1},\dots,p_{M-9}$ then the formula is

$\textit{SMA} = { p_{M} + p_{M-1} + \cdots + p_{M-9} \over 10 }$

When calculating successive values, a new value comes into the sum and an old value drops out, meaning a full summation each time is unnecessary,

$\textit{SMA}_\mathrm{today} = \textit{SMA}_\mathrm{yesterday} - {p_{M-n+1} \over n} + {p_{M+1} \over n}$

In technical analysis there are various popular values for n, like 10 days, 40 days, or 200 days. The period selected depends on the kind of movement one is concentrating on, such as short, intermediate, or long term. In any case moving average levels are interpreted as support in a rising market, or resistance in a falling market.

In all cases a moving average lags behind the latest data point, simply from the nature of its smoothing. An SMA can lag to an undesirable extent, and can be disproportionately influenced by old data points dropping out of the average. This is addressed by giving extra weight to more recent data points, as in the weighted and exponential moving averages.

One characteristic of the SMA is that if the data have a periodic fluctuation, then applying an SMA of that period will eliminate that variation (the average always containing one complete cycle). But a perfectly regular cycle is rarely encountered in economics or finance.^[1]

[edit] Central moving average

For a number of applications it is advantageous to avoid the shifting induced by using only 'past' data. Hence a central moving average can be computed, using both 'past' and 'future' data. The 'future' data in this case are not predictions, but merely data obtained after the time at which the average is to be computed.

Weighted and exponential moving averages^{[citation needed]} (see below) can also be computed centrally.

[edit] Cumulative moving average

The cumulative moving average is also frequently called a running average or a long running average although the term running average is also used as synonym for a moving average. This article uses the term cumulative moving average or simply cumulative average since this term is more descriptive and unambiguous.

In some data acquisition systems, the data arrives in an ordered data stream and the stastitician would like to get the average of all of the data up until the current data point. For example, an investor may want the average price of all of the stock transactions for a particular stock up until the current time. As each new transaction occurs, the average price at the time of the transaction can be calculated for all of the transactions up to that point using the cumulative average. This is the cumulative average, which is typically an unweighted average of the sequence of i values x₁, ..., x_i up to the current time:

$CA_i = {{x_1 + \cdots + x_i} \over i}\,.$

The brute force method to calculate this would be to store all of the data and calculate the sum and divide by the number of data points every time a new data point arrived. However, it is possible to simply update cumulative averagea as a new value x_i+1 becomes available, using the formula:

$CA_{i+1} = {CA_i} + {{x_{i+1} - CA_i} \over {i+1}}\,,$

where CA₀ can be taken to be equal to 0.

Thus the current cumulative average for a new data point is equal to the previous cumulative average plus the difference between the latest data point and the previous average divided by the number of points received so far. When all of the data points arrive (i = N), the cumulative average will equal the final average.

The derivation of the cumulative average formula is straightforward. Using

$x_1 + \cdots + x_i = iCA_i\,,$

and similarly for i + 1, it is seen that

$x_{i+1} = (x_1 + \cdots + x_{i+1}) - (x_1 + \cdots + x_i) = (i+1)CA_{i+1} - iCA_i\,.$

Solving this equation for CA_i+1 results in:

$CA_{i+1} = {(x_{i+1} + iCA_i) \over {i+1}} = {CA_i} + {{x_{i+1} - CA_i} \over {i+1}}\,.$

[edit] Weighted moving average

A weighted average is any average that has multiplying factors to give different weights to different data points. Mathematically, the moving average is the convolution of the data points with a moving average function; in technical analysis, a weighted moving average (WMA) has the specific meaning of weights which decrease arithmetically. In an n-day WMA the latest day has weight n, the second latest n - 1, etc, down to zero.

$\textit{WMA}_{M} = { n p_{M} + (n-1) p_{M-1} + \cdots + 2 p_{M-n+2} + p_{M-n+1} \over n + (n-1) + \cdots + 2 + 1}$

WMA weights n=15

The denominator is a triangle number, and can be easily computed as $\frac{n(n+1)}{2}.$

When calculating the WMA across successive values, it can be noted the difference between the numerators of WMA_M+1 and WMA_M is np_M+1 - p_M - ... - p_M-n+1. If we denote the sum p_M + ... + p_M-n+1 by Total_M, then

$Total_{M+1} = Total_{M} + p_{M+1} - p_{M-n+1} \,$

$\textit{Numerator}_{M+1} = \textit{Numerator}_{M} + n p_{M+1} - Total_{M} \,$

$\textit{WMA}_{M+1} = { \textit{Numerator}_{M+1} \over n + (n-1) + \cdots + 2 + 1} \,$

The graph at the right shows how the weights decrease, from highest weight for the most recent data points, down to zero. It can be compared to the weights in the exponential moving average which follows.

[edit] Exponential moving average

EMA weights N=15

An exponential moving average (EMA), sometimes also called an exponentially weighted moving average (EWMA), applies weighting factors which decrease exponentially. The weighting for each older data point decreases exponentially, giving much more importance to recent observations while still not discarding older observations entirely. The graph at right shows an example of the weight decrease.

The degree of weighing decrease is expressed as a constant smoothing factor α, a number between 0 and 1. α may be expressed as a percentage, so a smoothing factor of 10% is equivalent to α=0.1. Alternatively, α may be expressed in terms of N time periods, where $\alpha={2\over{N+1}}$ . For example, N=19 is equivalent to α=0.1. The half-life of the weights (the interval over which the weights decrease by a factor of two) is approximately $N\over{2.8854}$ (within 1% if N>5).

The observation at a time period t is designated Y_t, and the value of the EMA at any time period t is designated S_t. S₁ is undefined. S₂ may be initialized in a number of different ways, most commonly by setting S₂ to Y₁, though other techniques exist, such as setting S₂ to an average of the first 4 or 5 observations. The prominence of the S₂ initialization's effect on the resultant moving average depends on α; smaller α values make the choice of S₂ relatively more important than larger α values, since a higher α discounts older observations faster.

The formula for calculating the EMA at time periods t=2 is

$S_{t} = \alpha \times Y_{t-1} + (1-\alpha) \times S_{t-1}$

This formulation is according to Hunter (1986)^[2]. The weights will obey $α * (1 - α) x * Y t - (x + 1)$ . An alternate approach by Roberts (1959) uses Y_t in lieu of Y_t-1^[3]:

$S_{t, alternate} = \alpha \times Y_{t} + (1-\alpha) \times S_{t-1}$

This formula can also be expressed in technical analysis terms as follows, showing how the EMA steps towards the latest data point, but only by a proportion of the difference (each time):^[4]

$\textit{EMA}_{\text{today}} = \textit{EMA}_{\text{yesterday}} + \alpha \times (\textit{price} - \textit{EMA}_{\text{yesterday}})$

Expanding out $E M A y e s t e r d a y$ each time results in the following power series, showing how the weighting factor on each data point $p 1$ , $p 2$ , etc, decrease exponentially:

$\textit{EMA} = { p_1 + (1-\alpha) p_2 + (1-\alpha)^2 p_3 + (1-\alpha)^3 p_4 + \cdots \over 1 + (1-\alpha) + (1-\alpha)^2 + (1-\alpha)^3 + \cdots }$

In theory this is an infinite sum, but because 1-α is less than 1, the terms become smaller and smaller, and can be ignored once small enough. The denominator approaches 1/α, and that value can be used instead of adding up the powers, provided one is using enough terms that the omitted portion is negligible.

The N periods in an N-day EMA only specify the α factor. N is not a stopping point for the calculation in the way it is in an SMA or WMA. The first N data points in an EMA represent about 86% of the total weight in the calculation^{[citation needed]}.

The power formula above gives a starting value for a particular day, after which the successive days formula shown first can be applied.

The question of how far back to go for an initial value depends, in the worst case, on the data. If there are huge p price values in old data then they'll have an effect on the total even if their weighting is very small. If one assumes prices don't vary too wildly then just the weighting can be considered. The weight omitted by stopping after k terms is

$(1-\alpha)^k + (1-\alpha)^{k+1} + \cdots$ ,

which is

$(1-\alpha)^k \times (1 + (1-\alpha) + (1-\alpha)^2 \cdots)$ ,

i.e. a fraction

${(1-\alpha)^k \over \alpha}$

out of the total weight.

For example, to have 99.9% of the weight,

$k={ \log (0.001 \times \alpha) \over \log (1-\alpha)}$

terms should be used. Since $\log\,(1-\alpha)$ approaches $-2 \over N+1$

as N increases, this simplifies to approximately

$k=3.45\times(N+1)$

for this example (99.9% weight).

[edit] Application of exponential moving average to OS performance metrics

Some computer performance metrics use a form of exponential moving average, for example, the average process queue length, or the average CPU utilization.

$S_{n} = \alpha(t_{n}-t_{n-1}) \times Y_{n} + (1-\alpha(t_{n}-t_{n-1})) \times S_{n-1}$

Here $α$ is defined as a function of time between two readings. An example of a coefficient giving bigger weight to the current reading, and smaller weight to the older readings is

$\alpha(t_{n}-t_{n-1}) = 1-e^{-{1 \over {({t_{n}-t_{n-1}}) \times W \times 60}}}$

where time for readings $t n$ is expressed in seconds, and $W$ is the period of time in minutes over which the reading is said to be averaged. Given the above definition of $α$ , the moving average can be expressed as

$S_{n} = (1-e^{-{1 \over {({t_{n}-t_{n-1}}) \times W \times 60}}}) \times Y_{n} + e^{-{1 \over {({t_{n}-t_{n-1}}) \times W \times 60}}} \times S_{n-1}$

For example, a 15-minute average $L$ of a process queue length $Q$ , measured 5 times per second (time difference is 1/5 of a second), is computed as

$L_{n} = (1-e^{-{1 \over {{1 \over 5} \times 15 \times 60}}}) \times Q_{n} + e^{-{1 \over {{1 \over 5} \times 15 \times 60}}} \times L_{n-1} = (1-e^{-{1 \over {180}}}) \times Q_{n} + e^{-{1 \over {180}}} \times L_{n-1}$

[edit] Other weightings

Other weighting systems are used occasionally – for example, in share trading a volume weighting will weight each time period in proportion to its trading volume.

A further weighting, used by actuaries, is Spencer's 15-Point Moving Average^[5] (a central moving average).