Methodology

Brass Band Index – Methodology

The method used to rate brass bands is based on the classic Elo Rating method originally designed for chess (first implemented in 1960) and is still used (although slightly modified) to this day.

You can read about the Elo method on it’s wiki page here.

Each band has an assumed rating and when it competes against another band the outcome is predicted based upon the two ratings.

The winning band will be given some of the losing bands points. The number of points transferred is based upon how likely or unlikely that result was. This means that over time, the rating of each band will converge towards its “true rating”.

Initial Rating Values

For new bands, we have nothing to base their rating value on. Over time the rating will converge towards the ‘true rating’, however it is beneficial to start with a good estimate in order to obtain their true rating faster.

When new bands are entered into a contest they are given the average rating of the bands within that contest. Originally, all new bands were given a rating of 1000 but this new method has provided a small increase in accuracy.

K-Value

The amount of points that are transferred from a ‘losing’ band to a ‘winning’ band is a number between 0 and K based upon how unlikely that result was. The choice of K affects how quickly a bands rating can change and both small and large k values have advantages and disadvantages.

A large K-values mean that the ratings can ‘keep up’ with bands that are quickly improving (or getting worse). However it also means that the ratings are more susceptible to freak results.

A number of k-values have been tested and value which provides the most accuracy is now used. The actual k-value is slightly less than is used in other rating systems.

Adjustment for Contest Draw

An interesting part of optimising the Band Index rating system has been investigating the effect that draw position seems to have on a band results.

Almost 20,000 individual band contest results were analysed for their position within the draw (as a %, where 0% is drawn first and 100% is drawn last). A significant correlation was found between draw order and the bands chance of finishing in the top half of the results.

DrawAnalysis2

There is approximately a 54% chance of a top half position for bands drawn last and 44% chance for bands drawn first, with a roughly linear relationship.

This change is approximately equal to a 45 rating point disadvantage if you are drawn first up to a 25 rating point advantage if you are drawn last. This is slightly less than, but comparable to, the home/away advantage seen in football, which is considered to be around 90 Elo points.

This effect has been taken into account when calculating ratings and gives a very small improvement in rating accuracy.

Leave a Reply