AN
INTRODUCTION TO THE
SAINT CLOUD STATE FORECASTING CONTEST
Play the SCSU Forecasting Contest!
Updated: Tuesday, January 5, 2010 11:51 AM
A contest to predict high and low temperatures and the amount of precipitation as reported at the Saint Cloud airport is held on every day that classes are in session during the quarter. The game is played as follows:
Meal
Mooching |
Tuscon Int'l AP Climatology from NWS Western Region |
Arizona Surface Reports from MesoWest Project | |||
| Return
to: |
|||||
| EAS 385 Site | |||||
TIME PERIODS: There are 4 time periods
that you forecast for on any given day. Each time period is 12 hours long. For
example, on Monday, you would forecast for Monday night, Tuesday, Tuesday night,
and Wednesday as shown on the web page. You must make all forecasts in each
time period to have that forecast count. The actual cut offs for the time periods
are given in Greenwich Mean Time (GMT). They are noon (1200
GMT or 12Z) and midnight (0000 GMT or 00Z)
in Greenwich time. Since Saint Cloud is in the Central North America time zone,
we are 6 hours behind Greenwich, England when we are on standard
time and 5 hours behind when we are on daylight time.
So, the forecasting time periods for a Monday forecast would be as shown below:
| Forecast Day |
Forecast Period |
Greenwich Time |
CST |
CDT |
Monday
|
Monday Night |
00Z-12Z Tuesday |
6 PM Monday- 6 AM Tuesday |
7 PM Monday- 7 AM Tuesday |
Tuesday |
12Z Tuesday - 00Z Wednesday |
6 AM-6 PM Tuesday |
7 AM-7 PM Tuesday |
|
Tuesday Night |
00Z-12Z Tuesday |
6 PM Tuesday- 6 AM Wednesday |
7 PM Tuesday- 7 AM Wednesday |
|
Wednesday |
12Z Tuesday - 00Z Wednesday |
6 AM-6 PM Wednesday |
7 AM-7 PM Wednesday |
Note that, for the second city game, the time periods are as follows:
| Forecast Day |
Forecast Period |
Greenwich Time |
CST |
CDT |
Monday
|
Monday Night |
00Z-12Z Tuesday |
6 PM Monday- 6 AM Tuesday |
7 PM Monday- 7 AM Tuesday |
Tuesday |
12Z Tuesday - 00Z Wednesday |
6 AM-6 PM Tuesday |
7 AM-7 PM Tuesday |
Meal
Mooching |
Tuscon Int'l AP Climatology from NWS Western Region |
Arizona Surface Reports from MesoWest Project | |||
| Return
to: |
|||||
| EAS 385 Site | |||||
Meal
Mooching |
Tuscon Int'l AP Climatology from NWS Western Region |
Arizona Surface Reports from MesoWest Project | |||
| Return
to: |
|||||
| EAS 385 Site | |||||
PROBABILITY OF PRECIPITATION: There are two precipitation probability games to be played in each time period. The first is the probability of measurable precipitation. Measurable precipitation is defined as precipitation which amounts to at least .01 inch. A trace of precipitation does not count. If the precipitation takes the form of snow, the precipitation is the melted water equivalent amount, so this category verifies during a snowstorm. Note that the verification is taken at Saint Cloud State University for a snow event. The forecast is made in tens of percent.
Meal
Mooching |
Tuscon Int'l AP Climatology from NWS Western Region |
Arizona Surface Reports from MesoWest Project | |||
| Return
to: |
|||||
| EAS 385 Site | |||||
PROBABILITY OF AT LEAST .25 INCH: The probability of a quarter inch (PROB>.25") game is played the same way as the probability of measurable precipitation, except that you are determining the chance that the airport will report at least 1/4 inch (0.25") of liquid water. Again, in a snowstorm, this category verfies as the melted precipitation, as measured at Saint Cloud State University.
Important: If the airport reports at least 1/4 inch, there must be at least .01 inch and both probability games verify as a "10". Therefore, you cannot enter a probability on the .01 game that is lower than the probability of .25 inch!
Meal
Mooching |
Tuscon Int'l AP Climatology from NWS Western Region |
Arizona Surface Reports from MesoWest Project | |||
| Return
to: |
|||||
| EAS 385 Site | |||||
PRECIPITATION AMOUNT (P-AMT) GAME: In this game you are attempting to forecast the amount of liquid water that will be measured at the St. Cloud airport with an error of .05". To do this, you write down a precipitation amount category. The categories are shown below.
| Category |
Amount Range (inches) |
Category |
Amount Range (inches) |
0 |
Zero or Trace |
6 |
.26 - .30 |
1 |
.01 - .05 |
7 |
.31 - .35 |
2 |
.06 - .10 |
10
|
.46 - .50
|
3 |
.11 - .15 |
||
4 |
.16 - .20 |
20
|
.96 - 1.00
|
5 |
.21 - .25 |
Note that there are many possibilities for precipitation amount. Each category is .05" wide and the highest amount is the category number times .05". We have had a category 89 verification (4.46 - 4.50 inches) in Saint Cloud. Again, in snow situations, it is the liquid water equivalent that is used to determine the category.
Note also, for categories 1-5, the Probability of Precipitation is "10" and the Probability of Quarter-Inch is "0" for all verifications except .25 inch. For all categories of 6 or high, both the Probability of Precipitation and the Probability of Quarter-Inch verifies as "10."
Meal
Mooching |
Tuscon Int'l AP Climatology from NWS Western Region |
Arizona Surface Reports from MesoWest Project | |||
| Return
to: |
|||||
| EAS 385 Site | |||||
SNOWFALL GAME: In this game, you are attempting to predict the amount of new snow that will fall at Saint Cloud State Univerisity in whole numbers of inches during a given time period. The verification amounts are rounded to the nearest inch. Therefore, if you forecasted 2 inches to fall on Monday night and SCSU reported 2.4 inches, then the 2.4 would be rounded to 2 and you would have hit it on the nose. This also means that snowfall verifies as zero unless SCSU receives at least 0.5". Zero is a legitimate forecast in this game.Also, note that, for a snowstorm, you should have a number above zero in both the P-AMOUNT and SNOWFALL games if you expect at least 0.5 inch of accumulation and at least .01 inch measurable (usually a solid dusting).
Meal
Mooching |
Tuscon Int'l AP Climatology from NWS Western Region |
Arizona Surface Reports from MesoWest Project | |||
| Return
to: |
|||||
| EAS 385 Site | |||||
Meal
Mooching |
Tuscon Int'l AP Climatology from NWS Western Region |
Arizona Surface Reports from MesoWest Project | |||
| Return
to: |
|||||
| EAS 385 Site | |||||
The forecast standings are expressed as a percentage improvement over a "consensus" forecast. The consensus forecast is the average forecast of all EAS department forecasters who played that day. Therefore, the idea of the game is to make a better forecast than "consensus". This method helps to balance the difference between "easy" forecasting days (when everyone is very close to the actual temperature) and "tough" forecasting days (when most people are way off). An illustration is given below.
Anderson's Forecast
| Forecast Period |
Min/Max Temperature |
Probability of .01 inch |
Probability of .25 inch |
P-Amount |
Snowfall |
Monday Night |
12 |
1 |
0 |
0 |
0 |
Tuesday |
32 |
2 |
0 |
0 |
0 |
Tuesday Night |
15 |
0 |
0 |
0 |
0 |
Wednesday |
38 |
0 |
0 |
0 |
0 |
Weisman's Forecast (a.k.a. The Evil Empire):
| Forecast Period |
Min/Max Temperature |
Probability of .01 inch |
Probability of .25 inch |
P-Amount |
Snowfall |
Monday Night |
10 |
2 |
1 |
1 |
1 |
Tuesday |
35 |
1 |
0 |
0 |
0 |
Tuesday Night |
12 |
0 |
0 |
0 |
0 |
Wednesday |
41 |
0 |
0 |
0 |
0 |
If Anderson and Weisman are the only 2 players in the game, then consensus would be the average of the 2 forecasts and would appear as follows:
CONSENSUS FORECAST
| Forecast Period |
Min/Max Temperature |
Probability of .01 inch |
Probability of .25 inch |
P-Amount |
Snowfall |
Monday Night |
11 |
2 |
1 |
1 |
1 |
Tuesday |
35 |
2 |
0 |
0 |
0 |
Tuesday Night |
14 |
0 |
0 |
0 |
0 |
Wednesday |
40 |
0 |
0 |
0 |
0 |
Let's say that what actually happened was that no precipitation was reported and Monday night's low was 14, Monday's high was 37, Tuesday night's low was 20, and Wednesday's high was 36. So, the verification is:
| Forecast Period |
Min/Max Temperature |
Probability of .01 inch |
Probability of .25 inch |
P-Amount |
Snowfall |
Monday Night |
14 |
0 |
0 |
0 |
0 |
Tuesday |
37 |
0 |
0 |
0 |
0 |
Tuesday Night |
20 |
0 |
0 |
0 |
0 |
Wednesday |
36 |
0 |
0 |
0 |
0 |
The forecast game, if you used the predict history menu for this date, would look like this for Anderson:
| Forecast Period |
Min/Max Temperature |
Probability of .01 inch |
Probability of .25 inch |
P-Amount |
Snowfall |
Monday Night |
12|11|14 |
1|2|0 |
0|1|0 |
0|1|0 |
0|1|0 |
Tuesday |
32|34|37 |
2|2|0 |
0|0|0 |
0|0|0 |
0|0|0 |
Tuesday Night |
15|14|20 |
0|0|0 |
0|0|0 |
0|0|0 |
0|0|0 |
Wednesday |
38|40|36 |
0|0|0 |
0|0|0 |
0|0|0 |
0|0|0 |
On Monday night, Anderson missed the low by 2 degrees, but consensus missed it by 3 degrees. So, Anderson gains a degree error point on consensus. Anderson was off by 5 degrees on his Tuesday high while consensus missed by 3 degrees there, so he loses two degree error points on that forecast. Similarly, Anderson gets 5 error points on Tuesday night's low while consensus gets 6 and Anderson gets 2 error points on Wednesday's high while consensus gets 2. So, for Monday's temperature forecasts, Anderson got a total of 2+5+5+2 = 14 error points while consensus got 3+3+6+2 = 14 error points. The percentage improvement on consensus for the temperature and precipitation amount games are based on the following formula.
S = Total consensus error points - total forecaster error points X 100‰
Total
consensus error points
So, Anderson's temperature score for Monday would be
(14-14)/14 = 0.0%
For the probability game, Anderson only picked up error points in the Probability of .01 inch game. Note, however, that these errors points are squared. So, Anderson picked up 1 POP error points for Monday night and 4 POP error points for Tuesday for a total of 5. Consensus also received 4 POP error points for Monday night and 4 more POP error points for Tuesday for a total of 8.
In the probability of .25 inch game, Anderson had zero error points, but consensus (thanks to Weisman's rotten forecasting) has 1 error point.
The POP error points of both POP games are combined then turned into a percentage using the formula above. So, Anderson's POP score is: (8-5)/8 = 37.5% and his POP.25 score is: (1-0)/1 = +100.0%. The error points for both games are combined into a total POP score. So, Anderson's all POP score is: (9-5)/9 = +44.44%
Another percentage score is made from the P-Amount games (P-Amount and Snowfall). In this case, Anderson again has zero error points, but consensus has 2 error points. So, the total P-amount score is: (2-0)/2 = +100.0%.
The total game score for each forecast is:
Total Score = .50(Temperature Score) + .25(POP Score) + .25(P-Amount Score)
Running totals of error points are used to make the total standings, i.e., we don't average the daily scores...we compute the total score through all forecasts using the running error point totals. So, for the day, Anderson has earned the incredible score of +36.11%. Here's another example. In practice, it is very hard to beat consensus.
Meal
Mooching |
Tuscon Int'l AP Climatology from NWS Western Region |
Arizona Surface Reports from MesoWest Project | |||
| Return
to: |
|||||
| EAS 385 Site | |||||
BOB WEISMAN'S FORECAST CHALLENGE: Anyone who makes the minimum number of forecasts in a given semester and beats Bob Weisman in the final standings at the end of the semester gets treated to a free meal. Recent semesters have proven that Bob's forecasting is the only thing balancing out the weak economy.
Meal
Mooching |
Tuscon Int'l AP Climatology from NWS Western Region |
Arizona Surface Reports from MesoWest Project | |||
| Return
to: |
|||||
| EAS 385 Site | |||||
Spring 2010 Second City Selection
Meal
Mooching |
Tuscon Int'l AP Climatology from NWS Western Region |
Arizona Surface Reports from MesoWest Project | |||
| Return
to: |
|||||
| EAS 385 Site | |||||
Last Updated: Tuesday, January 5, 2010 11:51 AM
Send questions or comments to Bob Weisman