Challenge library
EpiBenchmark ships with a library of predefined challenges (challenges have fixed hub, target, dates, horizons, quantiles, locations, and scoring requirements). Explore each challenge in our library below. You can list them locally via the command line with epibench list, and fully download a bundled challenge with epibench fetch <challenge-id>.
Click a challenge to expand its definition.
epb_flu_inchosp_2023-2024_dev
| Field |
Value |
| Hub |
flusight-forecast-hub |
| Target |
wk inc flu hosp |
| Reference dates |
2023-10-14 → 2024-05-04 (30 dates) |
| Horizons |
0, 1, 2, 3 |
| Quantiles |
0.025, 0.25, 0.5, 0.75, 0.975 |
| Locations |
50 U.S. states + Washington D.C. + U.S. (52 total) |
| Baseline model |
FluSight-baseline |
| Scorecard |
total wis, 50_coverage, 95_coverage |
Ground-truth exclusions
Ground-truth observations are unavailable for the following location and target-end-date combinations:
| Location |
Target end date |
25 |
2024-05-18 |
25 |
2024-05-25 |
27 |
2024-05-18 |
27 |
2024-05-25 |
Forecast units corresponding to these combinations are excluded from scoring. They must still be present in model output to satisfy the challenge's complete-coverage validation.
epb_flu_inchosp_2024-2025_dev
| Field |
Value |
| Hub |
flusight-forecast-hub |
| Target |
wk inc flu hosp |
| Reference dates |
2024-11-23 → 2025-05-31 (27 dates) |
| Horizons |
0, 1, 2, 3 |
| Quantiles |
0.025, 0.25, 0.5, 0.75, 0.975 |
| Locations |
50 U.S. states + Washington D.C. + U.S. (52 total) |
| Baseline model |
FluSight-baseline |
| Scorecard |
total wis, 50_coverage, 95_coverage |
- Note:
epb_flu_inchosp_2025-2025_dev has a 1-week date discontinuity at 2025-01-25 due to a US government shutdown.
epb_flu_inchosp_2024-2026_dev
| Field |
Value |
| Hub |
flusight-forecast-hub |
| Target |
wk inc flu hosp |
| Reference dates |
2024-11-23 → 2025-05-31; 2025-11-22 → 2026-05-30 (55 dates total) |
| Horizons |
0, 1, 2, 3 |
| Quantiles |
0.025, 0.25, 0.5, 0.75, 0.975 |
| Locations |
50 U.S. states + Washington D.C. + U.S. (52 total) |
| Baseline model |
FluSight-baseline |
| Scorecard |
total wis, 50_coverage, 95_coverage |
- Note: This challenge combines
epb_flu_inchosp_2024-2025_dev and epb_flu_inchosp_2025-2026_dev. There is a 1-week discontinuity at 2025-01-25 and a break between the two flu seasons.
epb_flu_inchosp_2025-2026_dev
| Field |
Value |
| Hub |
flusight-forecast-hub |
| Target |
wk inc flu hosp |
| Reference dates |
2025-11-22 → 2026-05-30 (28 dates) |
| Horizons |
0, 1, 2, 3 |
| Quantiles |
0.025, 0.25, 0.5, 0.75, 0.975 |
| Locations |
50 U.S. states + Washington D.C. + U.S. (52 total) |
| Baseline model |
FluSight-baseline |
| Scorecard |
total wis, 50_coverage, 95_coverage |
epb_rsv_inchosp_2025-2026_dev
| Field |
Value |
| Hub |
rsv-forecast-hub |
| Target |
wk inc rsv hosp |
| Reference dates |
2025-11-22 → 2026-05-30 (28 dates) |
| Horizons |
0, 1, 2, 3 |
| Quantiles |
0.025, 0.25, 0.5, 0.75, 0.975 |
| Locations |
50 U.S. states + Washington D.C. + U.S. (52 total) |
| Baseline model |
RSVHub-baseline |
| Scorecard |
total wis, 50_coverage, 95_coverage |
epb_covid_inchosp_2024-2025_dev
| Field |
Value |
| Hub |
covid19-forecast-hub |
| Target |
wk inc covid hosp |
| Reference dates |
2024-11-23 → 2025-06-28 (30 dates) |
| Forecast target end dates |
2024-11-23 → 2025-07-19 |
| Horizons |
0, 1, 2, 3 |
| Quantiles |
0.025, 0.25, 0.5, 0.75, 0.975 |
| Locations |
50 U.S. states + Washington D.C. + U.S. (52 total) |
| Required forecast units |
6,240 (30 reference dates × 52 locations × 4 horizons) |
| Baseline model |
CovidHub-baseline |
| Bundled comparison models |
CEPH-Rtrend_covid, CovidHub-baseline, CovidHub-ensemble |
| Scorecard |
total wis, 50_coverage, 95_coverage |
- Note: Reference dates exclude
2024-11-30 and 2025-01-25. Puerto Rico is excluded.
epb_covid_inchosp_2025-2026_dev
| Field |
Value |
| Hub |
covid19-forecast-hub |
| Target |
wk inc covid hosp |
| Reference dates |
2025-07-12 → 2026-06-27 (44 dates) |
| Forecast target end dates |
2025-07-12 → 2026-07-18 |
| Horizons |
0, 1, 2, 3 |
| Quantiles |
0.025, 0.25, 0.5, 0.75, 0.975 |
| Locations |
50 U.S. states + Washington D.C. + U.S. (52 total) |
| Required forecast units |
9,152 (44 reference dates × 52 locations × 4 horizons) |
| Baseline model |
CovidHub-baseline |
| Bundled comparison models |
CMU-TimeSeries, CovidHub-baseline, CovidHub-ensemble |
| Scorecard |
total wis, 50_coverage, 95_coverage |
- Note: Reference dates exclude the seven weeks from
2025-10-04 through 2025-11-15 due to a U.S. government shutdown. Puerto Rico is excluded.