The Lab
Autoresearch loop: overnight batches run experiments, keep winners, discard losers. Edit program.md files to steer what gets tried next.
Total Experiments
72
Kept
57
79.2% keep rate
Tiers Active
8
of 9
Best Model
persistence
Experiment Timeline (Metric by Tier)
Win Rate by Tier
Model Leaderboard
| Rank | Model | ISO | MAPE ↑ | Count | Status |
|---|---|---|---|---|---|
| 1 | persistence | ERCOT | 0.00% | 15 | Production |
| 2 | persistence | NYISO | 0.10% | 281 | Production |
| 3 | rolling_avg_24h | NYISO | 0.21% | 287 | Challenger |
| 4 | same_hour_yesterday | NYISO | 0.25% | 285 | Challenger |
| 5 | rolling_avg_24h | ERCOT | 0.53% | 15 | Challenger |
| 6 | rolling_avg_24h | SPP | 2.50% | 38 | Challenger |
| 7 | same_hour_yesterday | SPP | 4.05% | 40 | Challenger |
| 8 | persistence | SPP | 5.08% | 39 | Production |
Recent Experiments
Click a row to view details
| Module | Tier | ISO | Metric | Delta | Kept | When |
|---|---|---|---|---|---|---|
| loop7-weather-features | feature-extraction | ISO_NE | 0.1840 | +0.1840 | Yes | 50d ago |
| loop7-weather-features | feature-extraction | ISO_NE | 0.0000 | 0.0000 | Yes | 50d ago |
| loop7-weather-features | feature-extraction | ISO_NE | 24.3600 | +24.3600 | Yes | 50d ago |
| loop7-weather-features | feature-extraction | PJM | 0.0000 | 0.0000 | Yes | 50d ago |
| loop7-weather-features | feature-extraction | PJM | 22.3300 | +22.3300 | Yes | 50d ago |
| loop7-weather-features | feature-extraction | MISO | 0.0080 | +0.0080 | Yes | 50d ago |
| loop7-weather-features | feature-extraction | MISO | 0.3100 | +0.3100 | Yes | 50d ago |
| loop7-weather-features | feature-extraction | MISO | 0.0000 | 0.0000 | Yes | 50d ago |
| loop7-weather-features | feature-extraction | MISO | 26.5800 | +26.5800 | Yes | 50d ago |
| loop7-weather-features | feature-extraction | ERCOT | 0.0180 | +0.0180 | Yes | 50d ago |
| loop7-weather-features | feature-extraction | ERCOT | 0.3520 | +0.3520 | Yes | 50d ago |
| loop7-weather-features | feature-extraction | ERCOT | 4.2900 | +4.2900 | Yes | 50d ago |
| loop7-weather-features | feature-extraction | ERCOT | 3.2600 | +3.2600 | Yes | 50d ago |
| loop7-weather-features | feature-extraction | SPP | 0.1740 | +0.1740 | Yes | 50d ago |
| loop7-weather-features | feature-extraction | SPP | 0.2640 | +0.2640 | Yes | 50d ago |
| loop7-weather-features | feature-extraction | SPP | 2.9400 | +2.9400 | Yes | 50d ago |
| loop7-weather-features | feature-extraction | PJM | 0.3730 | +0.3730 | Yes | 50d ago |
| loop7-weather-features | feature-extraction | SPP | 10.3300 | +10.3300 | Yes | 50d ago |
| loop7-weather-features | feature-extraction | CAISO | 0.0120 | +0.0120 | Yes | 50d ago |
| loop7-weather-features | feature-extraction | CAISO | 0.2570 | +0.2570 | Yes | 50d ago |
| loop7-weather-features | feature-extraction | PJM | 0.0200 | +0.0200 | Yes | 50d ago |
| loop7-weather-features | feature-extraction | CAISO | 7.3800 | +7.3800 | Yes | 50d ago |
| loop7-weather-features | feature-extraction | CAISO | 1.9200 | +1.9200 | Yes | 50d ago |
| loop7-weather-features | feature-extraction | NYISO | 0.3800 | +0.3800 | Yes | 50d ago |
| loop7-weather-features | feature-extraction | NYISO | 0.1890 | +0.1890 | Yes | 50d ago |
| loop7-weather-features | feature-extraction | NYISO | 0.0000 | 0.0000 | Yes | 50d ago |
| loop7-weather-features | feature-extraction | NYISO | 21.6700 | +21.6700 | Yes | 50d ago |
| loop7-weather-features | feature-extraction | ISO_NE | 0.1860 | +0.1860 | Yes | 50d ago |
| price_forecasting | foundation llm zero | NYISO | 8.4928 | +1.2979 | Yes | 51d ago |
| price_forecasting | baseline | ERCOT | 12.1589 | -0.8547 | Yes | 51d ago |
| price_forecasting | foundation llm few | CAISO | 6.6275 | +0.9363 | Yes | 51d ago |
| price_forecasting | ml feature search | NYISO | 9.6065 | -0.8830 | Yes | 51d ago |
| price_forecasting | foundation llm few | ISO_NE | 7.3210 | -0.8103 | Yes | 51d ago |
| price_forecasting | ml feature search | MISO | 8.0518 | +1.1133 | Yes | 51d ago |
| price_forecasting | foundation llm zero | SPP | 9.0359 | -0.9002 | No | 51d ago |
| price_forecasting | foundation llm zero | CAISO | 8.8606 | +0.7756 | No | 51d ago |
| price_forecasting | baseline | PJM | 10.1990 | +0.1116 | Yes | 51d ago |
| price_forecasting | ml feature search | ISO_NE | 7.7550 | +0.4096 | Yes | 51d ago |
| price_forecasting | ml feature discovery | PJM | 9.0554 | -0.2510 | No | 51d ago |
| price_forecasting | foundation llm zero | PJM | 7.8736 | -0.8494 | No | 51d ago |
| price_forecasting | ml feature discovery | ISO_NE | 7.4034 | -0.9146 | Yes | 51d ago |
| price_forecasting | ensemble | ISO_NE | 5.0462 | -0.2759 | Yes | 51d ago |
| price_forecasting | statistical | NYISO | 9.8290 | -1.3045 | Yes | 51d ago |
| price_forecasting | foundation llm few | PJM | 6.3242 | +1.3528 | No | 51d ago |
| price_forecasting | statistical | MISO | 9.2923 | -0.1103 | Yes | 51d ago |
| price_forecasting | ensemble | MISO | 5.7718 | -0.8941 | Yes | 51d ago |
| price_forecasting | ensemble | ERCOT | 6.3174 | +0.3634 | No | 51d ago |
| price_forecasting | ensemble | PJM | 4.2239 | -0.6100 | No | 51d ago |
| price_forecasting | ensemble | CAISO | 6.2473 | -0.4166 | Yes | 52d ago |
| price_forecasting | foundation llm few | SPP | 7.2736 | -1.0079 | Yes | 52d ago |
| price_forecasting | statistical | SPP | 8.5462 | +0.7204 | No | 52d ago |
| price_forecasting | foundation llm zero | ISO_NE | 9.1524 | +0.5895 | Yes | 52d ago |
| price_forecasting | baseline | SPP | 10.8223 | +0.5573 | Yes | 52d ago |
| price_forecasting | ml feature search | ERCOT | 8.1581 | -1.2549 | Yes | 52d ago |
| price_forecasting | ml feature search | CAISO | 7.6818 | -0.0776 | No | 52d ago |
| price_forecasting | baseline | NYISO | 9.9044 | -0.9180 | Yes | 52d ago |
| price_forecasting | baseline | CAISO | 13.7481 | -0.6380 | Yes | 52d ago |
| price_forecasting | ml feature discovery | MISO | 7.6896 | -0.4877 | No | 52d ago |
| price_forecasting | ml feature search | PJM | 7.2153 | +0.3575 | No | 52d ago |
| price_forecasting | statistical | ISO_NE | 10.9823 | +1.2740 | Yes | 52d ago |
| price_forecasting | ml feature discovery | SPP | 5.9756 | +1.0141 | Yes | 52d ago |
| price_forecasting | ensemble | SPP | 4.0926 | +0.6282 | No | 52d ago |
| price_forecasting | baseline | MISO | 9.9801 | -0.4610 | Yes | 52d ago |
| price_forecasting | baseline | ISO_NE | 13.9604 | -1.1626 | Yes | 52d ago |
| price_forecasting | foundation llm few | ERCOT | 9.7936 | -0.6592 | No | 52d ago |
| price_forecasting | ml feature search | SPP | 9.8145 | +0.0172 | No | 52d ago |
| price_forecasting | foundation llm few | NYISO | 10.5758 | -0.4196 | Yes | 52d ago |
| price_forecasting | ml feature discovery | ERCOT | 5.7992 | +0.1072 | Yes | 52d ago |
| price_forecasting | ml feature discovery | CAISO | 7.7343 | +0.8088 | No | 52d ago |
| price_forecasting | ml feature discovery | NYISO | 6.4283 | +0.4486 | Yes | 53d ago |
| price_forecasting | foundation llm few | MISO | 7.9499 | -1.0811 | Yes | 53d ago |
| price_forecasting | statistical | ERCOT | 9.7658 | +1.2828 | Yes | 53d ago |