Fix rankings: #1 Optimal Accuracy (88.7%), #2 Optimal Selection (43.0%), #7 overall / #5 open-source

README.md

@@ -19,15 +19,18 @@ metrics:
 
 ## Performance
 
-🏆 **#1 on RouterArena Leaderboard in Optimal Accuracy Score**
+🏆 **SOTA on RouterArena: #1 Optimal Accuracy Score, #2 Optimal Selection**
 
 Official RouterArena Full Dataset Results (8,400 queries):
-- **88.7% Optimal Accuracy Score** - 🥇 SOTA! Ranked #1 in this category
-- **64.9% Overall Accuracy** - #1 among open-source routers
-- **Arena Score: 63.8**
+- **88.7% Optimal Accuracy Score** - 🥇 #1 SOTA! (Best routing decision quality)
+- **43.0% Optimal Selection Score** - 🥈 #2 Silver! (Second-best model selection)
+- **64.9% Overall Accuracy** - #7 overall, #5 among open-source routers
+- **Arena Score: 63.8** - #7 overall, #5 among open-source routers
 - **$0.60 per 1K queries** - Cost-efficient routing
 
-The **Optimal Accuracy Score** measures how often the router makes the right routing decision - when Chayan selects a model for a query, that model provides the correct answer 88.7% of the time.
+**Key Metrics Explained:**
+- **Optimal Accuracy Score**: When Chayan routes to a model, that model gives the correct answer 88.7% of the time (highest on leaderboard!)
+- **Optimal Selection Score**: Chayan selects the best available model 43% of the time (second-best on leaderboard)
 
 Sub_10 Benchmark (809 queries):
 - **69.05% accuracy**
@@ -164,22 +167,29 @@ predictions = router.predict(augmented, k=4)
 
 ## RouterArena Leaderboard
 
-🏆 **Official Results - #1 in Optimal Accuracy Score Category**
+🏆 **Official Results - #1 Optimal Accuracy, #2 Optimal Selection**
 
 ![RouterArena Leaderboard](routerarena_leaderboard.png)
 
-Chayan on the official [RouterArena leaderboard](https://routeworks.github.io/):
+Chayan on the official [RouterArena leaderboard](https://routeworks.github.io/) (sorted by Optimal Accuracy):
 
-| Rank (Overall) | Router | Arena Score | Accuracy | **Opt. Acc** | Cost/1k | Type |
-|----------------|--------|-------------|----------|--------------|---------|------|
-| 1 | **Chayan** | 63.8 | 64.9% | **88.7%** 🥇 | $0.60 | Open-Source |
-| 2 | RouterBench-MLP | 57.6 | 61.6% | 83.3% | $4.80 | Open-Source |
-| 3 | Azure | 66.7 | 68.1% | 82.0% | $0.50 | Closed-Source |
-| 4 | vLLM-SR | 64.3 | 67.3% | 79.3% | $1.70 | Open-Source |
+| Rank | Router | **Opt. Acc** | **Opt. Select** | Accuracy | Arena Score | Cost/1k | Type |
+|------|--------|--------------|-----------------|----------|-------------|---------|------|
+| **1** | **Chayan** | **88.7%** 🥇 | **43.0%** 🥈 | 64.9% | 63.8 | $0.60 | Open-Source |
+| 2 | RouterBench-MLP | 83.3% | 13.4% | 61.6% | 57.6 | $4.80 | Open-Source |
+| 3 | Azure | 82.0% | 22.5% | 68.1% | 66.7 | $0.50 | Closed-Source |
+| 4 | vLLM-SR | 79.3% | 4.8% | 67.3% | 64.3 | $1.70 | Open-Source |
+| 5 | RouterBench-KNN | 78.8% | 13.1% | 58.7% | 55.5 | $4.30 | Open-Source |
 
-**🥇 SOTA Achievement - Optimal Accuracy Score Category**: Chayan achieves **88.7% Optimal Accuracy**, ranking **#1** in this critical metric across all routers on the leaderboard.
+**Overall Rankings:**
+- **Optimal Accuracy Score**: 🥇 #1 (88.7% - SOTA!)
+- **Optimal Selection Score**: 🥈 #2 (43.0% - Silver!)
+- **Overall Accuracy**: #7 overall, #5 among open-source
+- **Arena Score**: #7 overall, #5 among open-source
 
-**What is Optimal Accuracy Score?** This metric measures routing decision quality - when Chayan selects a model for a query, that model provides the correct answer 88.7% of the time. This is the highest score among all evaluated routers, demonstrating Chayan's superior model selection capability.
+**🥇 SOTA Achievement - Optimal Accuracy Score**: Chayan achieves **88.7%**, the highest score among all routers. This measures routing decision quality - when Chayan routes to a model, that model gives the correct answer 88.7% of the time.
+
+**🥈 Silver Medal - Optimal Selection Score**: Chayan ranks **#2** with **43.0%**, meaning it selects the optimal model (best among all available models) 43% of the time, second only to Azure's 46.3%.
 
 View the full leaderboard and PR: [RouterArena PR #24](https://github.com/RouteWorks/RouterArena/pull/24)