Put both models in the evaluation table
Browse files
README.md
CHANGED
|
@@ -30,10 +30,12 @@ The model was then evaluated on [Mean Reciprocal Rank (MRR)](https://en.wikipedi
|
|
| 30 |
When the model has to pick the positive example out of a pool of 32, it almost always ranks it first. When
|
| 31 |
the pool is significantly enlarged to 10.000 functions, it still ranks the positive example highest most of the time.
|
| 32 |
|
| 33 |
-
| Model
|
| 34 |
-
|
| 35 |
-
| ARM64BERT
|
| 36 |
-
| ARM64BERT
|
|
|
|
|
|
|
| 37 |
|
| 38 |
## Purpose and use of the model
|
| 39 |
|
|
|
|
| 30 |
When the model has to pick the positive example out of a pool of 32, it almost always ranks it first. When
|
| 31 |
the pool is significantly enlarged to 10.000 functions, it still ranks the positive example highest most of the time.
|
| 32 |
|
| 33 |
+
| Model | Pool size | MRR | Recall@1 |
|
| 34 |
+
|----------------------|-----------|------|----------|
|
| 35 |
+
| ARM64BERT | 32 | 0.78 | 0.72 |
|
| 36 |
+
| ARM64BERT-embedding | 32 | 0.99 | 0.99 |
|
| 37 |
+
| ARM64BERT | 10.000 | 0.58 | 0.56 |
|
| 38 |
+
| ARM64BERT-embedding | 10.000 | 0.87 | 0.83 |
|
| 39 |
|
| 40 |
## Purpose and use of the model
|
| 41 |
|