Update app.py
Browse files
app.py
CHANGED
|
@@ -444,10 +444,15 @@ with demo:
|
|
| 444 |
|
| 445 |
```python
|
| 446 |
from datasets import load_dataset
|
| 447 |
-
dataset = load_dataset("Exploration-Lab/IL-TUR","<task_name>")
|
| 448 |
```
|
| 449 |
|
| 450 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 451 |
"""
|
| 452 |
)
|
| 453 |
|
|
|
|
| 444 |
|
| 445 |
```python
|
| 446 |
from datasets import load_dataset
|
| 447 |
+
dataset = load_dataset("Exploration-Lab/IL-TUR", "<task_name>", revision="script")
|
| 448 |
```
|
| 449 |
|
| 450 |
+
## Creating a submission file
|
| 451 |
+
|
| 452 |
+
A submission file should exactly follow the format as "IL_TUR_eval_submission_dummy.json".
|
| 453 |
+
Each key in the file corresponds to each task. You can submit predictions for one, multiple, or all tasks.
|
| 454 |
+
However, for any task you submit, you should have predictions corresponding to every instance in the test set (keys in the submission file).
|
| 455 |
+
In most cases, the format of the predictions is similar to that of the gold-standard labels in the dataset.
|
| 456 |
"""
|
| 457 |
)
|
| 458 |
|