update model card README.md
Browse files
    	
        README.md
    ADDED
    
    | @@ -0,0 +1,62 @@ | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | 
|  | |
| 1 | 
            +
            ---
         | 
| 2 | 
            +
            license: apache-2.0
         | 
| 3 | 
            +
            tags:
         | 
| 4 | 
            +
            - generated_from_trainer
         | 
| 5 | 
            +
            metrics:
         | 
| 6 | 
            +
            - accuracy
         | 
| 7 | 
            +
            - f1
         | 
| 8 | 
            +
            model-index:
         | 
| 9 | 
            +
            - name: distilroberta-base-mrl-sym
         | 
| 10 | 
            +
              results: []
         | 
| 11 | 
            +
            ---
         | 
| 12 | 
            +
             | 
| 13 | 
            +
            <!-- This model card has been generated automatically according to the information the Trainer had access to. You
         | 
| 14 | 
            +
            should probably proofread and complete it, then remove this comment. -->
         | 
| 15 | 
            +
             | 
| 16 | 
            +
            # distilroberta-base-mrl-sym
         | 
| 17 | 
            +
             | 
| 18 | 
            +
            This model is a fine-tuned version of [distilroberta-base](https://huggingface.co/distilroberta-base) on an unknown dataset.
         | 
| 19 | 
            +
            It achieves the following results on the evaluation set:
         | 
| 20 | 
            +
            - Loss: 0.0001
         | 
| 21 | 
            +
            - Accuracy: 1.0
         | 
| 22 | 
            +
            - F1: 1.0
         | 
| 23 | 
            +
             | 
| 24 | 
            +
            ## Model description
         | 
| 25 | 
            +
             | 
| 26 | 
            +
            More information needed
         | 
| 27 | 
            +
             | 
| 28 | 
            +
            ## Intended uses & limitations
         | 
| 29 | 
            +
             | 
| 30 | 
            +
            More information needed
         | 
| 31 | 
            +
             | 
| 32 | 
            +
            ## Training and evaluation data
         | 
| 33 | 
            +
             | 
| 34 | 
            +
            More information needed
         | 
| 35 | 
            +
             | 
| 36 | 
            +
            ## Training procedure
         | 
| 37 | 
            +
             | 
| 38 | 
            +
            ### Training hyperparameters
         | 
| 39 | 
            +
             | 
| 40 | 
            +
            The following hyperparameters were used during training:
         | 
| 41 | 
            +
            - learning_rate: 2.740146306575944e-05
         | 
| 42 | 
            +
            - train_batch_size: 128
         | 
| 43 | 
            +
            - eval_batch_size: 128
         | 
| 44 | 
            +
            - seed: 42
         | 
| 45 | 
            +
            - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
         | 
| 46 | 
            +
            - lr_scheduler_type: linear
         | 
| 47 | 
            +
            - num_epochs: 2
         | 
| 48 | 
            +
             | 
| 49 | 
            +
            ### Training results
         | 
| 50 | 
            +
             | 
| 51 | 
            +
            | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1  |
         | 
| 52 | 
            +
            |:-------------:|:-----:|:----:|:---------------:|:--------:|:---:|
         | 
| 53 | 
            +
            | No log        | 1.0   | 150  | 0.0001          | 1.0      | 1.0 |
         | 
| 54 | 
            +
            | No log        | 2.0   | 300  | 0.0001          | 1.0      | 1.0 |
         | 
| 55 | 
            +
             | 
| 56 | 
            +
             | 
| 57 | 
            +
            ### Framework versions
         | 
| 58 | 
            +
             | 
| 59 | 
            +
            - Transformers 4.18.0
         | 
| 60 | 
            +
            - Pytorch 1.12.0.dev20220422+cu116
         | 
| 61 | 
            +
            - Datasets 2.1.0
         | 
| 62 | 
            +
            - Tokenizers 0.12.1
         | 
