eskayML commited on
Commit
31862d3
·
verified ·
1 Parent(s): cecdafb

eskayML/interview_electra

Browse files
README.md CHANGED
@@ -17,8 +17,8 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  This model is a fine-tuned version of [mrm8488/electra-small-finetuned-squadv2](https://huggingface.co/mrm8488/electra-small-finetuned-squadv2) on the None dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 1.3918
21
- - Accuracy: 0.7261
22
 
23
  ## Model description
24
 
@@ -49,31 +49,31 @@ The following hyperparameters were used during training:
49
 
50
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
51
  |:-------------:|:-----:|:----:|:---------------:|:--------:|
52
- | No log | 1.0 | 79 | 2.2793 | 0.1720 |
53
- | No log | 2.0 | 158 | 2.2569 | 0.2102 |
54
- | No log | 3.0 | 237 | 2.2141 | 0.2866 |
55
- | No log | 4.0 | 316 | 2.1554 | 0.3121 |
56
- | No log | 5.0 | 395 | 2.0661 | 0.5096 |
57
- | No log | 6.0 | 474 | 1.9949 | 0.5669 |
58
- | 2.2016 | 7.0 | 553 | 1.9088 | 0.5987 |
59
- | 2.2016 | 8.0 | 632 | 1.8361 | 0.5605 |
60
- | 2.2016 | 9.0 | 711 | 1.7648 | 0.6306 |
61
- | 2.2016 | 10.0 | 790 | 1.7013 | 0.6561 |
62
- | 2.2016 | 11.0 | 869 | 1.6548 | 0.6115 |
63
- | 2.2016 | 12.0 | 948 | 1.5916 | 0.6943 |
64
- | 1.812 | 13.0 | 1027 | 1.5425 | 0.6943 |
65
- | 1.812 | 14.0 | 1106 | 1.5137 | 0.7006 |
66
- | 1.812 | 15.0 | 1185 | 1.4722 | 0.7261 |
67
- | 1.812 | 16.0 | 1264 | 1.4426 | 0.7197 |
68
- | 1.812 | 17.0 | 1343 | 1.4216 | 0.7197 |
69
- | 1.812 | 18.0 | 1422 | 1.4061 | 0.7325 |
70
- | 1.5304 | 19.0 | 1501 | 1.3961 | 0.7325 |
71
- | 1.5304 | 20.0 | 1580 | 1.3918 | 0.7261 |
72
 
73
 
74
  ### Framework versions
75
 
76
- - Transformers 4.41.1
77
  - Pytorch 2.3.0+cu121
78
- - Datasets 2.19.2
79
  - Tokenizers 0.19.1
 
17
 
18
  This model is a fine-tuned version of [mrm8488/electra-small-finetuned-squadv2](https://huggingface.co/mrm8488/electra-small-finetuned-squadv2) on the None dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 1.4308
21
+ - Accuracy: 0.8675
22
 
23
  ## Model description
24
 
 
49
 
50
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
51
  |:-------------:|:-----:|:----:|:---------------:|:--------:|
52
+ | No log | 1.0 | 76 | 2.2703 | 0.1589 |
53
+ | No log | 2.0 | 152 | 2.2403 | 0.1656 |
54
+ | No log | 3.0 | 228 | 2.1815 | 0.3311 |
55
+ | No log | 4.0 | 304 | 2.1125 | 0.4636 |
56
+ | No log | 5.0 | 380 | 2.0395 | 0.4503 |
57
+ | No log | 6.0 | 456 | 1.9782 | 0.5232 |
58
+ | 2.1758 | 7.0 | 532 | 1.9149 | 0.4768 |
59
+ | 2.1758 | 8.0 | 608 | 1.8410 | 0.5497 |
60
+ | 2.1758 | 9.0 | 684 | 1.7949 | 0.5497 |
61
+ | 2.1758 | 10.0 | 760 | 1.7268 | 0.6159 |
62
+ | 2.1758 | 11.0 | 836 | 1.6659 | 0.6159 |
63
+ | 2.1758 | 12.0 | 912 | 1.6137 | 0.6755 |
64
+ | 2.1758 | 13.0 | 988 | 1.5773 | 0.7086 |
65
+ | 1.8023 | 14.0 | 1064 | 1.5381 | 0.7748 |
66
+ | 1.8023 | 15.0 | 1140 | 1.5067 | 0.8013 |
67
+ | 1.8023 | 16.0 | 1216 | 1.4807 | 0.8344 |
68
+ | 1.8023 | 17.0 | 1292 | 1.4590 | 0.8543 |
69
+ | 1.8023 | 18.0 | 1368 | 1.4447 | 0.8477 |
70
+ | 1.8023 | 19.0 | 1444 | 1.4338 | 0.8675 |
71
+ | 1.5562 | 20.0 | 1520 | 1.4308 | 0.8675 |
72
 
73
 
74
  ### Framework versions
75
 
76
+ - Transformers 4.41.2
77
  - Pytorch 2.3.0+cu121
78
+ - Datasets 2.20.0
79
  - Tokenizers 0.19.1
config.json CHANGED
@@ -48,7 +48,7 @@
48
  "summary_type": "first",
49
  "summary_use_proj": true,
50
  "torch_dtype": "float32",
51
- "transformers_version": "4.41.1",
52
  "type_vocab_size": 2,
53
  "use_cache": true,
54
  "vocab_size": 30522
 
48
  "summary_type": "first",
49
  "summary_use_proj": true,
50
  "torch_dtype": "float32",
51
+ "transformers_version": "4.41.2",
52
  "type_vocab_size": 2,
53
  "use_cache": true,
54
  "vocab_size": 30522
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3256ccee7c54ed91f76c0961e16713673deaa45fda905519bf0076b18b92385c
3
  size 54229432
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fd24b399577bace44cfe73c644899447bf7122417aa76b0fd34e6596b2f7800e
3
  size 54229432
runs/Jun18_19-56-01_0c265ed1ed29/events.out.tfevents.1718740561.0c265ed1ed29.821.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2ae9fe8eccbf9fe7634e48ac363585fb6efa25d2c21926544f7fdc86383e0a1f
3
+ size 13229
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:730a70e966adc43050536a96f84b724c667993f45cc633d476784af89f06405d
3
  size 5112
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f86d160236237f69bf142295e246e69ca12c3d78c4396a46dfa320e70a718bee
3
  size 5112