Hugging Face's logo

haesun
/
bert-base-uncased-issues-128

Fill-Mask
Transformers
PyTorch
bert
Generated from Trainer
Model card Files
xet
Community
2
haesun commited on
Commit
3e0698f
·
1 Parent(s): 4d7bdc9

Training complete!

Browse files
Files changed (7) hide show
  1. README.md +22 -21
  2. added_tokens.json +7 -0
  3. config.json +1 -1
  4. generation_config.json +1 -1
  5. pytorch_model.bin +2 -2
  6. tokenizer_config.json +44 -2
  7. training_args.bin +2 -2
README.md CHANGED
@@ -1,5 +1,6 @@
1
  ---
2
  license: apache-2.0
 
3
  tags:
4
  - generated_from_trainer
5
  model-index:
@@ -14,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
14
 
15
  This model is a fine-tuned version of [bert-base-uncased](https://huggingface.co/bert-base-uncased) on the None dataset.
16
  It achieves the following results on the evaluation set:
17
- - Loss: 1.2456
18
 
19
  ## Model description
20
 
@@ -45,27 +46,27 @@ The following hyperparameters were used during training:
45
 
46
  | Training Loss | Epoch | Step | Validation Loss |
47
  |:-------------:|:-----:|:----:|:---------------:|
48
- | 2.0986 | 1.0 | 291 | 1.6929 |
49
- | 1.6401 | 2.0 | 582 | 1.4304 |
50
- | 1.4881 | 3.0 | 873 | 1.3916 |
51
- | 1.4 | 4.0 | 1164 | 1.3796 |
52
- | 1.3416 | 5.0 | 1455 | 1.2012 |
53
- | 1.2807 | 6.0 | 1746 | 1.2733 |
54
- | 1.2396 | 7.0 | 2037 | 1.2646 |
55
- | 1.1993 | 8.0 | 2328 | 1.2098 |
56
- | 1.1661 | 9.0 | 2619 | 1.1862 |
57
- | 1.1406 | 10.0 | 2910 | 1.2223 |
58
- | 1.1294 | 11.0 | 3201 | 1.2056 |
59
- | 1.1042 | 12.0 | 3492 | 1.1655 |
60
- | 1.0827 | 13.0 | 3783 | 1.2525 |
61
- | 1.0738 | 14.0 | 4074 | 1.1685 |
62
- | 1.0626 | 15.0 | 4365 | 1.1182 |
63
- | 1.0629 | 16.0 | 4656 | 1.2456 |
64
 
65
 
66
  ### Framework versions
67
 
68
- - Transformers 4.26.1
69
- - Pytorch 1.13.1+cu116
70
- - Datasets 2.10.1
71
- - Tokenizers 0.13.2
 
1
  ---
2
  license: apache-2.0
3
+ base_model: bert-base-uncased
4
  tags:
5
  - generated_from_trainer
6
  model-index:
 
15
 
16
  This model is a fine-tuned version of [bert-base-uncased](https://huggingface.co/bert-base-uncased) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 1.1725
19
 
20
  ## Model description
21
 
 
46
 
47
  | Training Loss | Epoch | Step | Validation Loss |
48
  |:-------------:|:-----:|:----:|:---------------:|
49
+ | 2.1083 | 1.0 | 291 | 1.6830 |
50
+ | 1.6339 | 2.0 | 582 | 1.3684 |
51
+ | 1.4793 | 3.0 | 873 | 1.4214 |
52
+ | 1.3969 | 4.0 | 1164 | 1.4244 |
53
+ | 1.3425 | 5.0 | 1455 | 1.2755 |
54
+ | 1.2837 | 6.0 | 1746 | 1.3189 |
55
+ | 1.2316 | 7.0 | 2037 | 1.2051 |
56
+ | 1.2106 | 8.0 | 2328 | 1.2933 |
57
+ | 1.1779 | 9.0 | 2619 | 1.2659 |
58
+ | 1.1491 | 10.0 | 2910 | 1.2092 |
59
+ | 1.1254 | 11.0 | 3201 | 1.2649 |
60
+ | 1.0971 | 12.0 | 3492 | 1.1623 |
61
+ | 1.0925 | 13.0 | 3783 | 1.1459 |
62
+ | 1.0772 | 14.0 | 4074 | 1.0685 |
63
+ | 1.0648 | 15.0 | 4365 | 1.2594 |
64
+ | 1.0651 | 16.0 | 4656 | 1.1725 |
65
 
66
 
67
  ### Framework versions
68
 
69
+ - Transformers 4.34.0
70
+ - Pytorch 2.0.1+cu118
71
+ - Datasets 2.14.5
72
+ - Tokenizers 0.14.1
added_tokens.json ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ {
2
+ "[CLS]": 101,
3
+ "[MASK]": 103,
4
+ "[PAD]": 0,
5
+ "[SEP]": 102,
6
+ "[UNK]": 100
7
+ }
config.json CHANGED
@@ -19,7 +19,7 @@
19
  "pad_token_id": 0,
20
  "position_embedding_type": "absolute",
21
  "torch_dtype": "float32",
22
- "transformers_version": "4.26.1",
23
  "type_vocab_size": 2,
24
  "use_cache": true,
25
  "vocab_size": 30522
 
19
  "pad_token_id": 0,
20
  "position_embedding_type": "absolute",
21
  "torch_dtype": "float32",
22
+ "transformers_version": "4.34.0",
23
  "type_vocab_size": 2,
24
  "use_cache": true,
25
  "vocab_size": 30522
generation_config.json CHANGED
@@ -1,5 +1,5 @@
1
  {
2
  "_from_model_config": true,
3
  "pad_token_id": 0,
4
- "transformers_version": "4.26.1"
5
  }
 
1
  {
2
  "_from_model_config": true,
3
  "pad_token_id": 0,
4
+ "transformers_version": "4.34.0"
5
  }
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f63a79b77a558916ac50589b2746739e84895ff8eb03ee2f97fa1430a869bf6a
3
- size 438130617
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ed9f87cd27329f1f800be3b30a138b5bf917834f4ea4d35defa8bff314058ad7
3
+ size 438126133
tokenizer_config.json CHANGED
@@ -1,12 +1,54 @@
1
  {
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2
  "cls_token": "[CLS]",
3
  "do_lower_case": true,
4
  "mask_token": "[MASK]",
5
  "model_max_length": 512,
6
- "name_or_path": "bert-base-uncased",
7
  "pad_token": "[PAD]",
8
  "sep_token": "[SEP]",
9
- "special_tokens_map_file": null,
10
  "strip_accents": null,
11
  "tokenize_chinese_chars": true,
12
  "tokenizer_class": "BertTokenizer",
 
1
  {
2
+ "added_tokens_decoder": {
3
+ "0": {
4
+ "content": "[PAD]",
5
+ "lstrip": false,
6
+ "normalized": false,
7
+ "rstrip": false,
8
+ "single_word": false,
9
+ "special": true
10
+ },
11
+ "100": {
12
+ "content": "[UNK]",
13
+ "lstrip": false,
14
+ "normalized": false,
15
+ "rstrip": false,
16
+ "single_word": false,
17
+ "special": true
18
+ },
19
+ "101": {
20
+ "content": "[CLS]",
21
+ "lstrip": false,
22
+ "normalized": false,
23
+ "rstrip": false,
24
+ "single_word": false,
25
+ "special": true
26
+ },
27
+ "102": {
28
+ "content": "[SEP]",
29
+ "lstrip": false,
30
+ "normalized": false,
31
+ "rstrip": false,
32
+ "single_word": false,
33
+ "special": true
34
+ },
35
+ "103": {
36
+ "content": "[MASK]",
37
+ "lstrip": false,
38
+ "normalized": false,
39
+ "rstrip": false,
40
+ "single_word": false,
41
+ "special": true
42
+ }
43
+ },
44
+ "additional_special_tokens": [],
45
+ "clean_up_tokenization_spaces": true,
46
  "cls_token": "[CLS]",
47
  "do_lower_case": true,
48
  "mask_token": "[MASK]",
49
  "model_max_length": 512,
 
50
  "pad_token": "[PAD]",
51
  "sep_token": "[SEP]",
 
52
  "strip_accents": null,
53
  "tokenize_chinese_chars": true,
54
  "tokenizer_class": "BertTokenizer",
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:50c5a337effdce84df871f86e6073f8d26e963814b83386cf068b528c23456e8
3
- size 3515
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:027655ae2ded7a80b2518ea374ec113356bb444961cfb08c69b1f8df2169273a
3
+ size 4091