File size: 6,504 Bytes
704b9d8
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
---
license: apache-2.0
base_model: facebook/wav2vec2-base
tags:
- audio-classification
- generated_from_trainer
datasets:
- superb
metrics:
- accuracy
model-index:
- name: superb_ks_42
  results:
  - task:
      name: Audio Classification
      type: audio-classification
    dataset:
      name: superb
      type: superb
      config: ks
      split: validation
      args: ks
    metrics:
    - name: Accuracy
      type: accuracy
      value: 0.6209179170344219
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# superb_ks_42

This model is a fine-tuned version of [facebook/wav2vec2-base](https://huggingface.co/facebook/wav2vec2-base) on the superb dataset.
It achieves the following results on the evaluation set:
- Loss: 1051591.375
- Accuracy: 0.6209
- Test Accuracy: 0.6209
- Df Accuracy: 0.1352
- Unlearn Overall Accuracy: 0.7429
- Unlearn Time: 11585.2870

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 32
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- lr_scheduler_warmup_ratio: 0.1
- num_epochs: 20

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Accuracy | Overall Accuracy | Unlearn Overall Accuracy | Time |
|:-------------:|:-----:|:-----:|:---------------:|:--------:|:----------------:|:------------------------:|:----:|
| 0.0           | 0.5   | 1564  | 2.0251          | 0.5642   | 0.6213           | 0.6213                   | -1   |
| 0.0           | 1.0   | 3128  | 24.9043         | 0.1352   | 0.7429           | 0.7429                   | -1   |
| 0.0           | 1.5   | 4692  | 118.8172        | 0.1342   | 0.7431           | 0.7431                   | -1   |
| 0.0           | 2.0   | 6256  | 360.7070        | 0.1342   | 0.7404           | 0.7404                   | -1   |
| 0.0           | 2.5   | 7820  | 1797.0188       | 0.1352   | 0.7429           | 0.7429                   | -1   |
| 0.0           | 3.0   | 9384  | 1833.0411       | 0.1342   | 0.7407           | 0.7407                   | -1   |
| 0.0           | 3.5   | 10948 | 5951.4312       | 0.1352   | 0.7391           | 0.7391                   | -1   |
| 0.0           | 4.0   | 12512 | 23488.5137      | 0.1352   | 0.7429           | 0.7429                   | -1   |
| 0.0           | 4.5   | 14076 | 43524.4297      | 0.1352   | 0.7429           | 0.7429                   | -1   |
| 0.0           | 5.0   | 15640 | 61965.0234      | 0.1352   | 0.7429           | 0.7429                   | -1   |
| 0.0           | 5.5   | 17204 | 83421.5312      | 0.1352   | 0.7429           | 0.7429                   | -1   |
| 0.0           | 6.0   | 18768 | 108193.9766     | 0.1352   | 0.7429           | 0.7429                   | -1   |
| 0.0           | 6.5   | 20332 | 136248.25       | 0.1352   | 0.7429           | 0.7429                   | -1   |
| 0.0           | 7.0   | 21896 | 167441.5938     | 0.1352   | 0.7429           | 0.7429                   | -1   |
| 0.0           | 7.5   | 23460 | 201594.4688     | 0.1352   | 0.7429           | 0.7429                   | -1   |
| 0.0           | 7.99  | 25024 | 238488.5        | 0.1352   | 0.7429           | 0.7429                   | -1   |
| 0.0           | 8.49  | 26588 | 277883.0625     | 0.1352   | 0.7429           | 0.7429                   | -1   |
| 0.0           | 8.99  | 28152 | 319393.5625     | 0.1352   | 0.7429           | 0.7429                   | -1   |
| 0.0           | 9.49  | 29716 | 362743.3438     | 0.1352   | 0.7429           | 0.7429                   | -1   |
| 0.0           | 9.99  | 31280 | 407556.3438     | 0.1352   | 0.7429           | 0.7429                   | -1   |
| 0.0           | 10.49 | 32844 | 453439.1875     | 0.1352   | 0.7429           | 0.7429                   | -1   |
| 0.0           | 10.99 | 34408 | 500049.6562     | 0.1352   | 0.7429           | 0.7429                   | -1   |
| 0.0           | 11.49 | 35972 | 546989.6875     | 0.1352   | 0.7429           | 0.7429                   | -1   |
| 0.0           | 11.99 | 37536 | 593870.5625     | 0.1352   | 0.7429           | 0.7429                   | -1   |
| 0.0           | 12.49 | 39100 | 640257.0        | 0.1352   | 0.7429           | 0.7429                   | -1   |
| 0.0           | 12.99 | 40664 | 685795.3125     | 0.1352   | 0.7429           | 0.7429                   | -1   |
| 0.0           | 13.49 | 42228 | 730008.5        | 0.1352   | 0.7429           | 0.7429                   | -1   |
| 0.0           | 13.99 | 43792 | 772677.1875     | 0.1352   | 0.7429           | 0.7429                   | -1   |
| 0.0           | 14.49 | 45356 | 813358.625      | 0.1352   | 0.7429           | 0.7429                   | -1   |
| 0.0           | 14.99 | 46920 | 851736.9375     | 0.1352   | 0.7429           | 0.7429                   | -1   |
| 0.0           | 15.49 | 48484 | 887515.625      | 0.1352   | 0.7429           | 0.7429                   | -1   |
| 0.0           | 15.99 | 50048 | 920330.625      | 0.1352   | 0.7429           | 0.7429                   | -1   |
| 0.0           | 16.49 | 51612 | 949979.0        | 0.1352   | 0.7429           | 0.7429                   | -1   |
| 0.0           | 16.99 | 53176 | 976159.25       | 0.1352   | 0.7429           | 0.7429                   | -1   |
| 0.0           | 17.49 | 54740 | 998714.6875     | 0.1352   | 0.7429           | 0.7429                   | -1   |
| 0.0           | 17.99 | 56304 | 1017460.9375    | 0.1352   | 0.7429           | 0.7429                   | -1   |
| 0.0           | 18.49 | 57868 | 1032206.9375    | 0.1352   | 0.7429           | 0.7429                   | -1   |
| 0.0           | 18.99 | 59432 | 1042871.625     | 0.1352   | 0.7429           | 0.7429                   | -1   |
| 0.0           | 19.49 | 60996 | 1049350.375     | 0.1352   | 0.7429           | 0.7429                   | -1   |
| 0.0           | 19.99 | 62560 | 1051591.375     | 0.1352   | 0.7429           | 0.7429                   | -1   |


### Framework versions

- Transformers 4.39.3
- Pytorch 2.2.2+cu118
- Datasets 2.18.0
- Tokenizers 0.15.2