Update README.md
Browse files
README.md
CHANGED
|
@@ -44,6 +44,28 @@ It is _**the largest open-source vision/vision-language foundation model (14B)**
|
|
| 44 |
```python
|
| 45 |
TODO
|
| 46 |
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 47 |
|
| 48 |
## Citation
|
| 49 |
|
|
|
|
| 44 |
```python
|
| 45 |
TODO
|
| 46 |
```
|
| 47 |
+
## Evaluation
|
| 48 |
+
|
| 49 |
+
|
| 50 |
+
**MultiModal Benchmark**
|
| 51 |
+
|
| 52 |
+
| model | MME | MMB<sub>dev/test</sub> | MMB-CN<sub>dev/test</sub> | POPE | MMMU<sub>val/test</sub> | CMMMU<sub>val/test</sub> | Tiny<sub>LVLM</sub> | LLaVA<sub>bench</sub> |
|
| 53 |
+
| --------------------------------------------------------------------------------- | -------------- | ---------------------- | ------------------------- | ---- | ----------------------- | ------------------------ | ------------------- | --------------------- |
|
| 54 |
+
| [InternVL-Chat-V1.1](https://huggingface.co/OpenGVLab/InternVL-Chat-Chinese-V1.1) | 1672.3 / 341.1 | 76.6 / 75.4 | 71.5 / 70.1 | 87.2 | 39.1 / 35.3 | TODO | 344.5 | 76.3 |
|
| 55 |
+
|
| 56 |
+
|
| 57 |
+
**Visual Question Answering**
|
| 58 |
+
|
| 59 |
+
| model | VQAv2<sub>test</sub> | OKVQA<sub>val</sub> | TextVQA<sub>val</sub> | VizWiz<sub>val/test</sub> | AI2D<sub>test</sub> | GQA<sub>test</sub> | SQA<sub>test</sub> |
|
| 60 |
+
| --------------------------------------------------------------------------------- | -------------------- | ------------------- | --------------------- | ------------------------- | ------------------- | ------------------ | ------------------ |
|
| 61 |
+
| [InternVL-Chat-V1.1](https://huggingface.co/OpenGVLab/InternVL-Chat-Chinese-V1.1) | 80.9 | 64.2 | 65.8 | 58.3 / 57.3 | 70.23 | 62.4 | 91.2 |
|
| 62 |
+
|
| 63 |
+
**Image Captioning**
|
| 64 |
+
|
| 65 |
+
| model | COCO<sub>test</sub> | Flickr30K<sub>test</sub> | NoCaps<sub>val</sub> |
|
| 66 |
+
| --------------------------------------------------------------------------------- | ------------------- | ------------------------ | -------------------- |
|
| 67 |
+
| [InternVL-Chat-V1.1](https://huggingface.co/OpenGVLab/InternVL-Chat-Chinese-V1.1) | 141.8 | 84.3 | 120.4 |
|
| 68 |
+
|
| 69 |
|
| 70 |
## Citation
|
| 71 |
|