Commit
·
c0ec00c
1
Parent(s):
7427deb
Update README.md
Browse files
README.md
CHANGED
|
@@ -45,21 +45,6 @@ should probably proofread and complete it, then remove this comment. -->
|
|
| 45 |
|
| 46 |
This model is a fine-tuned version of [google/pegasus-x-base](https://huggingface.co/google/pegasus-x-base) on the arxiv-summarization dataset.
|
| 47 |
|
| 48 |
-
It achieves the following results on the evaluation set:
|
| 49 |
-
- Loss: 2.0127
|
| 50 |
-
|
| 51 |
-
### Training results
|
| 52 |
-
|
| 53 |
-
| Training Loss | Epoch | Step | Validation Loss |
|
| 54 |
-
|:-------------:|:-----:|:-----:|:---------------:|
|
| 55 |
-
| 2.6153 | 1.0 | 3172 | 2.1045 |
|
| 56 |
-
| 2.202 | 2.0 | 6344 | 2.0511 |
|
| 57 |
-
| 2.1547 | 3.0 | 9516 | 2.0282 |
|
| 58 |
-
| 2.132 | 4.0 | 12688 | 2.0164 |
|
| 59 |
-
| 2.1222 | 5.0 | 15860 | 2.0127 |
|
| 60 |
-
|
| 61 |
-
|
| 62 |
-
|
| 63 |
|
| 64 |
**Base Model**: [Pegasus-x-base (State-of-the-art for Long Context Summarization)](https://huggingface.co/google/pegasus-x-base)
|
| 65 |
|
|
@@ -139,6 +124,20 @@ num_epochs: 5
|
|
| 139 |
```
|
| 140 |
|
| 141 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 142 |
### Framework versions
|
| 143 |
|
| 144 |
- Transformers 4.32.1
|
|
|
|
| 45 |
|
| 46 |
This model is a fine-tuned version of [google/pegasus-x-base](https://huggingface.co/google/pegasus-x-base) on the arxiv-summarization dataset.
|
| 47 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 48 |
|
| 49 |
**Base Model**: [Pegasus-x-base (State-of-the-art for Long Context Summarization)](https://huggingface.co/google/pegasus-x-base)
|
| 50 |
|
|
|
|
| 124 |
```
|
| 125 |
|
| 126 |
|
| 127 |
+
### Training results
|
| 128 |
+
|
| 129 |
+
| Training Loss | Epoch | Step | Validation Loss |
|
| 130 |
+
|:-------------:|:-----:|:-----:|:---------------:|
|
| 131 |
+
| 2.6153 | 1.0 | 3172 | 2.1045 |
|
| 132 |
+
| 2.202 | 2.0 | 6344 | 2.0511 |
|
| 133 |
+
| 2.1547 | 3.0 | 9516 | 2.0282 |
|
| 134 |
+
| 2.132 | 4.0 | 12688 | 2.0164 |
|
| 135 |
+
| 2.1222 | 5.0 | 15860 | 2.0127 |
|
| 136 |
+
|
| 137 |
+
|
| 138 |
+
|
| 139 |
+
|
| 140 |
+
|
| 141 |
### Framework versions
|
| 142 |
|
| 143 |
- Transformers 4.32.1
|