acalatrava
commited on
TinyLlama-1.1B-translate-en-es v2
Browse files- README.md +4 -4
- params_shard_1.bin +1 -1
- params_shard_10.bin +1 -1
- params_shard_11.bin +1 -1
- params_shard_12.bin +1 -1
- params_shard_13.bin +1 -1
- params_shard_14.bin +1 -1
- params_shard_15.bin +1 -1
- params_shard_16.bin +1 -1
- params_shard_17.bin +1 -1
- params_shard_18.bin +1 -1
- params_shard_19.bin +1 -1
- params_shard_2.bin +1 -1
- params_shard_20.bin +1 -1
- params_shard_21.bin +1 -1
- params_shard_3.bin +1 -1
- params_shard_4.bin +1 -1
- params_shard_5.bin +1 -1
- params_shard_6.bin +1 -1
- params_shard_7.bin +1 -1
- params_shard_8.bin +1 -1
- params_shard_9.bin +1 -1
README.md
CHANGED
@@ -13,7 +13,9 @@ language:
|
|
13 |
|
14 |
# TinyLlama-1.1B-translate-en-es
|
15 |
|
16 |
-
|
|
|
|
|
17 |
|
18 |
The translation is not very accurate but it shows a lot of potential.
|
19 |
|
@@ -40,12 +42,10 @@ Spain is left without Copilot for Windows 11: the control of the UE has halted i
|
|
40 |
```
|
41 |
|
42 |
---
|
43 |
-
The results are far from perfect but there are A LOT of room to improvement since it was finetuned with only
|
44 |
|
45 |
The base model used is a fine-tuned model with orca dataset [acalatrava/TinyLlama-1.1B-orca-gpt4](https://huggingface.co/acalatrava/TinyLlama-1.1B-orca-gpt4)
|
46 |
|
47 |
-
</div>
|
48 |
-
|
49 |
### Training
|
50 |
- **Method**: QLORA
|
51 |
- **Time**: 5h on a M1 Pro 32GB
|
|
|
13 |
|
14 |
# TinyLlama-1.1B-translate-en-es
|
15 |
|
16 |
+
</div>
|
17 |
+
|
18 |
+
This is a finetuned version with a partial dataset from alvations/globalvoices-en-es to test performance on translation task. It has been trained to translate english to spanish and viceversa with only 20k rows from the dataset.
|
19 |
|
20 |
The translation is not very accurate but it shows a lot of potential.
|
21 |
|
|
|
42 |
```
|
43 |
|
44 |
---
|
45 |
+
The results are far from perfect but there are A LOT of room to improvement since it was finetuned with only 20k rows from the dataset (which has 355k rows) for 2 epoch. This training took only about 5 hours on a "M1 Pro" processor.
|
46 |
|
47 |
The base model used is a fine-tuned model with orca dataset [acalatrava/TinyLlama-1.1B-orca-gpt4](https://huggingface.co/acalatrava/TinyLlama-1.1B-orca-gpt4)
|
48 |
|
|
|
|
|
49 |
### Training
|
50 |
- **Method**: QLORA
|
51 |
- **Time**: 5h on a M1 Pro 32GB
|
params_shard_1.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 31825920
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:e379538b88315cebbbb6925b4b24b9d51a1e3da61d27bf0f762c77a355f81616
|
3 |
size 31825920
|
params_shard_10.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 24780800
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:1a52c09ed67d790d57b43dcfe4439e7eaf4643f8e7dcdd39d93c6f7a19264604
|
3 |
size 24780800
|
params_shard_11.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 24780800
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:fa85357f9985dda0ed5a5a2cd797a6adbad3b463aa23ecd1231b33bbb701439d
|
3 |
size 24780800
|
params_shard_12.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 24780800
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:0aec6b03b0edd54d53001766ac783f0d02c2dd865f47ca2fe3ffe735f68998e7
|
3 |
size 24780800
|
params_shard_13.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 24780800
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:17d728de276ce5d3ba292063d77a3f6c629f3de1216dc4ca47a9f7b1239d54fb
|
3 |
size 24780800
|
params_shard_14.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 24780800
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:1b697abb6f512a0c2ae979c649b0f2a7d4f8182f678fb12e17a61c6dff446bb2
|
3 |
size 24780800
|
params_shard_15.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 24780800
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:a46a6217aea97e47cb8fa0c7ba91142b3390a59d2b11be0b5793cc2c8320b467
|
3 |
size 24780800
|
params_shard_16.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 24780800
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:2f8007abad5e506b63f85afb943e4a2ded4684a0da963212fa6716657418427d
|
3 |
size 24780800
|
params_shard_17.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 24780800
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:e3995ac6df9a9e909d43df83279c7641202f85477c8367ca9324358e53c962fa
|
3 |
size 24780800
|
params_shard_18.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 24780800
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:0cbb806708b2e8c59e32b1eac11eaf6776830aaaa62be37c33fd14f7c10d7952
|
3 |
size 24780800
|
params_shard_19.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 24780800
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:99c27ed0525810c19a2afdf06dd05c4680c299a7a595d66758a93ec6486d6960
|
3 |
size 24780800
|
params_shard_2.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 27140096
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:d2671979b0b1524bbdd741deb7ecb985f427adf1176a5247f89f37f41d646d24
|
3 |
size 27140096
|
params_shard_20.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 24780800
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:7a5c92ba0f0a1a2da9ccfce2ad2bd9edff42e000f608c11230e0f254dce32016
|
3 |
size 24780800
|
params_shard_21.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 24780800
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:42734829b0036fd18d9b7759d5ed7d0ecf3fc0efd134db6acd13167c09d4b7d5
|
3 |
size 24780800
|
params_shard_3.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 24780800
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:0fee5401a9ffd8bc571fa389029241307bdb9aa6389149384bd4c12e47dc7700
|
3 |
size 24780800
|
params_shard_4.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 24780800
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:958eadb932ee5bed0e17e4f88e700fd615a2c2a98f78ad1f8fc5237d30b57cec
|
3 |
size 24780800
|
params_shard_5.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 24780800
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:a4ffccda3298bca3b04f9dcaff525932b40127287a9d2e53ee1ea749c57b9538
|
3 |
size 24780800
|
params_shard_6.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 24780800
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:c8e1458ca521ede434f05783eea108e96f44a18b5a08b480a8d71ab9fc9eb7c3
|
3 |
size 24780800
|
params_shard_7.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 24780800
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:a494da41eb4ff449de91ad5471102b579791b7128be07fa338961bd2c2c91848
|
3 |
size 24780800
|
params_shard_8.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 24780800
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:cdf232adf87feb7dd697feb5636ccbe333b657d45af5fd48f18a8aa800db8ea8
|
3 |
size 24780800
|
params_shard_9.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 24780800
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:9bfac5bd1c83f6bec4304258eb06ee614173f58a255548d865e09f9478b47706
|
3 |
size 24780800
|