Update README.md
Browse files
README.md
CHANGED
@@ -23,18 +23,18 @@ This is a base model, it can be finetuned to a particular use case.
|
|
23 |
See the snippet below for usage with Transformers:
|
24 |
|
25 |
```python
|
26 |
-
|
27 |
-
|
28 |
|
29 |
-
|
30 |
|
31 |
-
|
32 |
-
"text-generation",
|
33 |
model=model_id,
|
34 |
model_kwargs={"torch_dtype": torch.bfloat16},
|
35 |
device_map="auto"
|
36 |
)
|
37 |
-
|
38 |
text_inputs="Sommar och sol är det bästa jag vet",
|
39 |
max_length=128,
|
40 |
repetition_penalty=1.03)
|
|
|
23 |
See the snippet below for usage with Transformers:
|
24 |
|
25 |
```python
|
26 |
+
import transformers
|
27 |
+
import torch
|
28 |
|
29 |
+
model_id = "AI-Sweden-Models/Llama-3-8B"
|
30 |
|
31 |
+
pipeline = transformers.pipeline(
|
32 |
+
task="text-generation",
|
33 |
model=model_id,
|
34 |
model_kwargs={"torch_dtype": torch.bfloat16},
|
35 |
device_map="auto"
|
36 |
)
|
37 |
+
pipeline(
|
38 |
text_inputs="Sommar och sol är det bästa jag vet",
|
39 |
max_length=128,
|
40 |
repetition_penalty=1.03)
|