Update README.md

README.md

@@ -4,10 +4,44 @@ language:
 - sv
 - da
 - 'no'
-- en
 pipeline_tag: text-generation
 inference:
   parameters:
     temperature: 0.6
+tags:
+ - pytorch
+ - llama
+ - llama-3
+ - ai-sweden
 ---
-# Model Card
+
+### Use with transformers
+
+See the snippet below for usage with Transformers:
+
+```python
+>>> import transformers
+>>> import torch
+
+>>> model_id = "AI-Sweden-Models/Llama-3-8B"
+
+>>> pipeline = transformers.pipeline(
+    "text-generation",
+    model=model_id,
+    model_kwargs={"torch_dtype": torch.bfloat16},
+    device_map="auto"
+)
+>>> pipeline("Hey how are you doing today?")
+```
+
+## Training Data
+
+`AI-Sweden-Models/Llama-3-8B` was trained on a subset from [The nordic pile](https://arxiv.org/abs/2303.17183)
+
+## Hardware and Software
+
+**Training Factors** We used custom training libraries, Meta's Research SuperCluster, and production clusters for pretraining. Fine-tuning, annotation, and evaluation were also performed on third-party cloud compute.
+
+## Benchmarks 
+
+Coming soon.