namgoodfire commited on
Commit
596c864
·
verified ·
1 Parent(s): 18a303d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -277,6 +277,10 @@ logits, kv_cache, features = llama_3_1_8b.forward(
277
  print(llama_3_1_8b.tokenizer.decode(logits[-1].argmax(-1)))
278
  ```
279
 
 
 
 
 
280
  ## Responsibility & Safety
281
 
282
  Safety is at the core of everything we do at Goodfire. As a public benefit
 
277
  print(llama_3_1_8b.tokenizer.decode(logits[-1].argmax(-1)))
278
  ```
279
 
280
+ ## Training
281
+
282
+ Trained on activations harvested from Llama-3.3-70B-Instruct on the [LMSYS-Chat-1M dataset](https://arxiv.org/pdf/2309.11998).
283
+
284
  ## Responsibility & Safety
285
 
286
  Safety is at the core of everything we do at Goodfire. As a public benefit