safoinetl commited on
Commit
17c2e0a
verified
1 Parent(s): ce88812

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +62 -7
README.md CHANGED
@@ -1,7 +1,62 @@
1
- ---
2
- license: mit
3
- tags:
4
- - unsloth
5
- - trl
6
- - sft
7
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: unsloth/mistral-7b-bnb-4bit
3
+ library_name: transformers
4
+ model_name: alzheimer_llm_model
5
+ tags:
6
+ - generated_from_trainer
7
+ - unsloth
8
+ - trl
9
+ - sft
10
+ licence: license
11
+ license: mit
12
+ language:
13
+ - en
14
+ pipeline_tag: question-answering
15
+ ---
16
+
17
+ # Model Card for alzheimer_llm_model
18
+
19
+ This model is a fine-tuned version of [unsloth/mistral-7b-bnb-4bit](https://huggingface.co/unsloth/mistral-7b-bnb-4bit).
20
+ It has been trained using [TRL](https://github.com/huggingface/trl).
21
+
22
+ ## Quick start
23
+
24
+ ```python
25
+ from transformers import pipeline
26
+
27
+ question = "If you had a time machine, but could only go to the past or the future once and never return, which would you choose and why?"
28
+ generator = pipeline("text-generation", model="safoinetl/alzheimer_llm_model", device="cuda")
29
+ output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
30
+ print(output["generated_text"])
31
+ ```
32
+
33
+ ## Training procedure
34
+
35
+ [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/safoinetl-tl/huggingface/runs/o6x727bw)
36
+
37
+ This model was trained with SFT.
38
+
39
+ ### Framework versions
40
+
41
+ - TRL: 0.12.1
42
+ - Transformers: 4.46.2
43
+ - Pytorch: 2.5.1+cu121
44
+ - Datasets: 3.1.0
45
+ - Tokenizers: 0.20.3
46
+
47
+ ## Citations
48
+
49
+
50
+
51
+ Cite TRL as:
52
+
53
+ ```bibtex
54
+ @misc{vonwerra2022trl,
55
+ title = {{TRL: Transformer Reinforcement Learning}},
56
+ author = {Leandro von Werra and Younes Belkada and Lewis Tunstall and Edward Beeching and Tristan Thrush and Nathan Lambert and Shengyi Huang and Kashif Rasul and Quentin Gallou茅dec},
57
+ year = 2020,
58
+ journal = {GitHub repository},
59
+ publisher = {GitHub},
60
+ howpublished = {\url{https://github.com/huggingface/trl}}
61
+ }
62
+ ```