Triangle104 commited on
Commit
d49e78e
1 Parent(s): fad5cf8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +147 -0
README.md CHANGED
@@ -17,6 +17,153 @@ library_name: transformers
17
  This model was converted to GGUF format from [`oxyapi/oxy-1-small`](https://huggingface.co/oxyapi/oxy-1-small) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
18
  Refer to the [original model card](https://huggingface.co/oxyapi/oxy-1-small) for more details on the model.
19
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
20
  ## Use with llama.cpp
21
  Install llama.cpp through brew (works on Mac and Linux)
22
 
 
17
  This model was converted to GGUF format from [`oxyapi/oxy-1-small`](https://huggingface.co/oxyapi/oxy-1-small) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
18
  Refer to the [original model card](https://huggingface.co/oxyapi/oxy-1-small) for more details on the model.
19
 
20
+ ---
21
+ Model details:
22
+ -
23
+ Oxy 1 Small is a fine-tuned version of the Qwen/Qwen2.5-14B-Instruct language model, specialized for role-play
24
+ scenarios. Despite its small size, it delivers impressive performance
25
+ in generating engaging dialogues and interactive storytelling.
26
+
27
+
28
+ Developed by Oxygen (oxyapi), with contributions from TornadoSoftwares, Oxy 1 Small aims to provide an accessible and efficient language model for creative and immersive role-play experiences.
29
+
30
+
31
+
32
+
33
+
34
+
35
+
36
+ Model Details
37
+
38
+
39
+
40
+
41
+ Model Name: Oxy 1 Small
42
+ Model ID: oxyapi/oxy-1-small
43
+ Base Model: Qwen/Qwen2.5-14B-Instruct
44
+ Model Type: Chat Completions
45
+ Prompt Format: ChatML
46
+ License: Apache-2.0
47
+ Language: English
48
+ Tokenizer: Qwen/Qwen2.5-14B-Instruct
49
+ Max Input Tokens: 32,768
50
+ Max Output Tokens: 8,192
51
+
52
+
53
+
54
+
55
+
56
+
57
+
58
+ Features
59
+
60
+
61
+
62
+
63
+ Fine-tuned for Role-Play: Specially trained to generate dynamic and contextually rich role-play dialogues.
64
+ Efficient: Compact model size allows for faster inference and reduced computational resources.
65
+ Parameter Support:
66
+ temperature
67
+ top_p
68
+ top_k
69
+ frequency_penalty
70
+ presence_penalty
71
+ max_tokens
72
+
73
+
74
+
75
+
76
+
77
+
78
+
79
+
80
+
81
+ Metadata
82
+
83
+
84
+
85
+
86
+ Owned by: Oxygen (oxyapi)
87
+ Contributors: TornadoSoftwares
88
+ Description: A Qwen/Qwen2.5-14B-Instruct fine-tune for role-play trained on custom datasets
89
+
90
+
91
+
92
+
93
+
94
+
95
+
96
+ Usage
97
+
98
+
99
+
100
+
101
+ To utilize Oxy 1 Small for text generation in role-play scenarios,
102
+ you can load the model using the Hugging Face Transformers library:
103
+
104
+
105
+ from transformers import AutoModelForCausalLM, AutoTokenizer
106
+
107
+ tokenizer = AutoTokenizer.from_pretrained("oxyapi/oxy-1-small")
108
+ model = AutoModelForCausalLM.from_pretrained("oxyapi/oxy-1-small")
109
+
110
+ prompt = "You are a wise old wizard in a mystical land. A traveler approaches you seeking advice."
111
+ inputs = tokenizer(prompt, return_tensors="pt")
112
+ outputs = model.generate(**inputs, max_length=500)
113
+ response = tokenizer.decode(outputs[0], skip_special_tokens=True)
114
+ print(response)
115
+
116
+
117
+
118
+
119
+
120
+
121
+
122
+
123
+ Performance
124
+
125
+
126
+
127
+
128
+ Performance benchmarks for Oxy 1 Small are not available at this
129
+ time. Future updates may include detailed evaluations on relevant
130
+ datasets.
131
+
132
+
133
+
134
+
135
+
136
+
137
+
138
+ License
139
+
140
+
141
+
142
+
143
+ This model is licensed under the Apache 2.0 License.
144
+
145
+
146
+
147
+
148
+
149
+
150
+
151
+ Citation
152
+
153
+
154
+
155
+
156
+ If you find Oxy 1 Small useful in your research or applications, please cite it as:
157
+
158
+
159
+ @misc{oxy1small2024,
160
+ title={Oxy 1 Small: A Fine-Tuned Qwen2.5-14B-Instruct Model for Role-Play},
161
+ author={Oxygen (oxyapi)},
162
+ year={2024},
163
+ howpublished={\url{https://huggingface.co/oxyapi/oxy-1-small}},
164
+ }
165
+
166
+ ---
167
  ## Use with llama.cpp
168
  Install llama.cpp through brew (works on Mac and Linux)
169