beezu commited on
Commit
b4bff1b
·
verified ·
1 Parent(s): dc52aea

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +39 -0
README.md ADDED
@@ -0,0 +1,39 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: sophosympatheia/Nova-Tempus-70B-v0.3
3
+ library_name: transformers
4
+ tags:
5
+ - mergekit
6
+ - merge
7
+ - not-for-all-audiences
8
+ - mlx
9
+ - mlx-my-repo
10
+ license: llama3.3
11
+ language:
12
+ - en
13
+ ---
14
+
15
+ # beezu/Nova-Tempus-70B-v0.3-Q4-mlx
16
+
17
+ The Model [beezu/Nova-Tempus-70B-v0.3-Q4-mlx](https://huggingface.co/beezu/Nova-Tempus-70B-v0.3-Q4-mlx) was converted to MLX format from [sophosympatheia/Nova-Tempus-70B-v0.3](https://huggingface.co/sophosympatheia/Nova-Tempus-70B-v0.3) using mlx-lm version **0.20.5**.
18
+
19
+ ## Use with mlx
20
+
21
+ ```bash
22
+ pip install mlx-lm
23
+ ```
24
+
25
+ ```python
26
+ from mlx_lm import load, generate
27
+
28
+ model, tokenizer = load("beezu/Nova-Tempus-70B-v0.3-Q4-mlx")
29
+
30
+ prompt="hello"
31
+
32
+ if hasattr(tokenizer, "apply_chat_template") and tokenizer.chat_template is not None:
33
+ messages = [{"role": "user", "content": prompt}]
34
+ prompt = tokenizer.apply_chat_template(
35
+ messages, tokenize=False, add_generation_prompt=True
36
+ )
37
+
38
+ response = generate(model, tokenizer, prompt=prompt, verbose=True)
39
+ ```