apepkuss79 commited on
Commit
e097aa6
1 Parent(s): 0052fed

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +42 -3
README.md CHANGED
@@ -1,3 +1,42 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: nvidia/Llama-3_1-Nemotron-51B-Instruct
3
+ license: other
4
+ license_name: nvidia-open-model-license
5
+ license_link: >-
6
+ https://developer.download.nvidia.com/licenses/nvidia-open-model-license-agreement-june-2024.pdf
7
+ model_creator: tiiuae
8
+ model_name: Llama-3_1-Nemotron-51B-Instruct
9
+ quantized_by: Second State Inc.
10
+ library_name: transformers
11
+ pipeline_tag: text-generation
12
+ language:
13
+ - en
14
+ tags:
15
+ - nvidia
16
+ - llama-3
17
+ - pytorch
18
+ ---
19
+
20
+ # Llama-3_1-Nemotron-51B-Instruct-GGUF
21
+
22
+ ## Original Model
23
+
24
+ [nvidia/Llama-3_1-Nemotron-51B-Instruct](https://huggingface.co/nvidia/Llama-3_1-Nemotron-51B-Instruct)
25
+
26
+ ## Run with Gaianet
27
+
28
+ **Prompt template:**
29
+
30
+ prompt template: `llama-3-chat`
31
+
32
+ **Context size:**
33
+
34
+ chat_ctx_size: `8192`
35
+
36
+ **Run with GaiaNet:**
37
+
38
+ - Quick start: https://docs.gaianet.ai/node-guide/quick-start
39
+
40
+ - Customize your node: https://docs.gaianet.ai/node-guide/customize
41
+
42
+ *Quantized with llama.cpp b4381*