aashish1904 commited on
Commit
15f240f
·
verified ·
1 Parent(s): f868ee9

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +71 -0
README.md ADDED
@@ -0,0 +1,71 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+ ---
3
+
4
+ base_model:
5
+ - meta-llama/Llama-3.2-3B-Instruct
6
+ license: cc-by-4.0
7
+ language:
8
+ - en
9
+ pipeline_tag: text-generation
10
+ library_name: transformers
11
+
12
+ ---
13
+
14
+ [![QuantFactory Banner](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeiuCm7c8lEwEJuRey9kiVZsRn2W-b4pWlu3-X534V3YmVuVc2ZL-NXg2RkzSOOS2JXGHutDuyyNAUtdJI65jGTo8jT9Y99tMi4H4MqL44Uc5QKG77B0d6-JfIkZHFaUA71-RtjyYZWVIhqsNZcx8-OMaA?key=xt3VSDoCbmTY7o-cwwOFwQ)](https://hf.co/QuantFactory)
15
+
16
+
17
+ # QuantFactory/VersatiLlama-Llama-3.2-3B-Instruct-Abliterated-GGUF
18
+ This is quantized version of [Devarui379/VersatiLlama-Llama-3.2-3B-Instruct-Abliterated](https://huggingface.co/Devarui379/VersatiLlama-Llama-3.2-3B-Instruct-Abliterated) created using llama.cpp
19
+
20
+ # Original Model Card
21
+
22
+
23
+ # Model Card for Model ID
24
+
25
+ # VersatiLlama-Llama-3.2-3B-Instruct-Abliterated
26
+
27
+ ![image/webp](https://cdn-uploads.huggingface.co/production/uploads/66c9d7a26f2335ba288810a4/4YDg-rcEXCK0fdTS1fBzE.webp)
28
+
29
+ ### Model Description
30
+ Small but Smart
31
+
32
+ Fine-Tuned on Vast dataset of Conversations
33
+
34
+ Able to Generate Human like text with high performance within its size.
35
+
36
+ It is Very Versatile when compared for it's size and Parameters and offers capability almost as good as Llama 3.1 8B Instruct
37
+
38
+ Feel free to Check it out!!
39
+
40
+ Check the quantized model here: [Devarui379/VersatiLlama-Llama-3.2-3B-Instruct-Abliterated-Imatrix-GGUF](https://huggingface.co/Devarui379/VersatiLlama-Llama-3.2-3B-Instruct-Abliterated-Imatrix-GGUF)
41
+
42
+ [This model was trained for 5hrs on GPU T4 15gb vram]
43
+
44
+
45
+ - **Developed by:** Meta AI
46
+ - **Fine-Tuned by:** Devarui379
47
+ - **Model type:** Transformers
48
+ - **Language(s) (NLP):** English
49
+ - **License:** cc-by-4.0
50
+
51
+ ### Model Sources [optional]
52
+
53
+ base model:meta-llama/Llama-3.2-3B-Instruct
54
+ - **Repository:** [Devarui379/VersatiLlama-Llama-3.2-3B-Instruct-Abliterated](https://huggingface.co/Devarui379/VersatiLlama-Llama-3.2-3B-Instruct-Abliterated)
55
+ - **Demo:** Use LM Studio with the Quantized version
56
+
57
+ ## Uses
58
+
59
+ Use desired System prompt when using in LM Studio
60
+ The optimal chat template seems to be Jinja but feel free to test it out as you want!
61
+
62
+
63
+ ## Technical Specifications
64
+
65
+ ### Model Architecture and Objective
66
+
67
+ Llama 3.2
68
+
69
+ #### Hardware
70
+
71
+ NVIDIA TESLA T4 GPU 15GB VRAM