n810x commited on
Commit
9c55f89
·
verified ·
1 Parent(s): d820ff6

Update README.md

Browse files

Update description...

Files changed (1) hide show
  1. README.md +7 -0
README.md CHANGED
@@ -1,3 +1,10 @@
1
  ---
2
  license: apache-2.0
3
  ---
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
  ---
4
+ 2024-03-14
5
+
6
+ This is a 3-bit exl2 (Exllamav2) conversion of MistralAI's Mistral-7B-Instruct-v0.2
7
+
8
+ This takes about 2.8G on disk, so it should load on consumer cards.
9
+ - More on ExLlamav2 -> https://github.com/turboderp/exllamav2 ( works with Oobabooga's textgen web ui )
10
+ - Original Model -> https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2 ( Original files are ~17GB on disk )