Hugging Face's logo

altomek
/
RE-70B-AS3D

Text Generation
Transformers
Safetensors
English
llama
Merge
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
altomek commited on
Commit
ca94baf
·
verified ·
1 Parent(s): d43f711

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -5
README.md CHANGED
@@ -34,17 +34,15 @@ This is first interesting result from the voyage...
34
 
35
  ### Settings
36
 
37
- Use Llama 3 template, model with ALpaca template sometimes halucinates and generates training materials ;P
38
 
39
 
40
  ### Quants
41
 
42
- More quants are comming soon... and I need to redo GGUF quants(!) as they do not encode chat template in tokenizer_config... if your inference engine uses chat template from GGUF file you will see halucinations. However GGUFs work fine for me in SillyTawern & text-generation-webui combo...
43
-
44
- - [GGUF](https://huggingface.co/altomek/RE-70B-AS3D-GGUF) --> TO BE UPDATED!
45
  - [3 BPW](https://huggingface.co/altomek/RE-70B-AS3D-3bpw-EXL2)
46
  - [3.5 BPW](https://huggingface.co/altomek/RE-70B-AS3D-3.5bpw-EXL2)
47
  - [3.75 BPW](https://huggingface.co/altomek/RE-70B-AS3D-3.75bpw-EXL2)
48
  - [4 BPW](https://huggingface.co/altomek/RE-70B-AS3D-4bpw-EXL2)
49
-
50
 
 
34
 
35
  ### Settings
36
 
37
+ Use Llama 3 template.
38
 
39
 
40
  ### Quants
41
 
42
+ - [GGUF](https://huggingface.co/altomek/RE-70B-AS3D-GGUF) --> UPLOADING!
 
 
43
  - [3 BPW](https://huggingface.co/altomek/RE-70B-AS3D-3bpw-EXL2)
44
  - [3.5 BPW](https://huggingface.co/altomek/RE-70B-AS3D-3.5bpw-EXL2)
45
  - [3.75 BPW](https://huggingface.co/altomek/RE-70B-AS3D-3.75bpw-EXL2)
46
  - [4 BPW](https://huggingface.co/altomek/RE-70B-AS3D-4bpw-EXL2)
47
+ - [4.25 BPW](https://huggingface.co/altomek/RE-70B-AS3D-4.25bpw-EXL2)
48