Adding `safetensors` variant of this model
#19 opened 11 months ago
by
SFconvertbot
![](https://cdn-avatars.huggingface.co/v1/production/uploads/635fd4cc14657fb8cff2a081/GDkyDwAcuqDBpaOvQgJuq.png)
Adding Evaluation Results
#18 opened 12 months ago
by
leaderboard-pr-bot
![](https://cdn-avatars.huggingface.co/v1/production/uploads/655506df9dc61e22c5f9c732/IZGvup0FdVlioPPIPnzZv.jpeg)
any plans for mixtral 128k?
#17 opened 12 months ago
by
sirus
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1656090140385-noauth.jpeg)
Transformers fix to mixed precision at long context lengths
1
#16 opened about 1 year ago
by
nbroad
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1639773384591-5f353bb37e58354338621655.jpeg)
How much computation power(like gpus and gpu hour) you guys needed to finetune this?
1
#15 opened about 1 year ago
by
zohadev
![](https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/PH3AEY9z0vOhONnPdZx-i.jpeg)
Yarn-StableLM-Epoch?
#14 opened about 1 year ago
by
KnutJaegersberg
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1669551186189-63732ebbbd81fae2b3aaf3fb.jpeg)
Instruction finetuning and train script, QLORA etc.
#13 opened about 1 year ago
by
aamir1122a
Add widget examples
#11 opened over 1 year ago
by
mishig
![](https://cdn-avatars.huggingface.co/v1/production/uploads/60a551a34ecc5d054c8ad93e/dhcBFtwNLcKqqASxniyVw.jpeg)
Using this model with Vllm
1
#10 opened over 1 year ago
by
haltux
Can't deploy to any provider an inference endpoint
2
#9 opened over 1 year ago
by
ejkkan
Pretraining from scratch?
#8 opened over 1 year ago
by
MengboZhou
Fine-tuned with all parameters?
1
#6 opened over 1 year ago
by
MengboZhou
VRAM usage for full 128k tokens
7
#5 opened over 1 year ago
by
Hypersniper
![](https://cdn-avatars.huggingface.co/v1/production/uploads/63b229669d21227b914badbb/umr0ngvZ5L_Nv2nVlC-Zo.png)
sliding_window = 131072? Sliding window attention doesn't work for 128?
1
#4 opened over 1 year ago
by
keyishen
smaller shards, pls
#2 opened over 1 year ago
by
lskywalker
Instruct Version?
8
#1 opened over 1 year ago
by
mrfakename
![](https://cdn-avatars.huggingface.co/v1/production/uploads/62e54f0eae9d3f10acb95cb9/VAyk05hqB3OZWXEZW-B0q.png)