sleepdeprived3
/

Qwen2.5-14B-Instruct-1M_EXL2_8bpw_H8

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

Qwen2.5-14B-Instruct-1M_EXL2_8bpw_H8

1 contributor

History: 15 commits

sleepdeprived3's picture

Upload vocab.json with huggingface_hub

7061294 verified about 1 month ago

.gitattributes

1.52 kB

initial commit about 1 month ago
LICENSE

54 Bytes

Upload LICENSE with huggingface_hub about 1 month ago
README.md

9.72 kB

Upload README.md with huggingface_hub about 1 month ago
config.json

1.2 kB

Upload config.json with huggingface_hub about 1 month ago
generation_config.json

242 Bytes

Upload generation_config.json with huggingface_hub about 1 month ago
huggingface-metadata.txt

944 Bytes

Upload huggingface-metadata.txt with huggingface_hub about 1 month ago
measurement.json

2.77 MB

Upload measurement.json with huggingface_hub about 1 month ago
merges.txt

1.67 MB

Upload merges.txt with huggingface_hub about 1 month ago
model.safetensors.index.json

47.5 kB

Upload model.safetensors.index.json with huggingface_hub about 1 month ago
output-00001-of-00002.safetensors

8.58 GB
LFS

Upload output-00001-of-00002.safetensors with huggingface_hub about 1 month ago
output-00002-of-00002.safetensors

5.64 GB
LFS

Upload output-00002-of-00002.safetensors with huggingface_hub about 1 month ago
sparse_attention_config.json

118 kB

Upload sparse_attention_config.json with huggingface_hub about 1 month ago
tokenizer.json

7.03 MB

Upload tokenizer.json with huggingface_hub about 1 month ago
tokenizer_config.json

7.23 kB

Upload tokenizer_config.json with huggingface_hub about 1 month ago
vocab.json

2.78 MB

Upload vocab.json with huggingface_hub about 1 month ago