Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
AIFunOver
/
Llama-3.1-70B-Instruct-openvino-4bit
like
0
Text Generation
Transformers
Safetensors
OpenVINO
PyTorch
8 languages
llama
facebook
meta
llama-3
nncf
4-bit precision
conversational
text-generation-inference
Inference Endpoints
License:
llama3.1
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
Llama-3.1-70B-Instruct-openvino-4bit
1 contributor
History:
15 commits
AIFunOver
Upload README.md with huggingface_hub
127ff3e
verified
about 1 month ago
.gitattributes
Safe
1.52 kB
initial commit
about 1 month ago
README.md
Safe
14.6 kB
Upload README.md with huggingface_hub
about 1 month ago
config.json
Safe
930 Bytes
Upload config.json with huggingface_hub
about 1 month ago
generation_config.json
Safe
184 Bytes
Upload generation_config.json with huggingface_hub
about 1 month ago
model.safetensors.index.json
Safe
59.6 kB
Upload model.safetensors.index.json with huggingface_hub
about 1 month ago
openvino_config.json
Safe
581 Bytes
Upload openvino_config.json with huggingface_hub
about 1 month ago
openvino_detokenizer.bin
1.35 MB
LFS
Upload openvino_detokenizer.bin with huggingface_hub
about 1 month ago
openvino_detokenizer.xml
Safe
14.3 kB
Upload openvino_detokenizer.xml with huggingface_hub
about 1 month ago
openvino_model.bin
37.7 GB
LFS
Upload openvino_model.bin with huggingface_hub
about 1 month ago
openvino_model.xml
Safe
6.9 MB
Upload openvino_model.xml with huggingface_hub
about 1 month ago
openvino_tokenizer.bin
5.64 MB
LFS
Upload openvino_tokenizer.bin with huggingface_hub
about 1 month ago
openvino_tokenizer.xml
Safe
28.6 kB
Upload openvino_tokenizer.xml with huggingface_hub
about 1 month ago
special_tokens_map.json
Safe
296 Bytes
Upload special_tokens_map.json with huggingface_hub
about 1 month ago
tokenizer.json
Safe
9.09 MB
Upload tokenizer.json with huggingface_hub
about 1 month ago
tokenizer_config.json
Safe
55.4 kB
Upload tokenizer_config.json with huggingface_hub
about 1 month ago
