Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
AIFunOver
/
Llama-3.1-70B-Instruct-openvino-4bit
like
0
Text Generation
Transformers
Safetensors
OpenVINO
PyTorch
8 languages
llama
facebook
meta
llama-3
nncf
4-bit precision
conversational
text-generation-inference
Inference Endpoints
License:
llama3.1
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
92e9f8d
Llama-3.1-70B-Instruct-openvino-4bit
1 contributor
History:
11 commits
AIFunOver
Upload model.safetensors.index.json with huggingface_hub
92e9f8d
verified
about 1 month ago
.gitattributes
Safe
1.52 kB
initial commit
about 1 month ago
config.json
Safe
930 Bytes
Upload config.json with huggingface_hub
about 1 month ago
model.safetensors.index.json
Safe
59.6 kB
Upload model.safetensors.index.json with huggingface_hub
about 1 month ago
openvino_config.json
Safe
581 Bytes
Upload openvino_config.json with huggingface_hub
about 1 month ago
openvino_detokenizer.bin
1.35 MB
LFS
Upload openvino_detokenizer.bin with huggingface_hub
about 1 month ago
openvino_model.xml
Safe
6.9 MB
Upload openvino_model.xml with huggingface_hub
about 1 month ago
openvino_tokenizer.bin
5.64 MB
LFS
Upload openvino_tokenizer.bin with huggingface_hub
about 1 month ago
openvino_tokenizer.xml
Safe
28.6 kB
Upload openvino_tokenizer.xml with huggingface_hub
about 1 month ago
special_tokens_map.json
Safe
296 Bytes
Upload special_tokens_map.json with huggingface_hub
about 1 month ago
tokenizer.json
Safe
9.09 MB
Upload tokenizer.json with huggingface_hub
about 1 month ago
tokenizer_config.json
Safe
55.4 kB
Upload tokenizer_config.json with huggingface_hub
about 1 month ago