fakezeta
/

LocalAI-Llama3-8b-Function-Call-v0.2-ov-int8

Text Generation

Inference Endpoints

Model card Files Files and versions Community

LocalAI-Llama3-8b-Function-Call-v0.2-ov-int8 / model.yaml

fakezeta's picture

Upload 9 files

19c6bdd verified 6 months ago

204 Bytes

	name: localai-llama3
	backend: transformers
	parameters:
	model: fakezeta/LocalAI-Llama3-8b-Function-Call-v0.2-ov-int8
	context_size: 8192
	type: OVModelForCausalLM
	template:
	use_tokenizer_template: true