Quantize Meta-Llama-3-70B-Instruct with llamafile-0.7.3 Q3_K_M 18b1706 verified jartine commited on Apr 20, 2024
Quantize Meta-Llama-3-70B-Instruct with llamafile-0.7.3 Q2_K 052c7c7 verified jartine commited on Apr 20, 2024
Quantize Meta-Llama-3-70B-Instruct with llamafile-0.7.2 Q8_0 ca29edc verified jartine commited on Apr 19, 2024
Quantize Meta-Llama-3-70B-Instruct with llamafile-0.7.2 Q8_0 0a463e7 verified jartine commited on Apr 19, 2024
Quantize Meta-Llama-3-70B-Instruct with llamafile-0.7.2 F16 8b09f85 verified jartine commited on Apr 19, 2024
Quantize Meta-Llama-3-70B-Instruct with llamafile-0.7.2 F16 eb933db verified jartine commited on Apr 19, 2024
Quantize Meta-Llama-3-70B-Instruct with llamafile-0.7.2 F16 826c529 verified jartine commited on Apr 19, 2024
Quantize Meta-Llama-3-70B-Instruct with llamafile-0.7.2 Q5_K_M fb01a5d verified jartine commited on Apr 19, 2024
Quantize Meta-Llama-3-70B-Instruct with llamafile-0.7.2 Q4_0 18730ef verified jartine commited on Apr 19, 2024