espressor/meta-llama.Llama-3.2-1B-Instruct_W8A8_FP8

meta-llama/Llama-3.2-1B-Instruct - W8A8_FP8 Compression

This is a compressed model using llmcompressor.

Compression Configuration

• Base Model: meta-llama/Llama-3.2-1B-Instruct
• Compression Scheme: W8A8_FP8
• Dataset: HuggingFaceH4/ultrachat_200k
• Dataset Split: train_sft
• Number of Samples: 512
• Preprocessor: chat
• Maximum Sequence Length: 131072

Sample Output

Prompt:

<|begin_of_text|><|start_header_id|>system<|end_header_id|>

Cutting Knowledge Date: December 2023
Today Date: 28 Nov 2024

<|eot_id|><|start_header_id|>user<|end_header_id|>

Who is Alan Turing?<|eot_id|>

Output:

<|begin_of_text|><|begin_of_text|><|start_header_id|>system<|end_header_id|>

Cutting Knowledge Date: December 2023
Today Date: 28 Nov 2024

<|eot_id|><|start_header_id|>user<|end_header_id|>

Who is Alan Turing?<|eot_id|><|start_header_id|>assistant<|end_header_id|>

Alan Turing (1912-1954) was a British mathematician, computer scientist, logician, philosopher, and cryptanalyst who made groundbreaking contributions to the development of computer science, artificial intelligence, and cryptography. He is widely regarded as one of the most influential figures in the history of computer science.

Early Life and Education:
Alan Turing was born on June 23, 1912, in Maida Vale, London, to a family of intellectuals. His father, Frank Turing, was a bank manager, and his mother, Mary (née Guiness), was a homemaker. Turing was a brilliant

Evaluation