PrunaAI/OpenLLM-France-Lucie-7B-Instruct-human-data-AWQ-4bit-smashed Updated about 1 month ago β’ 39
PrunaAI/OpenLLM-France-Lucie-7B-Instruct-human-data-AWQ-4bit-smashed Updated about 1 month ago β’ 39
view post Post 1881 We compressed SmolLMs to make 135 variations of them (see https://huggingface.co/PrunaAI?search_models=smolLM) with different quantization configurations with pruna (https://docs.pruna.ai/en/latest/). We made a blog to summarize our findings (see https://www.pruna.ai/blog/smollm2-smaller-faster) and small LM can be made smaller! :) See translation 3 replies Β· π 9 9 π₯ 2 2 + Reply