view post Post 1456 π’ For those who wish to launch distilled DeepSeek R1 for reasoning with schema, sharing the Google Colab notebook:π https://github.com/nicolay-r/nlp-thirdgate/blob/master/tutorials/llm_deep_seek_7b_distill_colab.ipynbThis is a wrapper of the Qwen2 transformers π€ provider via bulk-chain framework.Model: deepseek-ai/DeepSeek-R1-Distill-Qwen-7BGPU: T4 (15GB) is nearly enough in float32 mode. π To boost the performance you may set bf16 mode (use_bf16=True)π Powered by bulk-chain: https://github.com/nicolay-r/bulk-chain See translation π 4 4 π₯ 1 1 + Reply
Running 533 533 Open Source Ai Year In Review 2024 π» What happened in open-source AI this year, and whatβs next?