kas's picture

kas

shing3232

·

AI & ML interests

None yet

Recent Activity

new activity 8 days ago

agentica-org/DeepScaleR-1.5B-Preview:I have difficulty to trigger thinking process

new activity 11 days ago

agentica-org/DeepScaleR-1.5B-Preview:I have difficulty to trigger thinking process

new activity 4 months ago

tencent/Tencent-Hunyuan-Large:这个模型得什么配置能运行起来啊

View all activity

Organizations

None yet

shing3232's activity

New activity in agentica-org/DeepScaleR-1.5B-Preview 8 days ago

I have difficulty to trigger thinking process

#12 opened 11 days ago by

New activity in tencent/Tencent-Hunyuan-Large 4 months ago

这个模型得什么配置能运行起来啊

#13 opened 4 months ago by

New activity in SakuraLLM/Sakura-14B-Qwen2beta-v0.9.2-GGUF 9 months ago

CUDA运行不了BF16模型？

#1 opened 9 months ago by

New activity in Qwen/Qwen1.5-7B-Chat-GGUF 9 months ago

Please post f16 quantization.

#1 opened 9 months ago by

New activity in Qwen/CodeQwen1.5-7B-Chat 11 months ago

What are the diffences of this with Qwen/CodeQwen1.5-7B

#5 opened 11 months ago by

New activity in Qwen/Qwen1.5-MoE-A2.7B-Chat 11 months ago

请问这个版本GPU内存消耗28G与14B对比如何?

#7 opened 11 months ago by

New activity in Qwen/qwen1.5-MoE-A2.7B-Chat-demo 11 months ago

How is the inference so fast in this free hardware space?

#1 opened 11 months ago by

New activity in ai21labs/Jamba-v0.1 11 months ago

Would there a chance Jamba to be train in 1.58bit weight?

#22 opened 11 months ago by

commented a paper 11 months ago

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

Paper • 2402.17764 • Published Feb 27, 2024 • 610 •

New activity in shing3232/dataset_imatrix 11 months ago

这个矩阵用于常规中文模型量化效果会好吗？

#2 opened 12 months ago by

commented 3 papers 11 months ago

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

Paper • 2402.17764 • Published Feb 27, 2024 • 610 •

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

Paper • 2402.17764 • Published Feb 27, 2024 • 610 •

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

Paper • 2402.17764 • Published Feb 27, 2024 • 610 •

New activity in ShenSheiBot/Sakura-1B8-Qwen2beta-v0.9-GGUF 12 months ago

Upload sakura0.9_1.8B_IQ4NL.gguf

#1 opened about 1 year ago by

commented 3 papers 12 months ago

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

Paper • 2402.17764 • Published Feb 27, 2024 • 610 •

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

Paper • 2402.17764 • Published Feb 27, 2024 • 610 •

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

Paper • 2402.17764 • Published Feb 27, 2024 • 610 •

commented 3 papers about 1 year ago

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

Paper • 2402.17764 • Published Feb 27, 2024 • 610 •

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

Paper • 2402.17764 • Published Feb 27, 2024 • 610 •

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

Paper • 2402.17764 • Published Feb 27, 2024 • 610 •