Hugging Face's logo

SolidRusT Networks
company
Verified
https://solidrust.net
solidrust420
solidrust
Activity Feed

AI & ML interests

Self-hosting, Open Source and AI Unalignment

Recent Activity

Suparious  new activity 21 days ago
solidrust/dolphin-2.8-mistral-7b-v02-AWQ:Performed my own Quantization, now encounter an error while running inference with vllm.
Suparious  updated a model 9 months ago
solidrust/Llama-3-8B-Stroganoff-4.0-AWQ
Suparious  updated a model 9 months ago
solidrust/Llama-3.1-8B-TitanFusion-Mix-AWQ
View all activity

Organization Card
Community About org cards

Organization for sorting and categorizing collections of quantized models, featured on solidrust.net.

Currently focused on models that can be quantized by AWQ from: https://github.com/casper-hansen/AutoAWQ using https://github.com/SolidRusT/srt-model-quantizing/tree/main/awq

Collections 8

7B AWQ
These models are selected for their compatibility with small 12GB memory GPUs.
7B AWQ
These models are selected for their compatibility with small 12GB memory GPUs.
View 8 collections

datasets 0

None public yet