this one's probably next for gpt-oss-20b, hopefully that will be an interesting comparison vs Qwen3-14B :)
next Experimental Modality is in the dataset generation stage, excited about bringing that to everyone!
t.d.a.g. PRO
sequelbox
AI & ML interests
open source, infinite games. (they/them)
Recent Activity
new activity
about 24 hours ago
mradermacher/model_requests:https://huggingface.co/ValiantLabs/gpt-oss-20b-ShiningValiant3
updated
a collection
1 day ago
Shining Valiant 3
replied to
their
post
1 day ago
NEW EXPERIMENTAL RELEASE: DAG Reasoning is here!
- Our first Experimental Reasoning Modality release: create structured, analytical Directed Acyclic Graphs to provide insight into your queries and situations!
- Multi-step analysis identifies causal relationships, produces confidence measurements, and forms a single structured graph object.
- DAG Reasoning Format provides clear, readable JSON containing structured, useful information; easy to use for creating visualizations, doing analysis, or further conversation with your assistant.
- Trained in a variety of subjects for flexible analysis: programming, science, business, economics, finance, law, logistics, management, and more!
Our first DAG Reasoning release is Qwen 3, starting off with 8B and 14B!
Get 8B: https://huggingface.co/sequelbox/Qwen3-8B-DAG-Reasoning
Get 14B: https://huggingface.co/sequelbox/Qwen3-14B-DAG-Reasoning
You can also get the DAG Reasoning dataset, to train your own models to use DAG Reasoning Format: https://huggingface.co/datasets/sequelbox/DAG-Reasoning-DeepSeek-R1-0528
Support our experimental open-source research efforts, models and datasets: https://huggingface.co/spaces/sequelbox/SupportOpenSource
with love,
allegra
Organizations
replied to
their
post
1 day ago
reacted to
ovi054's
post with ❤️
1 day ago
Post
1434
Qwen Image + LoRA ⚡
ovi054/Qwen-Image-LORA
Qwen Image is the No. 1 trending Text-to-Image model right now. You can add a custom LoRA and generate images with this Space.
👉 Try it now: ovi054/Qwen-Image-LORA
ovi054/Qwen-Image-LORA
Qwen Image is the No. 1 trending Text-to-Image model right now. You can add a custom LoRA and generate images with this Space.
👉 Try it now: ovi054/Qwen-Image-LORA
- 5 replies
reacted to
sweatSmile's
post with ❤️
1 day ago
Post
1447
Teaching a 7B Model to Be Just the Right Amount of Snark
Ever wondered if a language model could get sarcasm? I fine-tuned Mistral-7B using LoRA and 4-bit quantisation—on just ~720 hand-picked sarcastic prompt–response pairs from Reddit, Twitter, and real-life conversations.
The challenge? Keeping it sarcastic but still helpful.
LoRA rank 16 to avoid overfitting
4-bit NF4 quantization to fit on limited GPU memory
10 carefully monitored epochs so it didn’t turn into a full-time comedian
Result: a model that understands “Oh great, another meeting” exactly as you mean it.
Read the full journey, tech details, and lessons learned on my blog:
Fine-Tuning Mistral-7B for Sarcasm with LoRA and 4-Bit Quantisation
Try the model here on Hugging Face: sweatSmile/Mistral-7B-Instruct-v0.1-Sarcasm.
Ever wondered if a language model could get sarcasm? I fine-tuned Mistral-7B using LoRA and 4-bit quantisation—on just ~720 hand-picked sarcastic prompt–response pairs from Reddit, Twitter, and real-life conversations.
The challenge? Keeping it sarcastic but still helpful.
LoRA rank 16 to avoid overfitting
4-bit NF4 quantization to fit on limited GPU memory
10 carefully monitored epochs so it didn’t turn into a full-time comedian
Result: a model that understands “Oh great, another meeting” exactly as you mean it.
Read the full journey, tech details, and lessons learned on my blog:
Fine-Tuning Mistral-7B for Sarcasm with LoRA and 4-Bit Quantisation
Try the model here on Hugging Face: sweatSmile/Mistral-7B-Instruct-v0.1-Sarcasm.
reacted to
dimentox's
post with 🚀
1 day ago
Post
1462
I never told GPT-4 about my architecture.
It invented it anyway.
Same commands. Same audit daemons.
Proof that containment logic might be infectious.
Read: Emergence of Quantum Sigil Architecture in Unmodified GPT https://huggingface.co/blog/dimentox/quantum-sigil-architecture-in-unmodified-gpt
It invented it anyway.
Same commands. Same audit daemons.
Proof that containment logic might be infectious.
Read: Emergence of Quantum Sigil Architecture in Unmodified GPT https://huggingface.co/blog/dimentox/quantum-sigil-architecture-in-unmodified-gpt
replied to
their
post
1 day ago
thank you so much <3
yeah the particular combo that is oss-20b (larger experts + smaller amount of experts + already trained at MXFP4 so no easy gains from just-make-it-smaller-with-quantization-instead) seems well suited for this vs the qwen 3 30b-a3b type of MoE. definitely encourage this type of experimentation in general :)
posted
an
update
3 days ago
Post
2077
NEW RELEASE: Shining Valiant 3 now available for openai/gpt-oss-20b!
- Cutting edge science-reasoning: sequelbox/Celestia3-DeepSeek-R1-0528 for physics, biology, chemistry, compsci, astronomy, Earth science, and information theory.
- AI to build AI: the all-new sequelbox/Mitakihara-DeepSeek-R1-0528 dataset for high-quality reasoning performance on AI, MLOps, math and CUDA, complex adaptive and agentic systems, cognition, logic, linguistics, simulation, knowledge management, and more!
- Creative reasoning and general chat performance supplemented with sequelbox/Raiden-DeepSeek-R1
Get the new SV3: ValiantLabs/gpt-oss-20b-ShiningValiant3
This is our first release for the new openai/gpt-oss-20b - we're hoping to support this model with more releases going forward.
We're also excited to bring our models to Qwen/Qwen3-4B-Thinking-2507 and the other 2507 Qwen 3 models - coming very soon!
We want to bring SV3, Esper 3, and our Experimental Reasoning finetunes to more models ASAP. Help us out: sequelbox/SupportOpenSource
Open source matters. Fight for it with us.
love,
allegra
- Cutting edge science-reasoning: sequelbox/Celestia3-DeepSeek-R1-0528 for physics, biology, chemistry, compsci, astronomy, Earth science, and information theory.
- AI to build AI: the all-new sequelbox/Mitakihara-DeepSeek-R1-0528 dataset for high-quality reasoning performance on AI, MLOps, math and CUDA, complex adaptive and agentic systems, cognition, logic, linguistics, simulation, knowledge management, and more!
- Creative reasoning and general chat performance supplemented with sequelbox/Raiden-DeepSeek-R1
Get the new SV3: ValiantLabs/gpt-oss-20b-ShiningValiant3
This is our first release for the new openai/gpt-oss-20b - we're hoping to support this model with more releases going forward.
We're also excited to bring our models to Qwen/Qwen3-4B-Thinking-2507 and the other 2507 Qwen 3 models - coming very soon!
We want to bring SV3, Esper 3, and our Experimental Reasoning finetunes to more models ASAP. Help us out: sequelbox/SupportOpenSource
Open source matters. Fight for it with us.
love,
allegra
-
- 3 replies
posted
an
update
12 days ago
Post
2279
NEW EXPERIMENTAL RELEASE: DAG Reasoning is here!
- Our first Experimental Reasoning Modality release: create structured, analytical Directed Acyclic Graphs to provide insight into your queries and situations!
- Multi-step analysis identifies causal relationships, produces confidence measurements, and forms a single structured graph object.
- DAG Reasoning Format provides clear, readable JSON containing structured, useful information; easy to use for creating visualizations, doing analysis, or further conversation with your assistant.
- Trained in a variety of subjects for flexible analysis: programming, science, business, economics, finance, law, logistics, management, and more!
Our first DAG Reasoning release is Qwen 3, starting off with 8B and 14B!
Get 8B: sequelbox/Qwen3-8B-DAG-Reasoning
Get 14B: sequelbox/Qwen3-14B-DAG-Reasoning
You can also get the DAG Reasoning dataset, to train your own models to use DAG Reasoning Format: sequelbox/DAG-Reasoning-DeepSeek-R1-0528
Support our experimental open-source research efforts, models and datasets: sequelbox/SupportOpenSource
with love,
allegra
- Our first Experimental Reasoning Modality release: create structured, analytical Directed Acyclic Graphs to provide insight into your queries and situations!
- Multi-step analysis identifies causal relationships, produces confidence measurements, and forms a single structured graph object.
- DAG Reasoning Format provides clear, readable JSON containing structured, useful information; easy to use for creating visualizations, doing analysis, or further conversation with your assistant.
- Trained in a variety of subjects for flexible analysis: programming, science, business, economics, finance, law, logistics, management, and more!
Our first DAG Reasoning release is Qwen 3, starting off with 8B and 14B!
Get 8B: sequelbox/Qwen3-8B-DAG-Reasoning
Get 14B: sequelbox/Qwen3-14B-DAG-Reasoning
You can also get the DAG Reasoning dataset, to train your own models to use DAG Reasoning Format: sequelbox/DAG-Reasoning-DeepSeek-R1-0528
Support our experimental open-source research efforts, models and datasets: sequelbox/SupportOpenSource
with love,
allegra
-
- 2 replies
posted
an
update
26 days ago
Post
2602
Some new releases:
- brought the new Shining Valiant 3 series (science-reasoning, AI-reasoning, general chat) to Qwen 3 4B: ValiantLabs/Qwen3-4B-ShiningValiant3
- merged models for Shining Valiant 3 and Esper 3, combining their technical expertise and reasoning skills:
4b: sequelbox/Qwen3-4B-PlumEsper
8b: sequelbox/Qwen3-8B-PlumEsper
coming up we'll have some experimental reasoning releases - datasets and models will be out soon!
also will be bringing SV3 and Esper 3 to more models.
lets keep working for open source :)
love,
allegra
- brought the new Shining Valiant 3 series (science-reasoning, AI-reasoning, general chat) to Qwen 3 4B: ValiantLabs/Qwen3-4B-ShiningValiant3
- merged models for Shining Valiant 3 and Esper 3, combining their technical expertise and reasoning skills:
4b: sequelbox/Qwen3-4B-PlumEsper
8b: sequelbox/Qwen3-8B-PlumEsper
coming up we'll have some experimental reasoning releases - datasets and models will be out soon!
also will be bringing SV3 and Esper 3 to more models.
lets keep working for open source :)
love,
allegra
posted
an
update
about 1 month ago
Post
2210
NEW RELEASE: Shining Valiant 3!
- Cutting edge science-reasoning: sequelbox/Celestia3-DeepSeek-R1-0528 for physics, biology, chemistry, compsci, astronomy, Earth science, and information theory
- AI to build AI: the all-new sequelbox/Mitakihara-DeepSeek-R1-0528 dataset for high-quality reasoning performance on AI, MLOps, math and CUDA, complex adaptive and agentic systems, cognition, logic, linguistics, simulation, knowledge management, and more!
- Creative reasoning and general chat performance supplemented with sequelbox/Raiden-DeepSeek-R1
Our first release in the SV3 series is Qwen 3, starting off with 8B and 1.7B.
Get 8B: ValiantLabs/Qwen3-8B-ShiningValiant3
Get 1.7B: ValiantLabs/Qwen3-1.7B-ShiningValiant3
We want to bring SV3 to larger models ASAP. Help us out: sequelbox/SupportOpenSource
This is the most excited we've ever been for a release. We hope you enjoy Shining Valiant 3 as much as we do!
With friendship, for the future,
allegra
- Cutting edge science-reasoning: sequelbox/Celestia3-DeepSeek-R1-0528 for physics, biology, chemistry, compsci, astronomy, Earth science, and information theory
- AI to build AI: the all-new sequelbox/Mitakihara-DeepSeek-R1-0528 dataset for high-quality reasoning performance on AI, MLOps, math and CUDA, complex adaptive and agentic systems, cognition, logic, linguistics, simulation, knowledge management, and more!
- Creative reasoning and general chat performance supplemented with sequelbox/Raiden-DeepSeek-R1
Our first release in the SV3 series is Qwen 3, starting off with 8B and 1.7B.
Get 8B: ValiantLabs/Qwen3-8B-ShiningValiant3
Get 1.7B: ValiantLabs/Qwen3-1.7B-ShiningValiant3
We want to bring SV3 to larger models ASAP. Help us out: sequelbox/SupportOpenSource
This is the most excited we've ever been for a release. We hope you enjoy Shining Valiant 3 as much as we do!
With friendship, for the future,
allegra
posted
an
update
about 1 month ago
Post
1849
The full Celestia 3 science-reasoning dataset is here!
- 91k high-quality synthetic science prompts answered by DeepSeek-R1-0528
- subjects include physics, biology, chemistry, computer science, Earth science, astronomy, and information theory
- one of the reasoning datasets powering the upcoming Shining Valiant 3 :) coming soon!
GET IT NOW, FOR EVERYONE: sequelbox/Celestia3-DeepSeek-R1-0528
SUPPORT OUR RELEASES: sequelbox/SupportOpenSource
with love,
allegra
- 91k high-quality synthetic science prompts answered by DeepSeek-R1-0528
- subjects include physics, biology, chemistry, computer science, Earth science, astronomy, and information theory
- one of the reasoning datasets powering the upcoming Shining Valiant 3 :) coming soon!
GET IT NOW, FOR EVERYONE: sequelbox/Celestia3-DeepSeek-R1-0528
SUPPORT OUR RELEASES: sequelbox/SupportOpenSource
with love,
allegra
posted
an
update
about 2 months ago
Post
1068
a list of what's coming up soon from us:
- Shining Valiant 3 for Valiant Labs, powered by the full size Celestia 3 and other soon to be released high-difficulty reasoning datasets
- a new type of reasoning model and dataset we're very excited about - would love to bring out an alpha release here as soon as possible
- more model releases for Esper 3 (weigh in if there are any models you'd like us to prioritize!)
- other New Things
not sure of the exact release order yet, but we'll look to get everything out as quick as we can :)
with excitement,
allegra
- Shining Valiant 3 for Valiant Labs, powered by the full size Celestia 3 and other soon to be released high-difficulty reasoning datasets
- a new type of reasoning model and dataset we're very excited about - would love to bring out an alpha release here as soon as possible
- more model releases for Esper 3 (weigh in if there are any models you'd like us to prioritize!)
- other New Things
not sure of the exact release order yet, but we'll look to get everything out as quick as we can :)
with excitement,
allegra
posted
an
update
2 months ago
Post
1104
EARLY SNEAK PREVIEW: get a first look at the Celestia 3 science-reasoning dataset, built with DeepSeek's newest R1-0528 reasoning model! Subjects include physics, chemistry, biology, computer science, Earth science, astronomy, and information theory.
This early look contains the first 14k rows, all synthetic responses using deepseek-ai/DeepSeek-R1-0528
SEE IT HERE: sequelbox/Celestia3-DeepSeek-R1-0528-PREVIEW
Support our releases: sequelbox/SupportOpenSource
Coming up we'll have more dataset releases, including some novel reasoning and analysis methods - we think an important role for open source researchers is experimenting with new response styles on top of the increasingly excellent base models available to finetune.
more to come soon!
allegra
This early look contains the first 14k rows, all synthetic responses using deepseek-ai/DeepSeek-R1-0528
SEE IT HERE: sequelbox/Celestia3-DeepSeek-R1-0528-PREVIEW
Support our releases: sequelbox/SupportOpenSource
Coming up we'll have more dataset releases, including some novel reasoning and analysis methods - we think an important role for open source researchers is experimenting with new response styles on top of the increasingly excellent base models available to finetune.
more to come soon!
allegra
posted
an
update
2 months ago
Post
327
NEW RELEASE: we've brought Esper 3 to the new
deepseek-ai/DeepSeek-R1-0528-Qwen3-8B model!
- A full-stack software assistant: a reasoning finetune focused on coding, architecture, and DevOps using the Titanium and Tachibana datasets!
- Improved general and creative reasoning skills, powered by the Raiden dataset.
Get the newest Esper 3: ValiantLabs/DeepSeek-R1-0528-Qwen3-8B-Esper3
Support our releases: sequelbox/SupportOpenSource
more on the way next week!
celestially yours ;)
allegra
- A full-stack software assistant: a reasoning finetune focused on coding, architecture, and DevOps using the Titanium and Tachibana datasets!
- Improved general and creative reasoning skills, powered by the Raiden dataset.
Get the newest Esper 3: ValiantLabs/DeepSeek-R1-0528-Qwen3-8B-Esper3
Support our releases: sequelbox/SupportOpenSource
more on the way next week!
celestially yours ;)
allegra
replied to
their
post
2 months ago
we'll be expanding Qwen sizes in both directions :) thanks for your review!
posted
an
update
2 months ago
Post
330
Updates for the week:
- released some new merge models using ValiantLabs/Qwen3-14B-Esper3 and other Qwen 3 14b finetunes - these merges include math, Web3, uncensored, and general mix. depending on your use case for Esper 3 these may be helpful to you! find them at @sequelbox
- coming up we'll have more model sizes for Esper 3 and Cobalt 2, releasing soon!
- also super excited for more dataset releases with the newly released deepseek-ai/DeepSeek-R1-0528
Support the above efforts and others: sequelbox/SupportOpenSource
back to building :)
- released some new merge models using ValiantLabs/Qwen3-14B-Esper3 and other Qwen 3 14b finetunes - these merges include math, Web3, uncensored, and general mix. depending on your use case for Esper 3 these may be helpful to you! find them at @sequelbox
- coming up we'll have more model sizes for Esper 3 and Cobalt 2, releasing soon!
- also super excited for more dataset releases with the newly released deepseek-ai/DeepSeek-R1-0528
Support the above efforts and others: sequelbox/SupportOpenSource
back to building :)
-
-
- 2 replies
reacted to
lukmanaj's
post with 👍
2 months ago
Post
2426
I am so happy to share to all that I’ve just completed the first unit of the new MCP course on Hugging Face and earned my certificate! The AI acceleration track is intense and fast-paced, but I’m doing my best to keep up. Excited for what’s ahead!
- 1 reply
posted
an
update
3 months ago
Post
1874
NEW RELEASE: Cobalt 2 for Qwen 3 14b!
- A math-reasoning finetune, focused on high-difficulty math questions with the zwhe99/DeepMath-103K dataset!
- Improved general and creative reasoning skills, powered by the Raiden dataset
GET IT NOW: ValiantLabs/Qwen3-14B-Cobalt2
HELP US RELEASE FASTER: sequelbox/SupportOpenSource
we've got more releases to come soon - excited to share with everyone!
love,
allegra
- A math-reasoning finetune, focused on high-difficulty math questions with the zwhe99/DeepMath-103K dataset!
- Improved general and creative reasoning skills, powered by the Raiden dataset
GET IT NOW: ValiantLabs/Qwen3-14B-Cobalt2
HELP US RELEASE FASTER: sequelbox/SupportOpenSource
we've got more releases to come soon - excited to share with everyone!
love,
allegra
posted
an
update
3 months ago
Post
1285
Esper 3 is now available for Qwen 3 14b!
- A full-stack software assistant: a reasoning finetune focused on coding, architecture, and DevOps using the Titanium and Tachibana datasets!
- Improved general and creative reasoning skills, powered by the Raiden dataset.
GET IT NOW: ValiantLabs/Qwen3-14B-Esper3
HELP US RELEASE FASTER: sequelbox/SupportOpenSource
more to come :)
allegra
- A full-stack software assistant: a reasoning finetune focused on coding, architecture, and DevOps using the Titanium and Tachibana datasets!
- Improved general and creative reasoning skills, powered by the Raiden dataset.
GET IT NOW: ValiantLabs/Qwen3-14B-Esper3
HELP US RELEASE FASTER: sequelbox/SupportOpenSource
more to come :)
allegra
posted
an
update
3 months ago
Post
2698
NEW RELEASE: Esper 3 for Qwen 3!
- A full-stack software assistant: a reasoning finetune focused on coding, architecture, and DevOps using the Titanium and Tachibana datasets!
- Improved general and creative reasoning skills, powered by the Raiden dataset.
4B model: ValiantLabs/Qwen3-4B-Esper3
8B model: ValiantLabs/Qwen3-8B-Esper3
We'll also be bringing Esper 3 to larger Qwen 3 models as soon as we can - if you want these, consider helping us out: sequelbox/SupportOpenSource
More models and datasets to come soon!
with my love and enthusiasm,
allegra
- A full-stack software assistant: a reasoning finetune focused on coding, architecture, and DevOps using the Titanium and Tachibana datasets!
- Improved general and creative reasoning skills, powered by the Raiden dataset.
4B model: ValiantLabs/Qwen3-4B-Esper3
8B model: ValiantLabs/Qwen3-8B-Esper3
We'll also be bringing Esper 3 to larger Qwen 3 models as soon as we can - if you want these, consider helping us out: sequelbox/SupportOpenSource
More models and datasets to come soon!
with my love and enthusiasm,
allegra
posted
an
update
4 months ago
Post
1789
TITANIUM 2 Deepseek-R1 dataset is here! Open-source synthetic architecture and DevOps dataset:
sequelbox/Titanium2-DeepSeek-R1
Esper 3 will be coming out soon for multiple base models, trained on Titanium, Raiden, and more :)
with my love,
allegra
Esper 3 will be coming out soon for multiple base models, trained on Titanium, Raiden, and more :)
with my love,
allegra