huaXiaKyrie/critique-VQA
Viewer
•
Updated
•
29k
•
146
•
5
nicolo
nicolollo
AI & ML interests
None yet
Recent Activity
liked
a dataset
18 days ago
huaXiaKyrie/critique-VQA
liked
a model
20 days ago
Gen-Verse/MMaDA-8B-Base
liked
a model
about 1 month ago
HuggingFaceTB/SmolLM3-3B
Organizations
liked
a
dataset
18 days ago
liked
a
model
20 days ago
liked
a
model
about 1 month ago
liked
a
dataset
about 1 month ago
No multimodal :c
😔
8
#13 opened 2 months ago
by
nicolollo
Can we ge just the pretrained version?
1
#1 opened 2 months ago
by
nicolollo
liked
a
model
3 months ago
upvoted
an
article
3 months ago
Article
Vision Language Models (Better, Faster, Stronger)
By
and 4 others
•
•
506
upvoted
a
paper
3 months ago
liked
a
model
3 months ago
reacted to
nicolay-r's
post with 🔥
4 months ago
Post
2672
🚀 Delighted to share a major milestone in adapting reasoning techniques for data collections augmentation!
Introducing bulk-chain 1.0.0 -- the first major release of a no-string API for adapting your LLM for Chain-of-Thought alike reasoning over records with large amount of parameters across large datasets.
⭐ Check it out: https://github.com/nicolay-r/bulk-chain
What’s new and why it matters:
📦 Fully no-string API for easy client deployment
🔥 Demos are now standalone projects:
Demos:
📺 bash / shell (dispatched): https://github.com/nicolay-r/bulk-chain-shell
📺 tksheet: https://github.com/nicolay-r/bulk-chain-tksheet-client
Using nlp-thirdgate to host the supported providers:
🌌 LLM providers: https://github.com/nicolay-r/nlp-thirdgate
Introducing bulk-chain 1.0.0 -- the first major release of a no-string API for adapting your LLM for Chain-of-Thought alike reasoning over records with large amount of parameters across large datasets.
⭐ Check it out: https://github.com/nicolay-r/bulk-chain
What’s new and why it matters:
📦 Fully no-string API for easy client deployment
🔥 Demos are now standalone projects:
Demos:
📺 bash / shell (dispatched): https://github.com/nicolay-r/bulk-chain-shell
📺 tksheet: https://github.com/nicolay-r/bulk-chain-tksheet-client
Using nlp-thirdgate to host the supported providers:
🌌 LLM providers: https://github.com/nicolay-r/nlp-thirdgate
liked
a
Space
5 months ago
liked
a
model
6 months ago
reacted to
grimjim's
post with ❤️
6 months ago
Post
2407
This recent paper points to an explanation for the unreasonable effectiveness of Frankenmerges:
Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth
Approach (2502.05171)
Specifically, the duplication of layers in Frankenmerges serves a purpose similar to what occurs in their recurrent-depth architecture. Successful frankenmerges that operate without additional fine-tuning are able to recover or "heal" from any damage due to abrupt transitions between layer blocks. Operational replicated layer blocks can provide functional benefits grounded in latent reasoning. Frankenmerges can also result in hybrid reasoning, by splicing together the latent reasoning of different models.
Back in April 2024, I was able to duplicate a few layers in the Llama 3 8B model, turning it into a 9B model, without harming benchmarks significantly, despite any transition damage.
grimjim/llama-3-experiment-v1-9B
My informal experimentation suggested that latent reasoning circuits could occupy continguous stacks of 2-4 layers, though the result was highly sensitive to the choice of transition location between layers.
Specifically, the duplication of layers in Frankenmerges serves a purpose similar to what occurs in their recurrent-depth architecture. Successful frankenmerges that operate without additional fine-tuning are able to recover or "heal" from any damage due to abrupt transitions between layer blocks. Operational replicated layer blocks can provide functional benefits grounded in latent reasoning. Frankenmerges can also result in hybrid reasoning, by splicing together the latent reasoning of different models.
Back in April 2024, I was able to duplicate a few layers in the Llama 3 8B model, turning it into a 9B model, without harming benchmarks significantly, despite any transition damage.
grimjim/llama-3-experiment-v1-9B
My informal experimentation suggested that latent reasoning circuits could occupy continguous stacks of 2-4 layers, though the result was highly sensitive to the choice of transition location between layers.
- 1 reply
liked
a
model
6 months ago
liked
3
models
7 months ago
upvoted
2
collections
7 months ago