Jeremie Tisby's picture
1 49

Jeremie Tisby

Frobenius
ยท

AI & ML interests

None yet

Recent Activity

liked a model 12 days ago
LGAI-EXAONE/EXAONE-3.5-2.4B-Instruct
liked a model 26 days ago
HKUSTAudio/Llasa-3B
updated a collection about 1 month ago
LLMs
View all activity

Organizations

Hugging Face Discord Community's profile picture

Frobenius's activity

updated a collection about 1 month ago
replied to lewtun's post 2 months ago
view reply

Wow people... This is CRACKED! THANK YOU HF!!!

reacted to lewtun's post with ๐Ÿ”ฅ 2 months ago
view post
Post
6912
We outperform Llama 70B with Llama 3B on hard math by scaling test-time compute ๐Ÿ”ฅ

How? By combining step-wise reward models with tree search algorithms :)

We show that smol models can match or exceed the performance of their much larger siblings when given enough "time to think"

We're open sourcing the full recipe and sharing a detailed blog post.

In our blog post we cover:

๐Ÿ“ˆ Compute-optimal scaling: How we implemented DeepMind's recipe to boost the mathematical capabilities of open models at test-time.

๐ŸŽ„ Diverse Verifier Tree Search (DVTS): An unpublished extension we developed to the verifier-guided tree search technique. This simple yet effective method improves diversity and delivers better performance, particularly at large test-time compute budgets.

๐Ÿงญ Search and Learn: A lightweight toolkit for implementing search strategies with LLMs and built for speed with vLLM

Here's the links:

- Blog post: HuggingFaceH4/blogpost-scaling-test-time-compute

- Code: https://github.com/huggingface/search-and-learn

Enjoy!
  • 2 replies
ยท
updated a collection 7 months ago