3 1 7

Straughter Guthrie PRO

jmanhype

AI & ML interests

None yet

Recent Activity

upvoted a paper 13 days ago

SRMT: Shared Memory for Multi-agent Lifelong Pathfinding

liked a model 3 months ago

GoodiesHere/Apollo-LMMs-Apollo-3B-t32

replied to merve's post 3 months ago

Apollo is a new family of open-source video language models by Meta, where 3B model outperforms most 7B models and 7B outperforms most 30B models 🧶 ✨ the models come in 1.5B https://huggingface.co/Apollo-LMMs/Apollo-1_5B-t32, 3B https://huggingface.co/Apollo-LMMs/Apollo-3B-t32 and 7B https://huggingface.co/Apollo-LMMs/Apollo-7B-t32 with A2.0 license, based on Qwen1.5 & Qwen2 ✨ the authors also release a benchmark dataset https://huggingface.co/spaces/Apollo-LMMs/ApolloBench The paper has a lot of experiments (they trained 84 models!) about what makes the video LMs work ⏯️ Try the demo for best setup here https://huggingface.co/spaces/Apollo-LMMs/Apollo-3B they evaluate sampling strategies, scaling laws for models and datasets, video representation and more! > The authors find out that whatever design decision was applied to small models also scale properly when the model and dataset are scaled 📈 scaling dataset has diminishing returns for smaller models > They evaluate frame sampling strategies, and find that FPS sampling is better than uniform sampling, and they find 8-32 tokens per frame optimal > They also compare image encoders, they try a variation of models from shape optimized SigLIP to DINOv2 they find https://huggingface.co/google/siglip-so400m-patch14-384 to be most powerful 🔥 > they also compare freezing different parts of models, training all stages with some frozen parts give the best yield They eventually release three models, where Apollo-3B outperforms most 7B models and Apollo 7B outperforms 30B models 🔥

View all activity

Organizations

jmanhype's activity

liked 2 models 3 months ago

GoodiesHere/Apollo-LMMs-Apollo-3B-t32

Text Generation • Updated Dec 18, 2024 • 78 • 18

Qwen/Qwen2.5-Coder-0.5B-Instruct

Text Generation • Updated Nov 18, 2024 • 42.3k • • 42

liked a Space 3 months ago

810

OminiControl

🌍

Generate detailed images from a prompt and an image

liked a model 7 months ago

openbmb/MiniCPM-V-2_6

Image-Text-to-Text • Updated Jan 15 • 72.2k • 955

liked a Space 11 months ago

199

AniPortrait Official

🏆

Create an animated video from audio and a reference image

liked a Space about 1 year ago

Scepter Studio

🚀

liked a Space almost 2 years ago

2.27k

HuggingGPT

😻

Engage in multimedia chat with LLMs and ML models