PramaLLC/BEN
Image Segmentation
•
Updated
•
234
•
78
boqsc
boqsc
AI & ML interests
None yet
Recent Activity
liked
a model
about 1 month ago
PramaLLC/BEN
liked
a Space
about 1 month ago
Qwen/Qwen2.5-Coder-Artifacts
Organizations
None yet
boqsc's activity
liked
a
model
about 1 month ago
liked
a
Space
about 1 month ago
liked
a
model
3 months ago
Is this really Llama 3.1-70B? the config.json say: Meta-Llama-3-70B-Instruct
1
#35 opened 4 months ago
by
boqsc
I created the Llama-3.1-8B Version
10
#38 opened 4 months ago
by
gr0010
liked
3
models
4 months ago
liked
a
model
7 months ago
liked
a
model
8 months ago
liked
a
model
10 months ago
liked
2
models
11 months ago
liked
a
Space
11 months ago
reacted to
fffiloni's
post with ❤️
11 months ago
Post
I'm happy to announce that ✨ Image to Music v2 ✨ is ready for you to try and i hope you'll like it too ! 😌
This new version has been crafted with transparency in mind,
so you can understand the process of translating an image to a musical equivalent.
How does it works under the hood ? 🤔
First, we get a very literal caption from microsoft/kosmos-2-patch14-224; this caption is then given to a LLM Agent (currently HuggingFaceH4/zephyr-7b-beta )which task is to translate the image caption to a musical and inspirational prompt for the next step.
Once we got a nice musical text from the LLM, we can send it to the text-to-music model of your choice:
MAGNet, MusicGen, AudioLDM-2, Riffusion or Mustango
Instead of the previous version of Image to Music which used Mubert API, and could output curious and obscure combinations, we only provide open sourced models available on the hub, called via the gradio API.
Also i guess the music result should be more accurate to the atmosphere of the image input, thanks to the LLM Agent step.
Pro tip, you can adjust the inspirational prompt to match your expectations, according to the chosen model and specific behavior of each one 👌
Try it, explore different models and tell me which one is your favorite 🤗
—› fffiloni/image-to-music-v2
This new version has been crafted with transparency in mind,
so you can understand the process of translating an image to a musical equivalent.
How does it works under the hood ? 🤔
First, we get a very literal caption from microsoft/kosmos-2-patch14-224; this caption is then given to a LLM Agent (currently HuggingFaceH4/zephyr-7b-beta )which task is to translate the image caption to a musical and inspirational prompt for the next step.
Once we got a nice musical text from the LLM, we can send it to the text-to-music model of your choice:
MAGNet, MusicGen, AudioLDM-2, Riffusion or Mustango
Instead of the previous version of Image to Music which used Mubert API, and could output curious and obscure combinations, we only provide open sourced models available on the hub, called via the gradio API.
Also i guess the music result should be more accurate to the atmosphere of the image input, thanks to the LLM Agent step.
Pro tip, you can adjust the inspirational prompt to match your expectations, according to the chosen model and specific behavior of each one 👌
Try it, explore different models and tell me which one is your favorite 🤗
—› fffiloni/image-to-music-v2
- 9 replies
liked
2
models
12 months ago
Even with the prompt, it still feels like a fight.
2
#3 opened 12 months ago
by
boqsc
Is it Mistral 7b v0.1 or v0.2?
2
#2 opened 12 months ago
by
boqsc
liked
a
model
12 months ago