vikhyatk/moondream2
Image-Text-to-Text
ā¢
Updated
ā¢
124k
ā¢
1.05k
Fatih C. Akyon
fcakyon
AI & ML interests
multi-modal learning, video understanding
Recent Activity
new activity
3 days ago
An-619/FastSAM:Which Ultralytics is being used?
liked
a model
4 days ago
vikhyatk/moondream2
liked
a Space
4 days ago
An-619/FastSAM
Organizations
fcakyon's activity
Which Ultralytics is being used?
#7 opened 4 days ago
by
fcakyon
liked
a
model
4 days ago
liked
a
Space
4 days ago
fix runtime error by adding missing lines
1
#11 opened 4 days ago
by
fcakyon
updated
a
Space
4 days ago
dont clear selected points until `Clear points` button is pressed or input image is changed
#10 opened 4 days ago
by
fcakyon
update to latest gradio for improved ui performance
#9 opened 4 days ago
by
fcakyon
Remove non-used redundant ultralytics folder
#8 opened 4 days ago
by
fcakyon
š© Report: Not working
2
#6 opened 5 days ago
by
fcakyon
Adding `safetensors` variant of this model
#1 opened 13 days ago
by
SFconvertbot
Adding `safetensors` variant of this model
#1 opened about 2 months ago
by
SFconvertbot
Adding `safetensors` variant of this model
#1 opened about 1 month ago
by
SFconvertbot
Adding `safetensors` variant of this model
#1 opened about 1 month ago
by
SFconvertbot
confidence score
2
#24 opened about 1 month ago
by
fcakyon
List of All Supported Languages
#76 opened about 1 month ago
by
fcakyon
š© Report: Not working
#1 opened about 1 month ago
by
fcakyon
liked
a
Space
about 1 month ago
reacted to
joaogante's
post with š¤
about 1 month ago
Post
3266
New sampling strategy dropped in š¤ transformers -- Min P sampling š„
Are you tired of having
Min P consists of a dynamic token filter -- as opposed to Top K, which keeps the K most likely tokens, and Top P, which keeps the most likely tokens up to a fixed cumulative probability, both static filters. Min P takes a base probability (defined in the
š High probability token present -> aggressive filter (we don't want to miss on that high-probability case and risk derailing generation)
š No high probability token present -> relaxed filter (there are many continuation possibilities that the model finds plausible)
You should set
Kudos to @kalomaze and @menhguin for creating this technique š„ Read their discussion in the original issue for benchmarks (https://github.com/huggingface/transformers/issues/27670)
Copy-pasteable version of the example in the image below here: https://pastebin.com/VqXNtuxd
Have fun experimenting! š
Are you tired of having
top_k arbitrarily discarding high-quality continuations? Or top_p forgetting to exclude low-probability tokens, derailing your generation? Try out the new min_p flag in generate, fresh from a PR merged today! š„¬Min P consists of a dynamic token filter -- as opposed to Top K, which keeps the K most likely tokens, and Top P, which keeps the most likely tokens up to a fixed cumulative probability, both static filters. Min P takes a base probability (defined in the
min_p flag) and multiplies it by the probability of the most likely token in the distribution for the next token. All tokens less likely than the resulting value are filtered. What happens with this strategy?š High probability token present -> aggressive filter (we don't want to miss on that high-probability case and risk derailing generation)
š No high probability token present -> relaxed filter (there are many continuation possibilities that the model finds plausible)
You should set
min_p to a low value, between 0.05 and 0.1. It behaves particularly well for creative text generation when paired up with temperature > 1.Kudos to @kalomaze and @menhguin for creating this technique š„ Read their discussion in the original issue for benchmarks (https://github.com/huggingface/transformers/issues/27670)
Copy-pasteable version of the example in the image below here: https://pastebin.com/VqXNtuxd
Have fun experimenting! š
reacted to
joaogante's
post with š„
about 1 month ago
Post
2704
Adding a long prompt can help you fight LLM hallucinations. However, if you know exactly how you want your LLM output constrained, there are much better strategies! šŖ
Did you know you can force your LLM to ALWAYS generate a valid JSON file? Or to follow a well-defined answer template? You can do that and more with the š¤ transformers-compatible
It doesn't only allow you to master your LLM -- your text generation application will also become faster! š„ The more constrained your text generation is, the bigger speedups you'll see!
Follow @remi and other
Did you know you can force your LLM to ALWAYS generate a valid JSON file? Or to follow a well-defined answer template? You can do that and more with the š¤ transformers-compatible
outlines library.It doesn't only allow you to master your LLM -- your text generation application will also become faster! š„ The more constrained your text generation is, the bigger speedups you'll see!
Follow @remi and other
outlines folks to stay on top of the constrained generation game š§
add_confidence_score
3
#56 opened 7 months ago
by
haipingwu