Hugging Face's logo
Joshua Rosenkranz's picture
5 1 2

Joshua Rosenkranz

JRosenkranz
dfbdokk's profile picture eliebak's profile picture bikash05's profile picture
·

AI & ML interests

None yet

Organizations

IBM's profile picture ibm-ai-platform's profile picture LLHF's profile picture SLLHF's profile picture blhf's profile picture nltpt's profile picture

JRosenkranz's activity

New activity in ibm-ai-platform/llama3-8b-accelerator 2 months ago

Unexpectedly Large Memory Usage of ibm-fms/llama3-8b-accelerator in vLLM

1
#4 opened 3 months ago by
baizhuoyan
New activity in ibm-granite/granite-20b-code-instruct-accelerator 6 months ago

r1.1

1
#3 opened 6 months ago by
sahilsuneja
New activity in ibm-ai-platform/llama3-8b-accelerator 10 months ago

ValueError: Unsupported model type mlp_speculator using TGI server

2
#2 opened 10 months ago by
rishabh-simpplr
New activity in ibm-ai-platform/granite-7b-lab-accelerator 11 months ago

Error: prefill failed

4
#1 opened 11 months ago by
ulrichkr
New activity in ibm-ai-platform/llama3-8b-accelerator 11 months ago

shard 0 never ready when given the speculator option?

7
#1 opened 11 months ago by
mhill4980

shard 0 never ready when given the speculator option?

7
#1 opened 11 months ago by
mhill4980
New activity in ibm-ai-platform/granite-7b-lab-accelerator 11 months ago

Error: prefill failed

4
#1 opened 11 months ago by
ulrichkr
New activity in ibm-ai-platform/llama3-8b-accelerator 11 months ago

shard 0 never ready when given the speculator option?

7
#1 opened 11 months ago by
mhill4980
New activity in ibm-ai-platform/granite-7b-lab-accelerator 11 months ago

Error: prefill failed

4
#1 opened 11 months ago by
ulrichkr