Hugging Face's logo
Lorenzo Cevolani's picture
10

Lorenzo Cevolani

LorenzoCevolaniAXA
21world's profile picture
·

AI & ML interests

NLP, Transformers, GNN and many more!

Organizations

AXA Belgium - AIAS Team's profile picture

LorenzoCevolaniAXA's activity

New activity in neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w4a16 3 months ago

weights does not exist when trying to deploy in sagemaker endpoint

1
#1 opened 3 months ago by LorenzoCevolaniAXA
New activity in mistral-community/Mixtral-8x22B-Instruct-v0.1-4bit 7 months ago

error in sagemaker deployement
#2 opened 7 months ago by LorenzoCevolaniAXA
New activity in text-generation-inference/Mixtral-8x7B-Instruct-v0.1-medusa 7 months ago

What about latencies
#3 opened 7 months ago by LorenzoCevolaniAXA
New activity in ybelkada/Mixtral-8x7B-Instruct-v0.1-AWQ 7 months ago

latency is slower than standard model, is it normal?
#5 opened 7 months ago by LorenzoCevolaniAXA
New activity in text-generation-inference/Mixtral-8x7B-Instruct-v0.1-medusa 8 months ago

how to use this model on sagemaker endpoints

2
#1 opened 9 months ago by LorenzoCevolaniAXA
New activity in CohereForAI/c4ai-command-r-v01 8 months ago

Error "sharded is not supported for AutoModel" when deploying on sagemaker endpoint
#22 opened 8 months ago by LorenzoCevolaniAXA
New activity in CohereForAI/aya-101 9 months ago

Correct machine to deploy the model on AWS Sagemaker
#11 opened 9 months ago by LorenzoCevolaniAXA
New activity in mistralai/Mixtral-8x7B-Instruct-v0.1 11 months ago

SageMaker Deployment Error

11
#53 opened 11 months ago by seabasshn
New activity in intfloat/multilingual-e5-large about 1 year ago

Sagemaker Instance suggestion for Inference
#18 opened about 1 year ago by LorenzoCevolaniAXA
New activity in DAMO-NLP-MT/polylm-chat-13b over 1 year ago

protoc error while deploying the model into SM instance

1
#1 opened over 1 year ago by LorenzoCevolaniAXA