hidden_activation vs hidden_act in config.json

#10

by heheda - opened Sep 22, 2024

Sep 22, 2024

Llama 3.1 uses hidden_act to specify the activation function, while this model uses hidden_activation. Can you change the hidden_activation to hidden_act to help vllm reuse the code of llama 3.1?

ArthurZ

Meta Llama org Sep 22, 2024

For sure

heheda

Sep 22, 2024

Thanks!

heheda changed discussion status to closed Sep 22, 2024

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment