Context Length Differences

by zacharyrs - opened Jul 23, 2023

Jul 23, 2023

Hey there,

I'm just curious why the max_position_embeddings in this quantization is set to 2048, whereas the original model had 4096?
Forgive my ignorance if there's an obvious answer - I'm new to LLMs.

Cheers!

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment