allenai

/

Molmo-7B-D-0924

like 478

Follow

Ai2 1.78k

To test the diversity of generated outputs by setting the temperature, it would be helpful to have beam search functionality for MOLMO. However, currently I receive the following error:
NotImplementedError: Make sure that a _reorder_cache function is correctly implemented in transformers_modules.allenai.Molmo-7B-D-0924.1721478b71306fb7dc671176d5c204dc7a4d27d7.modeling_molmo to enable beam search for <class 'transformers_modules.allenai.Molmo-7B-D-0924.1721478b71306fb7dc671176d5c204dc7a4d27d7.modeling_molmo.MolmoForCausalLM'>

I found this documentation helpful: link

Could this be integrated into MolmoforCausalLM?