ValueError: [broadcast_shapes] Shapes (48) and (64) cannot be broadcast.
🥲 Failed to load the model
Failed to load model
Error when loading model: ValueError: [broadcast_shapes] Shapes (48) and (64) cannot be broadcast.
Hi @alexcardo ! The new model required some changes, did you install the latest version (0.21.5) of mlx-lm?
pip install --upgrade mlx-lm
Hi,
@alexcardo
!
The solution
@pcuenq
shared works if you're using the mlx-lm python package.
But I noticed that the error you pasted is the default error message from LM Studio. As it depends on mlx-lm to run MLX, we'll need to wait for the next release of LM Studio (or use the beta version, to get it earlier).
cc
@yagilb
It doesn't appear like there's a version 0.21.5 of mlxlibraries yet, it's still 0.21.2 on github and swift package manager.
@alexcardo , I'm closing this issue as I confirmed that the new version of LM Studio (v0.3.11) can run this model.
@Mitchins , the library needed is actually mlx-lm. The current version is v0.21.5.