Checkpoint compatibility
Hi, are the checkpoints provided here compatible with the architecture found at:
https://github.com/microsoft/GenerativeImage2Text
Or do they need some kind of modification?
Hi,
Yes the checkpoints were ported from there. See the conversion script (used to convert them from the original repository to the Transformers format) here: https://github.com/huggingface/transformers/blob/main/src/transformers/models/git/convert_git_to_pytorch.py
Hi Niels, thank you for the quick answer.
Do you happen to know how to access the original checkpoints? It seems to me that the link they provided is not working
https://publicgit.blob.core.windows.net/data/output/GIT_BASE/snapshot/model.pt
Or is my only alternative the one of converting them back checking how you translated them with the script?