gen_weight_roberta_like.py model_type

#5
by pikaduck - opened

The Roberta like weight generating script here - https://github.com/NielsRogge/LiLT/blob/fix_script/gen_weight_roberta_like.py changes the model_type of text model config to liltrobertalike but the config file for this model - https://huggingface.co/nielsr/lilt-xlm-roberta-base/raw/main/config.json has model_type as lilt. That also happened when I generated this model - https://huggingface.co/pikaduck/lilt-biomed-roberta-base/blob/main/config.json using that repo & script, and model_type turned out as lilt with LiltModel as the architecture. And using that script now to hook up legal-roberta-base (https://huggingface.co/saibo/legal-roberta-base) with lilt is outputting a model with RobertaForMaskedLM architecture and model_type liltrobertalike. Are there any internal scripts that are determining this apart from the manual assignment in the gen_weight_roberta_like.py script?

I checked the repo commits, there are no recent commits that have changed that somehow, so could you please explain that @nielsr . Thanks!

pikaduck changed discussion status to closed

Sign up or log in to comment