--- license: cc-by-nc-nd-4.0 base_model: - johnsnowlabs/JSL-MedMNX-7B - BioMistral/BioMistral-7B-DARE library_name: transformers tags: - mergekit - merge --- [](https://hf.co/QuantFactory) # QuantFactory/BioMistral-MedMNX-GGUF This is quantized version of [BioMistral/BioMistral-MedMNX](https://huggingface.co/BioMistral/BioMistral-MedMNX) created using llama.cpp # Original Model Card # BioMistral-MedMNX This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [DARE](https://arxiv.org/abs/2311.03099) [TIES](https://arxiv.org/abs/2306.01708) merge method using [johnsnowlabs/JSL-MedMNX-7B](https://huggingface.co/johnsnowlabs/JSL-MedMNX-7B) as a base. ### Models Merged The following models were included in the merge: * [BioMistral/BioMistral-7B-DARE](https://huggingface.co/BioMistral/BioMistral-7B-DARE) ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: johnsnowlabs/JSL-MedMNX-7B parameters: density: 0.53 weight: 0.4 - model: BioMistral/BioMistral-7B-DARE parameters: density: 0.53 weight: 0.3 merge_method: dare_ties tokenizer_source: union base_model: johnsnowlabs/JSL-MedMNX-7B parameters: int8_mask: true dtype: bfloat16 ```