File size: 914 Bytes
5047e93
ff39e7c
5047e93
8728f69
2602de5
7d2f5c1
 
ad74537
5047e93
 
 
 
2f260c7
6f15d8f
8bebfef
63564aa
ff9d197
5047e93
dd1bbea
cf6ec6a
2602de5
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
---
base_model: internlm/internlm2_5-7b-chat
pipeline_tag: text-generation
license: apache-2.0
language:
  - en
  - zh
library_name: transformers
---



# internlm2_5-7b-chat-abliterated

## Version 1.1 (Updated 9/1/2024): Layer 17 is used for abliteration instead of 16. Refusal mitigation tends to work better with this layer. PCA and cosine similarity tests seem to agree.

Check out the <a href="https://huggingface.co/byroneverson/internlm2_5-7b-chat-abliterated/blob/main/abliterate-internlm-2-5-7b-chat.ipynb">jupyter notebook</a> for details of how this model was abliterated from internlm2_5-7b-chat.

Please check out my <a href="https://huggingface.co/byroneverson/glm-4-9b-chat-abliterated">newer abliteration of glm-4-9b-chat</a>. It's jupyter notebook is a little more developed than this one.

![Logo](https://huggingface.co/byroneverson/internlm2_5-7b-chat-abliterated/resolve/main/logo.png "Logo")