File size: 1,188 Bytes
b614794
 
 
 
aed9371
b614794
 
 
 
64e5405
b614794
6e5955b
 
b614794
6e5955b
 
b614794
945728c
c8b95a1
78e3e3f
6e5955b
 
b614794
6e5955b
b83544d
b614794
6e5955b
 
b614794
6e5955b
b614794
6e5955b
b614794
6e5955b
b614794
6e5955b
 
b614794
6e5955b
b614794
6e5955b
b614794
6e5955b
b614794
6e5955b
b614794
6e5955b
b614794
6e5955b
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
---
base_model: westlake-repl/SaProt_35M_AF2
library_name: peft
---
# Base model: [westlake-repl/SaProt_35M_AF2](https://huggingface.co/westlake-repl/SaProt_35M_AF2)

# Model Card for Model ID

<!-- Provide a quick summary of what the model is/does. -->
This model is used to predict ACE2 binding affinities with mutant SARSCoV-2 Omicron BQ1.1 variants spike receptor-binding domain (RBD). 

### Task type
protein level regression

### Dataset description
The dataset is from [Deep mutational scans of XBB.1.5 and BQ.1.1 reveal ongoing epistatic drift during SARSCoV-2 evolution](https://doi.org/10.1371/journal.ppat.1011901).

Label means binding affinities level, ranging from minus infinity to positive infinity.
Zero means no affinity, lager means higher affinity and smaller means lower affinity.

### Model input type
Amino acid sequence

### Performance
0.70 Spearman's ρ

### LoRA config
lora_dropout: 0.0

lora_alpha: 16

target_modules: ["query", "key", "value", "intermediate.dense", "output.dense"]

modules_to_save: ["classifier"]

### Training config
class: AdamW

betas: (0.9, 0.98)

weight_decay: 0.01

learning rate: 1e-3

epoch: 50

batch size: 200

precision: 16-mixed