CHZY-1 commited on
Commit
ab1da75
1 Parent(s): 8b1d19b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -8
README.md CHANGED
@@ -19,21 +19,25 @@ language:
19
 
20
  # sqlcoder-7b-2_FineTuned_QLORA_Adapter
21
 
22
- This model is a fine-tuned version of [defog/sqlcoder-7b-2](https://huggingface.co/defog/sqlcoder-7b-2) on 260 MS SQL examples (Task, Schema and Answer).
23
 
24
  ## Intended uses & limitations
25
 
26
- MS Server - SQL Query Generation
27
 
28
- ## Training and evaluation data
29
 
30
- This model was re-trained using the QLoRA method, with the following configurations:
31
- - 'r = 64', 'lora_alpha = 32', 'lora_dropout = 0.05', bias='none', task_type='CAUSAL_LM'
 
 
 
 
32
 
33
  Quantization parameters:
34
- - load_in_4bit=True, bnb_4bit_quant_type="nf4", bnb_4bit_compute_dtype=torch.bfloat16
35
-
36
- ## Training procedure
37
 
38
  ### Training hyperparameters
39
 
 
19
 
20
  # sqlcoder-7b-2_FineTuned_QLORA_Adapter
21
 
22
+ This model is a fine-tuned version of [defog/sqlcoder-7b-2](https://huggingface.co/defog/sqlcoder-7b-2) on 260 SQL examples (Task, Schema and Answer triplets) related to financial/banking domain.
23
 
24
  ## Intended uses & limitations
25
 
26
+ MS SQL Server - SQL Query Generation
27
 
28
+ ## Training
29
 
30
+ This model was trained using the QLoRA method with the following configurations:
31
+ - r = 64,
32
+ - lora_alpha = 32
33
+ - lora_dropout = 0.05
34
+ - bias='none'
35
+ - task_type='CAUSAL_LM'
36
 
37
  Quantization parameters:
38
+ - load_in_4bit=True
39
+ - bnb_4bit_quant_type="nf4"
40
+ - bnb_4bit_compute_dtype=torch.bfloat16
41
 
42
  ### Training hyperparameters
43