Suparious commited on
Commit
464125c
·
verified ·
1 Parent(s): 3f817ee

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +33 -2
README.md CHANGED
@@ -1,4 +1,6 @@
1
  ---
 
 
2
  library_name: transformers
3
  tags:
4
  - 4-bit
@@ -6,10 +8,39 @@ tags:
6
  - text-generation
7
  - autotrain_compatible
8
  - endpoints_compatible
9
- pipeline_tag: text-generation
 
10
  inference: false
11
  quantized_by: Suparious
12
  ---
13
  #
14
 
15
- **UPLOAD IN PROGRESS**
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ language:
3
+ - en
4
  library_name: transformers
5
  tags:
6
  - 4-bit
 
8
  - text-generation
9
  - autotrain_compatible
10
  - endpoints_compatible
11
+ - vision
12
+ pipeline_tag: image-text-to-text
13
  inference: false
14
  quantized_by: Suparious
15
  ---
16
  #
17
 
18
+ ## Model Summary
19
+
20
+ # ADD HEAD
21
+
22
+ ```
23
+
24
+
25
+
26
+ print('Add Vision...')
27
+ # ADD HEAD
28
+ # Combine pre-trained encoder and pre-trained decoder to form a Seq2Seq model
29
+
30
+
31
+
32
+ Vmodel = VisionEncoderDecoderModel.from_encoder_decoder_pretrained(
33
+ "google/vit-base-patch16-224-in21k", "LeroyDyer/Mixtral_AI_Tiny"
34
+ )
35
+ _Encoder_ImageProcessor = Vmodel.encoder
36
+ _Decoder_ImageTokenizer = Vmodel.decoder
37
+ _VisionEncoderDecoderModel = Vmodel
38
+ # Add Pad tokems
39
+ LM_MODEL.VisionEncoderDecoder = _VisionEncoderDecoderModel
40
+ # Add Sub Components
41
+ LM_MODEL.Encoder_ImageProcessor = _Encoder_ImageProcessor
42
+ LM_MODEL.Decoder_ImageTokenizer = _Decoder_ImageTokenizer
43
+ LM_MODEL
44
+
45
+
46
+ ```