Upload model

README.md

@@ -0,0 +1,199 @@
+---
+library_name: transformers
+tags: []
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]

config.json

@@ -0,0 +1,28 @@
+{
+  "_name_or_path": "./merged_model",
+  "architectures": [
+    "Qwen2Model"
+  ],
+  "attention_dropout": 0.0,
+  "eos_token_id": 151645,
+  "hidden_act": "silu",
+  "hidden_size": 8192,
+  "initializer_range": 0.02,
+  "intermediate_size": 29568,
+  "max_position_embeddings": 32768,
+  "max_window_layers": 80,
+  "model_type": "qwen2",
+  "num_attention_heads": 64,
+  "num_hidden_layers": 86,
+  "num_key_value_heads": 8,
+  "rms_norm_eps": 1e-06,
+  "rope_scaling": null,
+  "rope_theta": 1000000.0,
+  "sliding_window": null,
+  "tie_word_embeddings": false,
+  "torch_dtype": "float32",
+  "transformers_version": "4.48.1",
+  "use_cache": false,
+  "use_sliding_window": false,
+  "vocab_size": 151646
+}

model-00001-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:614e38efffed8804cc054f194743b4401787c12f89671cf411f57370cd672e3d
+size 4969136264

model-00002-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b7394da4e068ac385f8abfe401f1efa26a86b18c43261090b424fd46bf914f17
+size 4114761736

model-00003-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c5c179594b0ba0fff1861ceda0b00407967fe74b459092c280df0e18edb5419d
+size 4479624584

model-00004-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:60a4d0040574d57ba35ab62b2072f88301254dd8c272cbd34258caa0d7328747
+size 4479624584

model-00005-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:275a5ecb9ae1e3b387b972e5bb06ef2c309d7f13efba2d30ce3beb3cdb5ec500
+size 4815276256

model-00006-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7f4a8ec64bd0db9546b5158119097b3fed93caefcc7138aca451c568e9e875d3
+size 4748060152

model-00007-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c11bb28848b3a147c82ba17e597e9412ab0e1d2e3358113c5a096495db611202
+size 4479624584

model-00008-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:20605a577c442a845fdf99915c04d8a021123bebd465e0f409b6b939035da954
+size 4815276256

model-00009-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0c65c9f50f2458a160b691bd9fb3a7e7d6fe0f6dbe840072c7216dc7f603d040
+size 4748060168

model-00010-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b09a9a0063673c7fe6d2f530ed87705ff270585107db91131071ccb3d7905ade
+size 4479624600

model-00011-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a615dd63dbe2ee9dc122d73ac476d8682cd9987f8bbdb307186286c29bb87f2a
+size 4815276272

model-00012-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:010678924de63c200ca95e5f33e3a032990ac48d22caa933086ee5a642bf8f72
+size 4748060168

model-00013-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:af8b7c464579d6996082ccb7d725fcfd316120e5c451c5a57fb690182470e665
+size 4479624600

model-00014-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:32d94f3addd951374bdc78d8a9029d95ab328b20ea26988260a3d6bf072c175c
+size 4815276272

model-00015-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3fa5351d847583f44bb1e544ea41d54e262a54ff6b59e21afdbbc1fcaf382cbb
+size 4748060168

model-00016-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:21018f469e27312d125e9297f88fa81ece30bb84b2834a0aa492d994b66f3719
+size 4479624600

model-00017-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2a97c155078d3c242d4b72c0d817305c117bf6860abc6b70ce74f11b764ee00a
+size 4815276272

model-00018-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b173d7068a85a97e0d63f2e7501ce177bb6fd996e13a5b18839c082ed213b879
+size 4748060168

model-00019-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c74543be13a764b10f1aedc7cdb1c468bae9030f612d9fc06f10f5799e1f54c9
+size 4479624600

model-00020-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5e6a646a84773557bf28ce0a3c5e4aaa97293f6757ec011688e15be220d02635
+size 4815276272

model-00021-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8a1e4324984d470883a35b9883d11ece35f7f52e42fd3a26f987e1fdf8d49a54
+size 4748060168

model-00022-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:99045083943c5bb5d9552eaed51ef74e223f4b128bc2943280287bfd4017ab1e
+size 4479624600

model-00023-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d387c6f1d9772dcdb91ebba614d06db04b6870d3b0be46f79e6e0723ce98bd92
+size 4815276272

model-00024-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:893707cb31f2981e714b8936d696a3315d022b1658072287d0fa04c0c7f71dd9
+size 4748060168

model-00025-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:216945a3c5c392bb4e13b29aa4513c3e6b14db7959fd32cbd0350a230d0bd61e
+size 4479624600

model-00026-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:95454ef182095c302ba8354be5c7fda5f0d464c0838e7c2969bdb215d5e6d2a4
+size 4815276272

model-00027-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ee0a700131743cbb0d9e53c3499da1d0d55c2297a81c977865ea4cd8a37c97d9
+size 4748060168

model-00028-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:29f70aeb5de6069e47bd150ad7dbbc38f0fd0847eed7a9329c2f676fec5e4fbb
+size 4479624600

model-00029-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:49e8fa5d023d9d158139bf9690139099de73efb65ddf44e3599bf5e32278a99c
+size 4815276272

model-00030-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4110f5627f78e55dbb5cb58f070b0c4d8fda2ab4bad60202aac609e883efbf66
+size 4748060168

model-00031-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:32d13f15640e76c08ec540e9be331cf434556e4971d580811657666f39bdffe8
+size 4479624600

model-00032-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:92c7f6fe7190679838c55dce65a83d0bce187e21c671c2188c9f177763e83486
+size 4815276272

model-00033-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3b28f5af8f6f51a34e60452afbab6c3e8cf51ee343b37a4b40b56777bf396cc9
+size 4748060168

model-00034-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e963f5287657b8e7407a99efb1847fcad36fd3aa19331b335a596a42e28a729c
+size 4479624600

model-00035-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8495bac7ccb8345dc14e6854c554c4f84d4baab335cb2d06abb811f05dea8b8a
+size 4815276272

model-00036-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9dd7148ac63b9d91e88b65d01ca935065240003112f161de77d8634e4eeef605
+size 4748060168

model-00037-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2a73c2155b044bf8e194f434705f150f2d569203b73160970b710f4211bf5f8d
+size 4479624600

model-00038-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:544db0d80b9760501814002c934a3dc9fe9e98a78c191a980f7ce67ffd52a018
+size 4815276272

model-00039-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ec5a7f0342c41a0bcfaabf8526702066ed9c128452956ef12eb3a9aee0a0d9ca
+size 4748060168

model-00040-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4ee4837975609051ea4affca03940cad90d00125b70703014e314e3c607f18bb
+size 4479624600

model-00041-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2036c0328b65d92c501a0f0d97b1d9753b6207543ed6b5a97cf4d0f607946088
+size 4815276272

model-00042-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9536dd7bd478550ca671e8d2e32bb00322f34a24a39dcea9f83fc1019f415c48
+size 4748060168

model-00043-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:901c258c2eb17bad2c4b33dbc39090b10d88e48823f1e162cc1f42d66441a290
+size 4479624600

model-00044-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5e9e5b66d7d79badcb034a20e54244d2368f534902e15ccad4b81392b6c418a5
+size 4815276272

model-00045-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0335bd762e8d0c258a840eba8b1db99b6c1a1f78297453712507041eed862559
+size 4748060168

model-00046-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:24b8f494b219f288697afd3f4def4196c4b2fd601f46c792f8591c770dc31642
+size 4479624600

model-00047-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:36e9d3b6a1869fe1c9bd360d93f5a0f02ea1aa6ec6668550251821a0242f32ba
+size 4815276272

model-00048-of-00066.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fc5ca75b58301dc0bf704864b72976043e4c8b36274104dd099b06adef9a95ac
+size 4748060168