Update README.md
Browse files
README.md
CHANGED
@@ -74,16 +74,16 @@ To support real-time and resource-constrained applications, we further introduce
|
|
74 |
### DMind-1-mini
|
75 |
|
76 |
To address scenarios requiring lower latency and faster inference, we introduce **DMind-1-mini**, a lightweight distilled version of DMind-1 based on Qwen3-14B. DMind-1-mini is trained using knowledge distillation and our custom **DeepResearch** framework, drawing from two teacher models:
|
77 |
-
- **DMind-1** (Qwen3-32B): Our specialized Web3 domain model
|
78 |
-
- **GPT-o3 + DeepResearch**: A general-purpose SOTA LLM, with its outputs processed through our DeepResearch framework for Web3 domain alignment
|
79 |
|
80 |
The **Distillation pipeline** combines:
|
81 |
|
82 |
-
- **Web3-specific data distillation**: High-quality instruction-following and QA examples generated by the teacher models
|
83 |
|
84 |
-
- **Distribution-level supervision**: The student model learns to approximate the teachers' output distributions through soft-label guidance, preserving nuanced prediction behavior and confidence calibration
|
85 |
|
86 |
-
- **Intermediate representation transfer**: Knowledge is transferred by aligning intermediate representations between teacher and student models, promoting deeper structural understanding beyond surface-level mimicry
|
87 |
|
88 |
This multi-level distillation strategy enables DMind-1-mini to maintain high Web3 task performance while significantly reducing computational overhead and latency, making it suitable for real-time applications such as instant Q&A, on-chain analytics, and lightweight agent deployment.
|
89 |
|
@@ -99,11 +99,11 @@ Under this rigorous evaluation:
|
|
99 |
|
100 |
|
101 |
## 3. Use Cases
|
102 |
-
- **Expert-Level Question & Answering**: Provides accurate, context-aware answers on blockchain, DeFi, smart contracts, and related Web3 topics
|
103 |
-
- **Compliance-Aware Support**: Assists in drafting or reviewing content within regulatory and legal contexts
|
104 |
-
- **Content Generation in Domain**: Produces Web3-specific blog posts, documentation, and tutorials tailored to developers and users
|
105 |
-
- **DeFi Strategy Suggestions**: Generates insights and recommendations for yield farming, liquidity provision, and portfolio strategies based on user-provided data
|
106 |
-
- **Risk Management**: Suggests strategies aligned with user risk profiles for more informed decision-making in volatile markets
|
107 |
|
108 |
## 4. Quickstart
|
109 |
|
|
|
74 |
### DMind-1-mini
|
75 |
|
76 |
To address scenarios requiring lower latency and faster inference, we introduce **DMind-1-mini**, a lightweight distilled version of DMind-1 based on Qwen3-14B. DMind-1-mini is trained using knowledge distillation and our custom **DeepResearch** framework, drawing from two teacher models:
|
77 |
+
- **DMind-1** (Qwen3-32B): Our specialized Web3 domain model.
|
78 |
+
- **GPT-o3 + DeepResearch**: A general-purpose SOTA LLM, with its outputs processed through our DeepResearch framework for Web3 domain alignment.
|
79 |
|
80 |
The **Distillation pipeline** combines:
|
81 |
|
82 |
+
- **Web3-specific data distillation**: High-quality instruction-following and QA examples generated by the teacher models.
|
83 |
|
84 |
+
- **Distribution-level supervision**: The student model learns to approximate the teachers' output distributions through soft-label guidance, preserving nuanced prediction behavior and confidence calibration.
|
85 |
|
86 |
+
- **Intermediate representation transfer**: Knowledge is transferred by aligning intermediate representations between teacher and student models, promoting deeper structural understanding beyond surface-level mimicry.
|
87 |
|
88 |
This multi-level distillation strategy enables DMind-1-mini to maintain high Web3 task performance while significantly reducing computational overhead and latency, making it suitable for real-time applications such as instant Q&A, on-chain analytics, and lightweight agent deployment.
|
89 |
|
|
|
99 |
|
100 |
|
101 |
## 3. Use Cases
|
102 |
+
- **Expert-Level Question & Answering**: Provides accurate, context-aware answers on blockchain, DeFi, smart contracts, and related Web3 topics.
|
103 |
+
- **Compliance-Aware Support**: Assists in drafting or reviewing content within regulatory and legal contexts.
|
104 |
+
- **Content Generation in Domain**: Produces Web3-specific blog posts, documentation, and tutorials tailored to developers and users.
|
105 |
+
- **DeFi Strategy Suggestions**: Generates insights and recommendations for yield farming, liquidity provision, and portfolio strategies based on user-provided data.
|
106 |
+
- **Risk Management**: Suggests strategies aligned with user risk profiles for more informed decision-making in volatile markets.
|
107 |
|
108 |
## 4. Quickstart
|
109 |
|