Frankai123 commited on
Commit
836c8ea
·
verified ·
1 Parent(s): b993dbd

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -10
README.md CHANGED
@@ -74,16 +74,16 @@ To support real-time and resource-constrained applications, we further introduce
74
  ### DMind-1-mini
75
 
76
  To address scenarios requiring lower latency and faster inference, we introduce **DMind-1-mini**, a lightweight distilled version of DMind-1 based on Qwen3-14B. DMind-1-mini is trained using knowledge distillation and our custom **DeepResearch** framework, drawing from two teacher models:
77
- - **DMind-1** (Qwen3-32B): Our specialized Web3 domain model
78
- - **GPT-o3 + DeepResearch**: A general-purpose SOTA LLM, with its outputs processed through our DeepResearch framework for Web3 domain alignment
79
 
80
  The **Distillation pipeline** combines:
81
 
82
- - **Web3-specific data distillation**: High-quality instruction-following and QA examples generated by the teacher models
83
 
84
- - **Distribution-level supervision**: The student model learns to approximate the teachers' output distributions through soft-label guidance, preserving nuanced prediction behavior and confidence calibration
85
 
86
- - **Intermediate representation transfer**: Knowledge is transferred by aligning intermediate representations between teacher and student models, promoting deeper structural understanding beyond surface-level mimicry
87
 
88
  This multi-level distillation strategy enables DMind-1-mini to maintain high Web3 task performance while significantly reducing computational overhead and latency, making it suitable for real-time applications such as instant Q&A, on-chain analytics, and lightweight agent deployment.
89
 
@@ -99,11 +99,11 @@ Under this rigorous evaluation:
99
 
100
 
101
  ## 3. Use Cases
102
- - **Expert-Level Question & Answering**: Provides accurate, context-aware answers on blockchain, DeFi, smart contracts, and related Web3 topics
103
- - **Compliance-Aware Support**: Assists in drafting or reviewing content within regulatory and legal contexts
104
- - **Content Generation in Domain**: Produces Web3-specific blog posts, documentation, and tutorials tailored to developers and users
105
- - **DeFi Strategy Suggestions**: Generates insights and recommendations for yield farming, liquidity provision, and portfolio strategies based on user-provided data
106
- - **Risk Management**: Suggests strategies aligned with user risk profiles for more informed decision-making in volatile markets
107
 
108
  ## 4. Quickstart
109
 
 
74
  ### DMind-1-mini
75
 
76
  To address scenarios requiring lower latency and faster inference, we introduce **DMind-1-mini**, a lightweight distilled version of DMind-1 based on Qwen3-14B. DMind-1-mini is trained using knowledge distillation and our custom **DeepResearch** framework, drawing from two teacher models:
77
+ - **DMind-1** (Qwen3-32B): Our specialized Web3 domain model.
78
+ - **GPT-o3 + DeepResearch**: A general-purpose SOTA LLM, with its outputs processed through our DeepResearch framework for Web3 domain alignment.
79
 
80
  The **Distillation pipeline** combines:
81
 
82
+ - **Web3-specific data distillation**: High-quality instruction-following and QA examples generated by the teacher models.
83
 
84
+ - **Distribution-level supervision**: The student model learns to approximate the teachers' output distributions through soft-label guidance, preserving nuanced prediction behavior and confidence calibration.
85
 
86
+ - **Intermediate representation transfer**: Knowledge is transferred by aligning intermediate representations between teacher and student models, promoting deeper structural understanding beyond surface-level mimicry.
87
 
88
  This multi-level distillation strategy enables DMind-1-mini to maintain high Web3 task performance while significantly reducing computational overhead and latency, making it suitable for real-time applications such as instant Q&A, on-chain analytics, and lightweight agent deployment.
89
 
 
99
 
100
 
101
  ## 3. Use Cases
102
+ - **Expert-Level Question & Answering**: Provides accurate, context-aware answers on blockchain, DeFi, smart contracts, and related Web3 topics.
103
+ - **Compliance-Aware Support**: Assists in drafting or reviewing content within regulatory and legal contexts.
104
+ - **Content Generation in Domain**: Produces Web3-specific blog posts, documentation, and tutorials tailored to developers and users.
105
+ - **DeFi Strategy Suggestions**: Generates insights and recommendations for yield farming, liquidity provision, and portfolio strategies based on user-provided data.
106
+ - **Risk Management**: Suggests strategies aligned with user risk profiles for more informed decision-making in volatile markets.
107
 
108
  ## 4. Quickstart
109