WizardLM

WizardLM

AI & ML interests

NLP, LLM

Recent Activity

Organizations

WizardLM Team's profile picture WizardDev's profile picture

WizardLM's activity

reacted to their post with ๐Ÿš€ 6 months ago
view post
Post
11143
๐Ÿ”ฅ ๐Ÿ”ฅ๐Ÿ”ฅ
Excited to announce WizardLM new Paper: Auto Evol-Instruct!

๐Ÿฆ Twitter: https://x.com/WizardLM_AI/status/1812857977122202087

๐Ÿ“ƒ Paper: https://arxiv.org/pdf/2406.00770

๐Ÿค– 1. Fully AI-Powered Pipeline

Auto Evol-Instruct automatically involves an iterative process of optimizing an Evol-Instruct V1 into an optimal one. The pipeline consists of two critical stages: Evol Trajectory Analysis, where the optimizer LLM analyzes the issues and failures exposed in instruction evolution performed by the evol LLM, and Evolving Method Optimization, where the optimizer LLM addresses these issues to progressively develop an effective evolving method. The optimal evolving method is then used to convert the entire instruction dataset into more diverse and complex forms, facilitating improved instruction tuning.

๐Ÿ“ˆ2. Scaling Evol-Instruct with Arena Learning

With Auto Evol-Instruct, the evolutionary synthesis data of WizardLM-2 has scaled up from WizardLM-1 to dozens of domains, covering tasks in all aspects of large language models. This allows Arena Learning to train and learn from an almost infinite pool of high-difficulty instruction data, fully unlocking all the potential of Arena Learning.
  • 1 reply
ยท
posted an update 6 months ago
view post
Post
11143
๐Ÿ”ฅ ๐Ÿ”ฅ๐Ÿ”ฅ
Excited to announce WizardLM new Paper: Auto Evol-Instruct!

๐Ÿฆ Twitter: https://x.com/WizardLM_AI/status/1812857977122202087

๐Ÿ“ƒ Paper: https://arxiv.org/pdf/2406.00770

๐Ÿค– 1. Fully AI-Powered Pipeline

Auto Evol-Instruct automatically involves an iterative process of optimizing an Evol-Instruct V1 into an optimal one. The pipeline consists of two critical stages: Evol Trajectory Analysis, where the optimizer LLM analyzes the issues and failures exposed in instruction evolution performed by the evol LLM, and Evolving Method Optimization, where the optimizer LLM addresses these issues to progressively develop an effective evolving method. The optimal evolving method is then used to convert the entire instruction dataset into more diverse and complex forms, facilitating improved instruction tuning.

๐Ÿ“ˆ2. Scaling Evol-Instruct with Arena Learning

With Auto Evol-Instruct, the evolutionary synthesis data of WizardLM-2 has scaled up from WizardLM-1 to dozens of domains, covering tasks in all aspects of large language models. This allows Arena Learning to train and learn from an almost infinite pool of high-difficulty instruction data, fully unlocking all the potential of Arena Learning.
  • 1 reply
ยท
upvoted an article 6 months ago
updated a Space 8 months ago
replied to their post 9 months ago
view reply

The models weights were removed about 20 minutes ago. Are there any plans to bring those back or relocate them?

Hi all Huggingface friends, we are sorry for that removing .

Itโ€™s been a while since weโ€™ve released a model months ago๐Ÿ˜…, so weโ€™re unfamiliar with the new release process now: We accidentally missed an item required in the model release process - toxicity testing. This is a step that all new models currently need to complete.

We are currently completing this test quickly and then will re-release our model as soon as possible. ๐Ÿ‡

โค๏ธDo not worry, thanks for your kindly caring and understanding.