mwitiderrick (Derrick Mwiti)

upvoted 3 articles 7 months ago

Article

The Open Medical-LLM Leaderboard: Benchmarking Large Language Models in Healthcare

Apr 19, 2024

• 131

Article

Fine-tuning 20B LLMs with RLHF on a 24GB consumer GPU

Mar 9, 2023

• 40

Article

Putting RL back in RLHF

Jun 12, 2024

• 75

upvoted 2 articles 8 months ago

Article

Welcome Gemma 2 - Google's new open LLM

Jun 27, 2024

• 127

Article

Proximal Policy Optimization (PPO)

Aug 5, 2022

• 20

upvoted a collection 8 months ago

FP8 LLMs for vLLM

Collection

Accurate FP8 quantized models by Neural Magic, ready for use with vLLM! • 44 items • Updated Oct 17, 2024 • 65

upvoted 3 articles 8 months ago

Article

Introducing Idefics2: A Powerful 8B Vision-Language Model for the community

Apr 15, 2024

• 174

Article

A Dive into Pretraining Strategies for Vision-Language Models

Feb 3, 2023

• 54

Article

Vision Language Models Explained

Apr 11, 2024

• 260

upvoted 2 collections 10 months ago

OpenELM Instruct Models

Collection

4 items • Updated Oct 4, 2024 • 116

📀 Dataset comparison models

Collection

1.8B models trained on 350BT to compare different pretraining datasets • 8 items • Updated Jun 12, 2024 • 37

upvoted a paper 11 months ago

A Picture is Worth a Thousand Words: Principled Recaptioning Improves Image Generation

Paper • 2310.16656 • Published Oct 25, 2023 • 44

upvoted a collection 11 months ago

Sparse Foundational Llama 2 Models

Collection

Sparse pre-trained and fine-tuned Llama models made by Neural Magic + Cerebras • 27 items • Updated Sep 26, 2024 • 9

upvoted a collection about 1 year ago

DeepSparse Sparse LLMs

Collection

Useful LLMs for DeepSparse where we've pruned at least 50% of the weights! • 10 items • Updated Sep 26, 2024 • 5

upvoted a collection over 1 year ago

Open LLM Leaderboard best models ❤️‍🔥

Collection

A daily uploaded list of models with best evaluations on the LLM leaderboard: • 64 items • Updated about 1 hour ago • 534

upvoted 2 papers over 1 year ago

VeRA: Vector-based Random Matrix Adaptation

Paper • 2310.11454 • Published Oct 17, 2023 • 30

Sparse Finetuning for Inference Acceleration of Large Language Models

Paper • 2310.06927 • Published Oct 10, 2023 • 14

upvoted a collection over 1 year ago

Sparse Finetuning MPT

Collection

Explore our breakthrough in sparse fine-tuning LLMs! Our novel method maintains downstream accuracy even with >70% sparsity. • 13 items • Updated Sep 26, 2024 • 3

upvoted a paper over 1 year ago

QA-LoRA: Quantization-Aware Low-Rank Adaptation of Large Language Models

Paper • 2309.14717 • Published Sep 26, 2023 • 44

Derrick Mwiti

AI & ML interests

Organizations

mwitiderrick's activity

The Open Medical-LLM Leaderboard: Benchmarking Large Language Models in Healthcare

Fine-tuning 20B LLMs with RLHF on a 24GB consumer GPU

Putting RL back in RLHF

Welcome Gemma 2 - Google's new open LLM

Proximal Policy Optimization (PPO)

FP8 LLMs for vLLM

Introducing Idefics2: A Powerful 8B Vision-Language Model for the community

A Dive into Pretraining Strategies for Vision-Language Models

Vision Language Models Explained

OpenELM Instruct Models

📀 Dataset comparison models

A Picture is Worth a Thousand Words: Principled Recaptioning Improves Image Generation

Sparse Foundational Llama 2 Models

DeepSparse Sparse LLMs

Open LLM Leaderboard best models ❤️‍🔥

VeRA: Vector-based Random Matrix Adaptation

Sparse Finetuning for Inference Acceleration of Large Language Models

Sparse Finetuning MPT

QA-LoRA: Quantization-Aware Low-Rank Adaptation of Large Language Models