Overview

This is the C2S-Pythia-410m-cell-type-conditioned-cell-generation model, built on the Pythia-410m architecture developed by EleutherAI, fine-tuned using Cell2Sentence (C2S) on a comprehensive collection of single-cell RNA sequencing (scRNA-seq) datasets from CellxGene and the Human Cell Atlas. Cell2Sentence is a pioneering technique that adapts large language models (LLMs) to single-cell biology by converting scRNA-seq data into "cell sentences" — ordered sequences of gene names based on expression levels. This model is specifically trained for cell type-conditioned single-cell generation, enabling the generation of realistic single-cell profiles conditioned on specified cell types.

Training Data

This model was trained on over 57 million human and mouse cells gathered from over 800 single-cell RNA sequencing datasets from CellxGene and the Human Cell Atlas. This dataset covers a broad range of cell types and conditions from multiple tissues in both human and mouse.

This model was trained with the top 200 genes per cell sentence.

Tasks

This model is designed for:

  • Cell type-conditioned single-cell generation: Generating single-cell profiles conditioned on specific cell types, allowing for the creation of synthetic cells that reflect the gene expression patterns of targeted cell types.

Cell2Sentence Links

Pythia Links

Downloads last month
28
Safetensors
Model size
405M params
Tensor type
F32
·
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for vandijklab/C2S-Pythia-410m-cell-type-conditioned-cell-generation

Finetuned
(71)
this model

Collection including vandijklab/C2S-Pythia-410m-cell-type-conditioned-cell-generation