← Back to all models
Foundation Model
scBERT
BERT-based pre-trained model for single-cell transcriptomics with gene-level tokenization.
Overview
scBERT adapts the BERT architecture for single-cell transcriptomics by treating each gene as a token. It is pre-trained on large-scale scRNA-seq data using masked gene expression prediction and achieves strong performance on cell type annotation tasks.
Publication
scBERT as a large-scale pretrained deep language model for cell type annotation of single-cell RNA-seq data