All benchmarks

Spatial Decomposition

Calling cell-type compositions for spot-based spatial transcriptomics data

9 methods
2 control methods
7 datasets
1 metrics
1 release

Spatial decomposition (also often referred to as Spatial deconvolution) is applicable to spatial transcriptomics data where the transcription profile of each capture location (spot, voxel, bead, etc.) do not share a bijective relationship with the cells in the tissue, i.e., multiple cells may contribute to the same capture location. The task of spatial decomposition then refers to estimating the composition of cell types/states that are present at each capture location. The cell type/states estimates are presented as proportion values, representing the proportion of the cells at each capture location that belong to a given cell type.

We distinguish between reference-based decomposition and de novo decomposition, where the former leverage external data (e.g., scRNA-seq or scNuc-seq) to guide the inference process, while the latter only work with the spatial data. We require that all datasets have an associated reference single cell data set, but methods are free to ignore this information.

contributors
summary figure

Leaderboard

Methods ranked by scaled overall mean. Each cell encodes a score from 0 to 1 by size and intensity.

QC: Normalisation Visualisation 1 plot

Per metric: points placed by control-anchored scaled score (x); dashed lines mark scaled 0 and 1 (worst/best control); the lower axis shows the raw score. Points beyond [-0.2, 1.2] are clamped to the edge as triangles. Hover a dot or line to highlight it and read details.

methodcontrol
  • r2higher better
    True ProportionsTrue ProportionsCell2location (alpha=…Cell2location (alpha=1, reference hard-coded)Cell2location (alpha=…Cell2location (alpha=20, reference hard-coded)Cell2location (alpha=…Cell2location (alpha=200, reference hard-coded)Cell2location (alpha=…Cell2location (alpha=20, NB reference)Cell2location (alpha=…Cell2location (alpha=20, amortised, hard-coded)DestVIDestVINon-Negative Least Sq…Non-Negative Least SquaresRCTDRCTDStereoscopeStereoscopeNon-Negative Matrix F…Non-Negative Matrix Factorization (NMF)NMF-regNMF-regRandom ProportionsRandom ProportionsTangramTangramSeuratV3SeuratV3-2.124-1.343-0.5620.219100.250.50.751rawscaled
QC: Indicator table 1 error1 warning

Automated checks on the benchmark run and its results: missing values, score scaling, metric ranges and similar. Errors are high-severity issues that usually need a maintainer's attention; warnings are lower-severity signals. Findings that are expected for this task are listed separately as silenced.

1 high-severity issue need review. 77 of 79 checks passed.

  • error Scaling Worst score seuratv3 r2

    Method seuratv3 performs much worse than baselines. Task id: spatial_decomposition Method id: seuratv3 Metric id: r2 Worst score: -4.847694679925471%

Show 1 warning
  • warning Scaling Worst score tangram r2

    Method tangram performs much worse than baselines. Task id: spatial_decomposition Method id: tangram Metric id: r2 Worst score: -2.638332193078756%

Method info 9

Cell2location is a decomposition method based on Negative Binomial regression that is able to account for batch effects in estimating the single-cell gene expression signature used for the spatial decomposition step. Note that since batch information is unavailable in this task, here we use either a hard-coded reference, or a negative-binomial learned reference without batch labels. The parameter alpha refers to the detection efficiency prior.

parameter sets tested alpha=20, amortised, hard-codedalpha=1, reference hard-codedalpha=20, reference hard-codedalpha=200, reference hard-codedalpha=20, NB reference

destVI is a decomposition method that leverages a conditional generative model of spatial transcriptomics down to the sub-cell-type variation level, which is then used to decompose the cell-type proportions determining the spatial organization of a tissue.

NMFreg is a decomposition method based on Non-negative Matrix Factorization Regression (NMFreg) that reconstructs expression of each spatial location as a weighted combination of cell-type signatures defined by scRNA-seq. It was originally developed for Slide-seq data.

Non-Negative Least Squarescode ↗source ↗Aliee & Theis, 2021

NNLS13 is a decomposition method based on Non-Negative Least Square Regression (NNLS). It was originally introduced by the method AutoGenes

Non-Negative Matrix Factorizationcode ↗source ↗Cichocki & Phan, 2009

NMF is a decomposition method based on Non-negative Matrix Factorization (NMF) that reconstructs expression of each spatial location as a weighted combination of cell-type signatures defined by scRNA-seq. It is a simpler baseline than NMFreg as it only performs the NMF step based on mean expression signatures of cell types, returning the weights loading of the NMF as (normalized) cell type proportions, without the regression step.

parameter sets tested NMF

RCTD (Robust Cell Type Decomposition) is a decomposition method that uses signatures learnt from single-cell data to decompose spatial expression of tissues. It is able to platform effect normalization step, which normalizes the scRNA-seq cell type profiles to match the platform effects of the spatial transcriptomics dataset.

SeuratV3 is a decomposition method that is based on Canonical Correlation Analysis (CCA).

Stereoscope is a decomposition method based on Negative Binomial regression. It is similar in scope and implementation to cell2location but less flexible to incorporate additional covariates such as batch effects and other type of experimental design annotations.

Tangram is a method to map gene expression signatures from scRNA-seq data to spatial data. It performs the cell type mapping by learning a similarity matrix between single-cell and spatial locations based on gene expression profiles.

Control method info 2

Random assignment of predicted celltype proportions from a Dirichlet distribution.

Perfect assignment of predicted celltype proportions from the ground truth.

Metric info 1
r2higher is betterMiles, 2005

R2, or the “coefficient of determination”, reports the fraction of the true proportion values’ variance that can be explained by the predicted proportion values. The best score, and upper bound, is 1.0. There is no fixed lower bound for the metric. The uniform/non-weighted average across all cell types/states is used to summarise performance.

Dataset info 7

scRNA-seq is generated based on learn NB parameters from the destVI manuscripts leveraging sparsePCA. Number of cells and cell types present in each spatial spot is computed via combination of kernel-based parametrization of a categorical distribution and the NB model.

Human pancreas cells aggregated from single-cell (Dirichlet alpha=0.5)

Human pancreas cells aggregated from single-cell (Dirichlet alpha=1)

Human pancreas cells aggregated from single-cell (Dirichlet alpha=5)

Mouse lung cells aggregated from single-cell (Dirichlet alpha=0.5)

Mouse lung cells aggregated from single-cell (Dirichlet alpha=1)

Mouse lung cells aggregated from single-cell (Dirichlet alpha=5)

references
  1. Aliee, H., & Theis, F. J. (2021). AutoGeneS: Automatic gene selection using multi-objective optimization for RNA-seq deconvolution. Cell Systems, 12(7), 706-715.e4. 10.1016/j.cels.2021.05.006 ↗
  2. Andersson, A., Bergenstr\aahle, J., Asp, M., Bergenstr\aahle, L., Jurek, A., Navarro, J. F., & Lundeberg, J. (2020). Single-cell and spatial transcriptomics enables probabilistic inference of cell type topography. Communications Biology, 3(1). 10.1038/s42003-020-01247-y ↗
  3. Biancalani, T., Scalia, G., Buffoni, L., Avasthi, R., Lu, Z., Sanger, A., Tokcan, N., Vanderburg, C. R., \AAsa Segerstolpe, Zhang, M., Avraham-Davidi, I., Vickovic, S., Nitzan, M., Ma, S., Subramanian, A., Lipinski, M., Buenrostro, J., Brown, N. B., Fanelli, D., … Regev, A. (2021). Deep learning and alignment of spatially resolved single-cell transcriptomes with Tangram. Nature Methods, 18(11), 1352–1362. 10.1038/s41592-021-01264-7 ↗
  4. Cable, D. M., Murray, E., Zou, L. S., Goeva, A., Macosko, E. Z., Chen, F., & Irizarry, R. A. (2021). Robust decomposition of cell type mixtures in spatial transcriptomics. Nature Biotechnology, 40(4), 517–526. 10.1038/s41587-021-00830-w ↗
  5. Cichocki, A., & Phan, A.-H. (2009). Fast Local Algorithms for Large Scale Nonnegative Matrix and Tensor Factorizations. IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences, E92-a(3), 708–721. 10.1587/transfun.e92.a.708 ↗
  6. Open Problems for Single Cell Analysis Consortium. (2022). Open Problems. link ↗
  7. Kleshchevnikov, V., Shmatko, A., Dann, E., Aivazidis, A., King, H. W., Li, T., Elmentaite, R., Lomakin, A., Kedlian, V., Gayoso, A., Jain, M. S., Park, J. S., Ramona, L., Tuck, E., Arutyunyan, A., Vento-Tormo, R., Gerstung, M., James, L., Stegle, O., & Bayraktar, O. A. (2022). Cell2location maps fine-grained cell types in spatial transcriptomics. Nature Biotechnology, 40(5), 661–671. 10.1038/s41587-021-01139-4 ↗
  8. Lopez, R., Li, B., Keren-Shaul, H., Boyeau, P., Kedmi, M., Pilzer, D., Jelinski, A., Yofe, I., David, E., Wagner, A., Ergen, C., Addadi, Y., Golani, O., Ronchese, F., Jordan, M. I., Amit, I., & Yosef, N. (2022). DestVI identifies continuums of cell types in spatial transcriptomics data. Nature Biotechnology, 40(9), 1360–1369. 10.1038/s41587-022-01272-8 ↗
  9. Miles, J. (2005). Encyclopedia of Statistics in Behavioral Science. John Wiley & Sons, Ltd. 10.1002/0470013192.bsa526 ↗
  10. Rodriques, S. G., Stickels, R. R., Goeva, A., Martin, C. A., Murray, E., Vanderburg, C. R., Welch, J., Chen, L. M., Chen, F., & Macosko, E. Z. (2019). Slide-seq: A scalable technology for measuring genome-wide expression at high spatial resolution. Science, 363(6434), 1463–1467. 10.1126/science.aaw1219 ↗
  11. Stuart, T., Butler, A., Hoffman, P., Hafemeister, C., Papalexi, E., Mauck, W. M., Hao, Y., Stoeckius, M., Smibert, P., & Satija, R. (2019). Comprehensive Integration of Single-Cell Data. Cell, 177(7), 1888-1902.e21. 10.1016/j.cell.2019.05.031 ↗