Feature Selection and Hierarchical Clustering of cells in Zhengmix4eq
Installing the Package
HIPPO is under review for Bioconductor and CRAN submission. You can download the developer version as below. Please allow up to 5 minutes to completely compile the vignette.
Read the data
The data set is available in the following link, where the detailed explanation is available here. Note that the file is very large (3.3GB). We use a subset of Zheng 2017 data set saved as a toydata within this package. Also, we load a reference data that matches ENSG ID to HGNC gene names.
Alternatively, you can start from a matrix object.
Diagnostic Plot
This plot shows the zero inflation compared to the expected Poisson line. If most genes don’t align with the black line, it shows that there is cell heterogeneity driving the zero inflation.
Feature Selection and Hierarchical Clustering
HIPPO assumes that the count matrix is placed in toydata@assays@data$counts. Some objects that we found online have the count matrix in toydata@assays$data$counts. In this case, HIPPO will throw an error because it cannot found a count matrix. In this case, you have to create another SingleCellExperiment object to assign the count matrix in the correct slot.
Next, you can run hippo function to do the pre-processing that simutlaneously conducts feature selection and hierarchcial clustering. There are three arguments that help you decide the stopping criterion of clustering procedure.
K is the maximum number of clusters that you want. HIPPO will return the clustering results for all k = 2, 3, …, K, so you can overestimate the number of potential clusters. The default is 10, but users are highly recommended to adjust this.
z_threshold is the feature selection criterion. For each round of hierarchical clustering, hippo will find outlier genes where the z-value of significance is greater than the threshold. For example, if you would like to select genes with p-values less than 0.05, z_threshold would be 1.96. The default threshold is 2, but users can use their discretion to change this value.
outlier_proportion is the number of outlier genes to allow. The default is 0.01 (1%) which means the clustering procedure will automatically stop if there are less than 1% of genes remain as important features. With the example data set, the default choice has empirically worked well.
Dimension Reduction for Each Round of HIPPO
We offer two dimension reduction methods: umap and tsne. And we offer two separate visualization functions.
Visualize the selected features at each round
This function shows how the zero-inflation decreases as HIPPO proceeds in the clustering. This function has arguments called switch_to_hgnc and ref. These aim to provide the users an option to change the gene names from ENSG IDs to HGNC symbols for ease of understanding. Many SingleCellExperiment objects have such data embedded in rowData(toydata). Users can create a data frame with ensg and hgnc columns for the genes, and HIPPO will automatically switch the row names of the count matrix from ENSG IDs to HGNC symbols. The default is set to FALSE, assuming that the row names are already HGNC symbols.
Differential Expression Example
We also offer a differential expression analysis tool.
This function also has an option to switch the gene names to HGNC symbols. top.n argument lets users choose how many top genes to show in the box plot. The default is 5.
The labels of boxplots are aligned with the t-SNE or UMAP plots above. When K is equal to 2, the color codes match with the cell groups as separated in the dimension reduction plot.
Each round of differential expression test results are also saved in the list of data frames.
genes meandiff sd z
21 ENSG00000087086 16.087318 0.9591965 16.771661
100 ENSG00000101439 8.384615 0.5678778 14.764823
32 ENSG00000011600 5.038462 0.4402124 11.445523
97 ENSG00000196126 4.308732 0.5546155 7.768864
52 ENSG00000204482 2.253638 0.2991452 7.533593
87 ENSG00000158869 2.022869 0.2839227 7.124717R version 4.4.2 (2024-10-31)
Platform: x86_64-pc-linux-gnu
Running under: Ubuntu 24.04.1 LTS
Matrix products: default
BLAS: /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3
LAPACK: /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.26.so; LAPACK version 3.12.0
locale:
[1] LC_CTYPE=en_US.UTF-8 LC_NUMERIC=C
[3] LC_TIME=en_US.UTF-8 LC_COLLATE=C
[5] LC_MONETARY=en_US.UTF-8 LC_MESSAGES=en_US.UTF-8
[7] LC_PAPER=en_US.UTF-8 LC_NAME=C
[9] LC_ADDRESS=C LC_TELEPHONE=C
[11] LC_MEASUREMENT=en_US.UTF-8 LC_IDENTIFICATION=C
time zone: Etc/UTC
tzcode source: system (glibc)
attached base packages:
[1] stats4 stats graphics grDevices utils datasets methods
[8] base
other attached packages:
[1] SingleCellExperiment_1.29.1 SummarizedExperiment_1.37.0
[3] Biobase_2.67.0 GenomicRanges_1.59.0
[5] GenomeInfoDb_1.43.1 IRanges_2.41.1
[7] S4Vectors_0.45.2 BiocGenerics_0.53.3
[9] generics_0.1.3 MatrixGenerics_1.19.0
[11] matrixStats_1.4.1 HIPPO_1.19.0
[13] rmarkdown_2.29
loaded via a namespace (and not attached):
[1] gtable_0.3.6 xfun_0.49 bslib_0.8.0
[4] ggplot2_3.5.1 ggrepel_0.9.6 lattice_0.22-6
[7] vctrs_0.6.5 tools_4.4.2 tibble_3.2.1
[10] fansi_1.0.6 pkgconfig_2.0.3 Matrix_1.7-1
[13] lifecycle_1.0.4 GenomeInfoDbData_1.2.13 farver_2.1.2
[16] compiler_4.4.2 stringr_1.5.1 munsell_0.5.1
[19] htmltools_0.5.8.1 sys_3.4.3 buildtools_1.0.0
[22] sass_0.4.9 yaml_2.3.10 pillar_1.9.0
[25] crayon_1.5.3 jquerylib_0.1.4 openssl_2.2.2
[28] cachem_1.1.0 DelayedArray_0.33.2 abind_1.4-8
[31] RSpectra_0.16-2 tidyselect_1.2.1 digest_0.6.37
[34] Rtsne_0.17 stringi_1.8.4 dplyr_1.1.4
[37] reshape2_1.4.4 labeling_0.4.3 maketools_1.3.1
[40] fastmap_1.2.0 grid_4.4.2 colorspace_2.1-1
[43] cli_3.6.3 SparseArray_1.7.2 magrittr_2.0.3
[46] S4Arrays_1.7.1 utf8_1.2.4 withr_3.0.2
[49] UCSC.utils_1.3.0 scales_1.3.0 XVector_0.47.0
[52] httr_1.4.7 umap_0.2.10.0 reticulate_1.40.0
[55] gridExtra_2.3 png_0.1-8 askpass_1.2.1
[58] evaluate_1.0.1 knitr_1.49 irlba_2.3.5.1
[61] rlang_1.1.4 Rcpp_1.0.13-1 glue_1.8.0
[64] jsonlite_1.8.9 R6_2.5.1 plyr_1.8.9
[67] zlibbioc_1.52.0