Contents

1 Overview

The levi (Landscape Expression Visualization Interface) package integrates gene expression data with biological networks. It projects the expression values onto the plane of the network and computes a continuous surface (the landscape) by Gaussian smoothing. Elevated regions correspond to genes with a high transformed signal and to their neighbours in the layout of the network.

levi is based on two prior tools: Viacomplex (M. A. Castro et al. (2009)), written in Fortran using the Dislin library, and Galant (Camilo et al. (2013)), a Cytoscape plugin.

Two files are required to use levi: a gene expression file and a biological network file. Alternatively, results from differential expression tools (DESeq2, edgeR, limma) or single-cell tools (Seurat) can be passed directly as R objects.

Web interface (no installation required): An interactive demo is available via Binder at: https://mybinder.org/v2/gh/jrybarczyk/levi/master?urlpath=shiny/inst/shiny/

2 Input Files

2.1 Gene Expression Data

The expression file must contain a column with gene identifiers (Gene Symbol, Entrez ID, Ensembl, etc.) and at least one column with expression values (e.g., normalized counts, log2 fold-change).

If some network genes have no expression value, levi assigns the neutral value 0.5, which represents no change. The missing genes are listed in result$metadata$missing_genes and in a log file, levi.log, written to a subdirectory of the temporary directory of the R session (tempdir()) that is named after the comparison.

Expression data can be obtained from:

2.2 Biological Network

levi supports the following network file formats:

Extension Format
dat Medusa (DAT) (Hooper and Bork 2005)
dyn RedeR (DYN) (M. A. A. Castro et al. 2012)
net Pajek (NET) (Batagelj and Mrvar 1998)
stg STRING / STITCH (Szklarczyk et al. 2021)

Network interaction data can be obtained from:

2.3 Networks with no coordinates

Every format above carries a position for each node, because levi computes the landscape over the plane that the network occupies. Interaction databases usually provide a list of interacting pairs without coordinates.

leviFromEdges() computes the coordinates with igraph (Csárdi and Nepusz 2006) and returns the two tables that levi() requires:

library(levi)

interactions <- data.frame(
    from = c("HUB", "HUB", "HUB", "HUB", "N1", "N2", "N3", "N4"),
    to   = c("N1", "N2", "N3", "N4", "N5", "N6", "N7", "N8"),
    stringsAsFactors = FALSE)

set.seed(42)                       # force-directed layouts are stochastic
net <- leviFromEdges(interactions, layout = "kk")
## Network laid out with 'kk': 9 nodes, 8 edges.
head(net$nodes)
##   name        x         y
## 1  HUB 50.50000  50.50000
## 2   N1 38.79074  76.13341
## 3   N2 24.86659  38.79074
## 4   N3 62.20926  24.86659
## 5   N4 76.13341  62.20926
## 6   N5 27.88855 100.00000
expression <- data.frame(
    ID      = c("HUB", paste0("N", 1:8)),
    Test    = c(200, 200, 200, 200, 200, 5, 5, 5, 5),
    Control = c(10, 10, 10, 10, 10, 200, 200, 200, 200))

res_edges <- levi(
    networkCoordinatesInput  = net$nodes,
    networkInteractionsInput = net$edges,
    fileTypeInput            = "stg",
    expressionInput          = expression,
    geneSymbolInput          = "ID",
    readExpColumn            = readExpColumn("Test-Control"),
    resolutionValueInput     = 30,
    smoothValueInput         = 50)

res_edges$scores[, c("Gene", "LandscapeScore", "Rank")]
##   Gene LandscapeScore Rank
## 1  HUB         0.9524    1
## 2   N1         0.9027    2
## 3   N2         0.9027    3
## 4   N3         0.9027    4
## 5   N4         0.9027    5
## 6   N5         0.0854    6
## 7   N6         0.0854    7
## 8   N7         0.0854    8
## 9   N8         0.0854    9

The layout is an analytical choice and not only a graphical one. The same expression values on a different layout give a different landscape, because levi evaluates neighbourhoods in the layout plane, and the layout is part of every landscape test. Where a curated layout exists, it is preferable to a computed one.

3 Viewing Modes

3.1 Graphical User Interface (GUI)

The GUI runs locally via Shiny. It calls levi() with the parameters chosen in the side panel and runs the node-label analysis and the landscape display. The sample-label tests, blocks, exact enumeration, the graph tests, leviEnrich() and leviSave3D() are available in script mode only. The node-label results of the interface agree with those of script mode under the same seed.

library(levi)
LEVIui(browser = TRUE)   # Opens in the system browser
LEVIui(browser = FALSE)  # Opens inside RStudio
Figure 1: The interface after a run on the example data, with the File tab of the side panel, the 2D landscape and the genes under the area selected on the map.

3.1.1 Side panel

The side panel has two tabs. File holds everything needed for a run; Settings holds the parameters that change the landscape and the test.

File tab

  • Network input type and Upload the network file: the network format (Medusa DAT, RedeR DYN, Pajek NET or STRING/STITCH) and the file itself. The STRING/STITCH option asks for two files, coordinates and interactions.
  • Expression data source: a tab-delimited file, or a Bioconductor object saved as .rds (SummarizedExperiment, SingleCellExperiment or ExpressionSet). For a file, tick Expression values in log scale when the columns are log2 values and choose Two Samples (test against control) or One Sample. For an object, choose the assay, the condition column and the test and control levels.
  • Select ID field, Select test field, Select control field: the column with the gene identifiers, which must match the node names of the network, and the two columns to compare.
  • Colour scale: Multicolor, or Two colors with one of six palettes. Colours are applied without re-running.
  • Chart with contour adds contour lines to the map. 3D surface builds the interactive surface and brings the 3D surface tab to the front.
  • Highlight genes draws a circle, in the chosen colour, at the grid cell of each gene listed. Label peaks on map writes the name of the gene closest to each detected peak and valley.
  • Run builds the landscape.

Settings tab

  • Contrast, Resolution, Smoothing and Zoom: the visual parameters of levi(). Contrast sets the occupancy threshold of the silhouette (higher values give a tighter silhouette), resolution the grid size, smoothing the width of the Gaussian kernel relative to the grid, and zoom the frame around the network (0 is the widest frame, 100 the tightest). Their ranges and effects are tabulated in vignette("levi_guide").
  • Signal mode and logFC steepness k: the conversion of expression values into the landscape score, see Signal transformation.
  • Permutations, Test unit, Test direction and Significance level: the node-label permutation test. With permutations above zero the significant regions are outlined and labelled on the map; the default test unit is the region (maximum regional mass), the legacy per-cell test is still offered.

3.1.2 Results

The main panel shows the figure in two tabs and the tables in four.

  • 2D landscape: the map, with a format selector (TIFF, BMP, JPEG, PNG) and Download Plot. Click and drag on the map to select an area: Expression area shows the summed score of the selected cells and the Genes tab lists the genes under the selection.
  • 3D surface: the interactive surface, shown when 3D surface is ticked. Rotate it, then use the camera icon of the toolbar to save a PNG of the current view, or Download 3D (HTML) to keep the view in an interactive file. The camera of the current view is printed as R code that can be passed to leviSave3D(camera = ...) to reproduce the view in script mode.
  • Genes: the genes under the area selected on the 2D map. This tab is shown only while the 2D map is in front.
  • Node scores: the landscape score of every node, ranked, with a CSV download. This is result$scores of script mode.
  • Peaks and valleys: the detected extrema and the closest gene to each. This is result$peaks.
  • Regions: the connected areas of the landscape beyond the neutral score, with their size, mass and peak score; after a permutation test, the regional p-value and whether the region passes the significance level. This is result$regions$summary.
Figure 2: The Settings tab of the side panel, the 3D surface and the regions table after a permutation test with 100 iterations.

A busy indicator is shown at the top of the page while the landscape or the permutation test is computed.

3.2 Script Mode

3.2.1 Basic usage

library(levi)

template_network <- file.path(system.file(package = "levi"), "extdata",
                              "medusa.dat", fsep = .Platform$file.sep)

template_expression <- file.path(system.file(package = "levi"), "extdata",
                                 "expression.dat", fsep = .Platform$file.sep)

multicolor <- levi(
    networkCoordinatesInput = template_network,
    expressionInput        = template_expression,
    fileTypeInput          = "dat",
    geneSymbolInput        = "ID",
    readExpColumn          = readExpColumn("TumorCurrentSmoker-NormalNeverSmoker"),
    contrastValueInput     = 50,
    resolutionValueInput   = 20,
    zoomValueInput         = 50,
    smoothValueInput       = 5,
    contourLevi            = TRUE
)
## There are 1 nodes without expression value, see log in path: /tmp/Rtmp8ai10J/TumorCurrentSmoker-NormalNeverSmoker/levi.log

The example dataset contains lung adenocarcinoma microarray data (Landi et al. 2008) comparing tumor tissue from current smokers against normal tissue from never-smokers. Elevated regions (warm colours) correspond to network areas in which the transformed signal is higher in tumours, and depressed regions (cool colours) to areas in which it is lower. The contour lines mark the boundaries between score levels.

3.2.2 Comparing multiple conditions (batch mode)

The readExpColumn() function allows several comparisons to be processed in one call:

base <- readExpColumn(
    "TumorCurrentSmoker-NormalNeverSmoker",
    "TumorFormerSmoker-NormalFormerSmoker"
)

levi(
    networkCoordinatesInput = template_network,
    expressionInput         = template_expression,
    fileTypeInput           = "dat",
    geneSymbolInput         = "ID",
    readExpColumn           = base,
    setcolor                = "pink_green",
    contourLevi             = FALSE
)
## There are 1 nodes without expression value, see log in path: /tmp/Rtmp8ai10J/TumorCurrentSmoker-NormalNeverSmoker/levi.log

## There are 1 nodes without expression value, see log in path: /tmp/Rtmp8ai10J/TumorFormerSmoker-NormalFormerSmoker/levi.log

3.2.3 Signal transformation (signal_mode)

The signal_mode parameter controls how raw expression values are converted to the landscape score in \[0, 1\]. The choice depends on the data type:

signal_mode Formula Score 0.5 means Best for
"ratio" (default) Test / (Test + Control) Test ≈ Control Raw counts, TPM, FPKM, linear proteomics LFQ
"logfc" 1 / (1 + e^{−k · logFC}) logFC = 0 (no change) RMA microarray, VST/rlog DESeq2, log2-proteomics, scRNA-seq avg_log2FC
"zscore" pnorm(z) where z = (logFC − μ) / σ Mean logFC of support points Relative position within a comparison

Quick guide by experiment type:

Data type signal_mode expressionLog Input columns
Raw counts (RNA-seq) "ratio" FALSE mean_test, mean_ctrl
TPM / FPKM "ratio" FALSE mean_test, mean_ctrl
Microarray RMA (log2) "logfc" FALSE log2_test, log2_ctrl
DESeq2 log2FoldChange only "logfc" FALSE readExpColumn("log2FoldChange-log2FoldChange")
edgeR / limma logFC only "logfc" FALSE readExpColumn("logFC-logFC")
scRNA-seq avg_log2FC "logfc" + logfc_k = 0.5 FALSE readExpColumn("avg_log2FC-avg_log2FC")
scRNA-seq pct.1 / pct.2 "ratio" FALSE pct.1, pct.2
Proteomics log2 LFQ "logfc" FALSE log2_LFQ_test, log2_LFQ_ctrl
Multi-condition / heterogeneous "zscore" any Test, Control

The logfc_k parameter controls the steepness of the sigmoid in "logfc" mode. The ranges below are rules of thumb. The package default is k = 1, and the analyses of the accompanying manuscript used k = 0.7 for all datasets.

  • k = 0.3–0.5 — large fold-change datasets (scRNA-seq often reaches ±5)
  • k = 1 (default) — typical RNA-seq or proteomics (±2)
  • k = 2–3 — tight microarray fold-changes (±0.5–1)
# Microarray RMA — keep log2 scale, use logfc mode
res_rma <- levi(
    networkCoordinatesInput = template_network,
    expressionInput         = rma_expression_df,   # columns: ID, Tumor_log2, Normal_log2
    fileTypeInput           = "dat",
    geneSymbolInput         = "ID",
    readExpColumn           = readExpColumn("Tumor_log2-Normal_log2"),
    signal_mode             = "logfc",
    expressionLog           = FALSE   # keep in log2 scale; no 2^ transform
)

# scRNA-seq — single-column avg_log2FC with reduced steepness
res_sc <- levi(
    networkCoordinatesInput = template_network,
    expressionInput         = seurat_markers_df,  # column: GeneID, avg_log2FC
    fileTypeInput           = "dat",
    geneSymbolInput         = "GeneID",
    readExpColumn           = readExpColumn("avg_log2FC-avg_log2FC"),
    signal_mode             = "logfc",
    logfc_k                 = 0.5     # softer gradient for large FC values
)

# DESeq2 log2FoldChange as single column
res_deseq <- levi(
    networkCoordinatesInput = template_network,
    expressionInput         = leviFromDESeq2(dds_result),
    fileTypeInput           = "dat",
    geneSymbolInput         = "GeneID",
    readExpColumn           = readExpColumn("log2FoldChange-log2FoldChange"),
    signal_mode             = "logfc"
)

The recipes above refer to objects of the analyst’s own analysis. The package ships a small log2-scale dataset, so that the "logfc" recipe can be run as written:

logfc_net  <- system.file("extdata", "logfc_network.dat", package = "levi")
logfc_expr <- system.file("extdata", "logfc_expression.dat", package = "levi")

# Control is 8 for every gene and Test runs from 3 to 10, so the logFC
# spans -5 to +2 on the log2 scale.
res_logfc <- levi(
    networkCoordinatesInput = logfc_net,
    expressionInput         = logfc_expr,
    fileTypeInput           = "dat",
    geneSymbolInput         = "ID",
    readExpColumn           = readExpColumn("Test-Control"),
    resolutionValueInput    = 40,
    signal_mode             = "logfc",
    expressionLog           = FALSE   # already log2; no back-transform
)

res_logfc$scores[, c("Gene", "LandscapeScore", "Rank")]
##   Gene LandscapeScore Rank
## 1   GF         0.8230    1
## 2   GE         0.3309    2
## 3   GD         0.1008    3
## 4   GC         0.0663    4
## 5   GB         0.0183    5
## 6   GA         0.0077    6

Only GF has a score above the neutral value 0.5; it is the single gene whose test value exceeds the control.

3.2.4 Two-color palettes

The setcolor parameter selects the color palette. Available options are:

Value Description
"default" 20-level multicolor (blue → red)
"purple_pink" Two-color: purple → pink
"green_blue" Two-color: green → blue
"blue_yellow" Two-color: blue → yellow
"pink_green" Two-color: pink → green
"orange_purple" Two-color: orange → purple
"green_marine" Two-color: green → marine

4 3D Interactive Visualization

When the plotly package is installed, levi can generate an interactive 3D surface plot in addition to the standard 2D landscape. The surface can be rotated and zoomed, and the values can be inspected interactively.

install.packages("plotly")

levi(
    networkCoordinatesInput = template_network,
    expressionInput         = template_expression,
    fileTypeInput           = "dat",
    geneSymbolInput         = "ID",
    readExpColumn           = readExpColumn("TumorCurrentSmoker-NormalNeverSmoker"),
    plot3d                  = TRUE
)

The 3D surface uses the same colour palette as the 2D plot. Peaks of the landscape correspond to network sub-regions with a high transformed signal in the test condition, and valleys to sub-regions with a low transformed signal.

5 Importing from Differential Expression Tools

levi accepts results directly from standard differential expression workflows: DESeq2 (Love, Huber, and Anders 2014), edgeR (Robinson, McCarthy, and Smyth 2010), limma (Ritchie et al. 2015) and Seurat (Hao et al. 2021). This avoids the manual preparation of input files.

5.1 From DESeq2

library(DESeq2)
library(levi)

# After running DESeq2 analysis:
res <- results(dds, contrast = c("condition", "Tumor", "Normal"))

expr_df <- leviFromDESeq2(res, gene_col = "GeneSymbol")

levi(
    expressionInput         = expr_df,
    networkCoordinatesInput = template_network,
    fileTypeInput           = "dat",
    geneSymbolInput         = "GeneSymbol",
    readExpColumn           = readExpColumn("log2FoldChange-log2FoldChange"),
    signal_mode             = "logfc"
)

5.2 From edgeR

library(edgeR)
library(levi)

fit  <- glmQLFit(dge, design)
qlf  <- glmQLFTest(fit, coef = 2)

expr_df <- leviFromEdgeR(qlf, gene_col = "GeneSymbol")

levi(
    expressionInput         = expr_df,
    networkCoordinatesInput = template_network,
    fileTypeInput           = "dat",
    geneSymbolInput         = "GeneSymbol",
    readExpColumn           = readExpColumn("logFC-logFC"),
    signal_mode             = "logfc"
)

5.3 From limma

library(limma)
library(levi)

fit2    <- eBayes(fit)
expr_df <- leviFromLimma(fit2, coef = "TvsC", gene_col = "GeneSymbol")

levi(
    expressionInput         = expr_df,
    networkCoordinatesInput = template_network,
    fileTypeInput           = "dat",
    geneSymbolInput         = "GeneSymbol",
    readExpColumn           = readExpColumn("logFC-logFC"),
    signal_mode             = "logfc"
)

5.4 Checking the adapters without the tools

Each adapter also accepts a plain data.frame with the columns that the corresponding tool produces. The conversion can therefore be reproduced without the tools, and a pipeline can be tested before the full set of packages is installed:

# A DESeq2 results table has baseMean and log2FoldChange.
res_de <- data.frame(
    baseMean       = c(1200, 1100, 900),
    log2FoldChange = c(4.3, 4.1, -5.3),
    row.names      = c("HUB", "N1", "N5"))
leviFromDESeq2(res_de, gene_col = "GeneID")
##   GeneID baseMean log2FoldChange
## 1    HUB     1200            4.3
## 2     N1     1100            4.1
## 3     N5      900           -5.3
# An edgeR topTags table has logFC and logCPM.
tt_edger <- data.frame(
    logFC     = c(4.3, -5.1),
    logCPM    = c(10.2, 9.8),
    row.names = c("HUB", "N5"))
leviFromEdgeR(tt_edger, gene_col = "GeneID")
##   GeneID logCPM logFC
## 1    HUB   10.2   4.3
## 2     N5    9.8  -5.1
# A limma topTable has logFC and AveExpr.
tt_limma <- data.frame(
    logFC     = c(4.3, -5.1),
    AveExpr   = c(8.1, 7.7),
    row.names = c("HUB", "N5"))
leviFromLimma(tt_limma, gene_col = "GeneID")
##   GeneID AveExpr logFC
## 1    HUB     8.1   4.3
## 2     N5     7.7  -5.1
# A Seurat FindMarkers table has avg_log2FC and pct.2, which become
# Test and Control.
mk_seurat <- data.frame(
    avg_log2FC = c(2.5, -1.8),
    pct.2      = c(0.3, 0.8),
    row.names  = c("HUB", "N5"))
leviFromSeurat(mk_seurat, gene_col = "GeneID")
## Warning: leviFromSeurat(): FindMarkers() statistics are computed over cells;
## the result is suitable for visualisation and node-label tests, and donor-level
## inference must go through leviPseudobulk() and the single-cell inference
## functions.
##   GeneID Control Test
## 1    HUB     0.3  2.5
## 2     N5     0.8 -1.8

6 Quantitative Analysis of the Landscape

6.1 Node landscape scores

Every levi() call returns a ranked table of landscape scores invisibly. A score close to 1 indicates a high transformed signal in the neighbourhood of the gene in the layout; a score close to 0 indicates a low transformed signal.

The network weights the landscape by degree. With the default edge_weighting = "midpoint", each edge adds a support point at its midpoint, which carries the mean signal of its two endpoints. Every node and every midpoint has weight one. A hub with twenty interactions is therefore surrounded by twenty midpoints, whereas a leaf adds one. The smoothed surface around a hub is dominated by the hub and its neighbours, and a moderately changed hub can appear more prominent than a strongly changed peripheral gene. The permutation tests keep the network fixed, so the weighting is part of their null and does not bias the p-values. It affects the emphasis of the figure, and result$scores is to be read together with the degree of the node.

The argument edge_weighting selects the weighting of the midpoints:

  • "midpoint" (default): one support point of weight one per edge midpoint. The landscape is weighted implicitly by degree.
  • "degree": the midpoint of the edge between nodes i and j has the weight (1/di + 1/dj)/2, where d is the degree. Each node of degree at least one contributes a total weight of 1/2 to its incident midpoints. The weights of the midpoints incident on one node sum to one in degree-regular graphs and not in general. The node itself keeps the weight one.
  • "none": the midpoints are omitted and the node values alone are smoothed.

All three options use the same coordinates, silhouette and permutation nulls. The choice is stored in result$metadata$edge_weighting and is reused by the sample-label tests. The scores of the example network under the three options, for the eight highest scores of the default option, and the Spearman correlation of the scores between the options, are:

ew_scores <- sapply(c("midpoint", "degree", "none"), function(w) {
    r <- levi(networkCoordinatesInput = template_network,
              expressionInput         = template_expression,
              fileTypeInput           = "dat",
              geneSymbolInput         = "ID",
              readExpColumn           = readExpColumn("TumorCurrentSmoker-NormalNeverSmoker"),
              resolutionValueInput    = 20,
              smoothValueInput        = 5,
              edge_weighting          = w)
    s <- r$scores
    setNames(s$LandscapeScore, s$Gene)[sort(s$Gene)]
})
## There are 1 nodes without expression value, see log in path: /tmp/Rtmp8ai10J/TumorCurrentSmoker-NormalNeverSmoker/levi.log
## There are 1 nodes without expression value, see log in path: /tmp/Rtmp8ai10J/TumorCurrentSmoker-NormalNeverSmoker/levi.log
## There are 1 nodes without expression value, see log in path: /tmp/Rtmp8ai10J/TumorCurrentSmoker-NormalNeverSmoker/levi.log
round(head(ew_scores[order(-ew_scores[, "midpoint"]), ], 8), 3)
##       midpoint degree  none
## OGDHL    0.777  0.790 0.791
## IDH1     0.694  0.694 0.694
## IDH2     0.668  0.685 0.686
## DLAT     0.649  0.649 0.649
## FH       0.633  0.633 0.633
## PDHA2    0.632  0.632 0.632
## SDHC     0.622  0.622 0.622
## MDH1     0.597  0.596 0.596
round(cor(ew_scores, method = "spearman"), 2)
##          midpoint degree none
## midpoint     1.00   0.95 0.95
## degree       0.95   1.00 1.00
## none         0.95   1.00 1.00
result <- levi(
    networkCoordinatesInput = template_network,
    expressionInput         = template_expression,
    fileTypeInput           = "dat",
    geneSymbolInput         = "ID",
    readExpColumn           = readExpColumn("TumorCurrentSmoker-NormalNeverSmoker"),
    contrastValueInput      = 50,
    resolutionValueInput    = 20,
    zoomValueInput          = 50,
    smoothValueInput        = 5
)
## There are 1 nodes without expression value, see log in path: /tmp/Rtmp8ai10J/TumorCurrentSmoker-NormalNeverSmoker/levi.log

# Top 10 most altered genes in the network
head(result$scores, 10)
##     Gene         X         Y LandscapeScore Rank
## 1  OGDHL 0.3323616 0.1683213         0.7768    1
## 2   IDH1 0.2850717 0.1341222         0.6944    2
## 3   IDH2 0.2352682 0.1331376         0.6678    3
## 4   DLAT 0.1228036 0.3618685         0.6486    4
## 5     FH 0.3917084 0.2269471         0.6327    5
## 6  PDHA2 0.3384309 0.2020927         0.6325    6
## 7   SDHC 0.2797636 0.4590206         0.6221    7
## 8   MDH1 0.3203979 0.2105595         0.5974    8
## 9  PDHA1 0.2585272 0.1312074         0.5960    9
## 10  MDH2 0.2081017 0.2368249         0.5933   10

The scores table contains columns Gene, X, Y, LandscapeScore (0–1), and Rank. The scores are descriptive; the values 0.7 and 0.3 are not thresholds of a test. Significance is assessed with the permutation tests below.

6.2 Automatic peak detection

Peaks (local maxima) and valleys (local minima) are detected automatically and returned in result$peaks. Each row reports the nearest gene, the matrix position, and the landscape score.

# Detected peaks (up-regulated regions) and valleys (down-regulated)
result$peaks
##   Type NearestGene MatrixRow MatrixCol  Score
## 1 peak       OGDHL        48        16 0.7910
## 2 peak        MDH1        42        25 0.6726
## 3 peak          CS        23        30 0.6705
## 4 peak        SDHD        35        22 0.6650

6.3 Permutation significance test

The argument n_perm runs a permutation test of the regions of the landscape. The measured expression values are shuffled among the network nodes, the edge signals are recalculated and the landscape is rebuilt in every permutation. The layout is not changed.

By default (inference_unit = "region") the eight-connected regions beyond the neutral score are redetected in every permutation and each observed region is compared with the largest regional mass seen under the null (Westfall and Young 1993; Nichols and Holmes 2002), over both directions. result$regions$summary gains PSpatial and Significant, and significant regions are outlined in white on the plot. The legacy inference_unit = "cell" tests every grid cell and draws contours from BY-adjusted p-values; it is what the graphical interface uses. The vignette levi_inference explains which null answers which question.

result_sig <- levi(
    networkCoordinatesInput = template_network,
    expressionInput         = template_expression,
    fileTypeInput           = "dat",
    geneSymbolInput         = "ID",
    readExpColumn           = readExpColumn("TumorCurrentSmoker-NormalNeverSmoker"),
    n_perm    = 100,     # larger values improve the p-value resolution
    sig_level = 0.05,
    perm_side = "both"   # "over", "under", or "both" (default)
)
## There are 1 nodes without expression value, see log in path: /tmp/Rtmp8ai10J/TumorCurrentSmoker-NormalNeverSmoker/levi.log
## Permutation test: 100 iterations for 'TumorCurrentSmoker-NormalNeverSmoker'...

# One row per region, with its permutation p-value:
result_sig$regions$summary[, c("Region", "Direction", "Cells", "Mass",
                               "PSpatial", "Significant")]
##    Region Direction Cells         Mass  PSpatial Significant
## 1 over_01      over  1164 0.0059971731 0.3663366       FALSE
## 2 over_03      over   288 0.0005096155 0.9405941       FALSE
## 3 over_02      over   108 0.0001563844 0.9801980       FALSE

With inference_unit = "cell", result$pvalues holds the $over and $under adjusted p-value matrices instead, and the landscape overlays two contours:

Contour Line style Meaning
Dashed (white) perm_side = "over" Significantly over-expressed region (p_over < 0.05)
Dotted (white) perm_side = "under" Significantly under-expressed region (p_under < 0.05)

Use perm_side = "both" (default) to show both simultaneously.

Interpretation: a region or contour marks an area of the landscape whose mass exceeds the null distribution obtained by shuffling the values among the nodes of the fixed network and layout. The null conditions on the network topology and on the layout; it does not control for them. The result is a statement about the spatial organisation of the values on this network and layout. It is not evidence of replication, and it is not a test of individual genes.

6.4 Beyond the landscape test: replication and graph TFCE

The node-label p-value above is conditional on the network and on its layout. It tests whether the observed arrangement of the values is more clustered than arrangements of the same values on the same layout. It does not address replication, and the layout is part of the test: a different layout of the same graph defines a different test. Two consequences follow.

  • Networks in which most genes respond. The statistic is area-weighted. When most of a network responds (for example an a-priori pathway under a stimulus that affects most of its genes), shuffled arrangements produce regions of similar mass. In the analyses of the accompanying manuscript the node-label p-value was 0.21 to 0.89 on the Kang monocyte networks of this type, and it can fall below 0.05 under neighbouring parameter settings (on the macrophage Toll-like network it was below 0.05 in 10 of 27 settings of the threshold, the smoothing and logfc_k). The test addresses a spatial question and not the existence of an effect.
  • Dependence on the layout. Force-directed layouts are stochastic, and the regions detected on one layout overlap only partly with those detected on another (vignette("levi_validation")).

When biological replicates are available, the landscape can be reported together with two sample-label tests, which permute the condition labels across replicates instead of the values across nodes:

  • leviReplicateInference() keeps the landscape and its regions but recomputes the fold-change from permuted labels, so PSpatial now answers whether the region replicates.
  • leviGraphTFCEInference() needs no layout at all. It fits a limma moderated t per gene (Smyth 2004) and integrates it over every threshold with threshold-free cluster enhancement (Smith and Nichols 2009) on the network components, controlling the family-wise error rate with the maximum over genes and directions. It does not depend on the layout. Against a module concentrated around a hub, in the simulations reported in vignette("levi_validation"), its power was greater than or equal to that of the sample-label regional test at every effect size.

Validity condition. A sample-label test, or a graph test, is a replication test only when the network and its gene set are fixed independently of the labels that are permuted. When the genes were selected on the same samples (for example the top differentially expressed genes of the tested contrast) and held fixed during the permutations, the observed statistic has been maximised over the gene universe. In the simulation of the manuscript this procedure rejected under the global null in 85 to 87 % of the datasets with 4 vs 4 samples (exact enumeration) and in 99 to 100 % with 8 vs 8 samples (Monte Carlo, 199 draws), whereas re-selecting the genes inside each permutation or selecting them on separate samples gave 0.015 to 0.060. Results on a network built from genes selected on the tested samples are descriptive. The valid designs (a network fixed a priori, closed-loop selection and split-sample selection) are described in vignette("levi_inference").

With four replicates per group the example below is small enough to enumerate all choose(8, 4) = 70 label arrangements. The complement of an arrangement gives the same maximum over both directions and ties the observed value, so the smallest attainable p-value is 2/70 = 0.029.

hub_net <- system.file("extdata", "hub_network.dat", package = "levi")
genes   <- c("HUB", paste0("N", 1:8))

# Four control and four treated replicates on a log2 scale; the hub and its
# first two neighbours respond.
set.seed(2026)
expression <- matrix(rnorm(9 * 8, mean = 6, sd = 0.3), 9, 8,
                     dimnames = list(genes, paste0("s", 1:8)))
groups <- rep(c("control", "treated"), each = 4)
expression[c("HUB", "N1", "N2"), groups == "treated"] <-
    expression[c("HUB", "N1", "N2"), groups == "treated"] + 1.5

# Landscape regions tested against biological replication
rep_res <- leviReplicateInference(
    expression, groups, test = "treated", control = "control",
    networkCoordinatesInput = hub_net, fileTypeInput = "dat",
    resolutionValueInput = 20, smoothValueInput = 30, seed = 1)
rep_res$regions$summary[, c("Region", "Direction", "Mass", "PSpatial",
                            "Significant")]
##    Region Direction        Mass   PSpatial Significant
## 1 over_03      over 0.033651593 0.02857143        TRUE
## 2 over_05      over 0.003513050 0.48571429       FALSE
## 3 over_04      over 0.002689098 0.48571429       FALSE
## 4 over_02      over 0.002476661 0.48571429       FALSE
## 5 over_01      over 0.002083346 0.48571429       FALSE
# Layout-free confirmation: graph TFCE with the same null
tfce <- leviGraphTFCEInference(
    expression, groups, hub_net, test = "treated", control = "control",
    seed = 1)
tfce$statistic[order(tfce$statistic$PGlobal), ][1:4, ]
##     Gene        T        TFCE      POver PUnder    PGlobal GlobalSignificant
## HUB  HUB 8.219189 264.0536523 0.01428571      1 0.02857143              TRUE
## N1    N1 6.796803 180.1085001 0.01428571      1 0.02857143              TRUE
## N2    N2 6.741273 180.1085001 0.01428571      1 0.02857143              TRUE
## N4    N4 1.009317   0.7337502 0.58571429      1 0.80000000             FALSE

In this simulated example the hub and its two neighbours respond by construction, and the network is fixed independently of the labels. The node-label test alone does not address whether such a response replicates. For paired designs the argument blocks is used, and for single-cell data the leviSingleCell* functions, which permute donors and not cells. The vignette levi_inference describes the three nulls and the attainable p-values of small designs, and levi_validation reports their calibration and power.

7 Single-Cell RNA-seq (Seurat)

levi can display the marker genes of a single-cell analysis from Seurat (Hao et al. 2021) on a biological network. Marker tables describe cells; tests that treat donors, and not cells, as replicates are provided by the leviSingleCell* functions (vignette("levi_inference")).

library(Seurat)
library(levi)

# Find markers for a specific cell cluster:
markers <- FindMarkers(seurat_obj,
                       ident.1 = "TumorCluster",
                       ident.2 = "NormalCluster")

expr_df <- leviFromSeurat(markers, gene_col = "GeneSymbol")

levi(
    expressionInput         = expr_df,
    networkCoordinatesInput = template_network,
    fileTypeInput           = "dat",
    geneSymbolInput         = "GeneSymbol",
    readExpColumn           = readExpColumn("Test-Control"),
    expressionLog           = TRUE,
    plot3d                  = TRUE
)

8 Toy datasets for testing and validation

levi ships several small toy datasets in inst/extdata/ with known expected results. Each dataset is designed to test one feature independently.

8.1 Available datasets

Dataset pair Topology What it tests
hub_network + hub_expression Star (9 nodes) Score highest at hub; Gaussian smoothing propagation
gradient_network + gradient_expression Linear chain (6 nodes) Strict monotone ordering of scores
bimodal_network + bimodal_expression Two stars + bridge (13 nodes) Simultaneous peak + valley; leviDiff
flat_network + flat_expression 3×3 grid (9 nodes) No false-positive peaks; uniform expression
logfc_network + logfc_expression Linear chain, log2 intensities signal_mode = "logfc" contrast improvement
hub_multicomp_expression Reuses hub network Batch mode; leviGrid; leviDiff
sparse_network + sparse_expression Chain (15 nodes, 5 expressed) NA handling; missing gene neutrality

8.2 Bimodal dataset

Two hubs (over-expressed cluster A and under-expressed cluster B) connected by a neutral bridge gene. The expected landscape has a peak on the left and a valley on the right; the dataset is used to test leviDiff.

bimodal_net  <- file.path(system.file(package="levi"), "extdata",
                           "bimodal_network.dat")
bimodal_expr <- file.path(system.file(package="levi"), "extdata",
                           "bimodal_expression.dat")

res_bimodal <- levi(
    networkCoordinatesInput = bimodal_net,
    expressionInput         = bimodal_expr,
    fileTypeInput           = "dat",
    geneSymbolInput         = "ID",
    readExpColumn           = readExpColumn("Test-Control"),
    contrastValueInput      = 50,
    resolutionValueInput    = 20,
    zoomValueInput          = 50,
    smoothValueInput        = 5,
    contourLevi             = TRUE
)
## Warning: `stat_contour()`: Zero contours were generated
## Warning in min(x): no non-missing arguments to min; returning Inf
## Warning in max(x): no non-missing arguments to max; returning -Inf

8.3 signal_mode = “logfc” with log2 microarray intensities

The logfc_expression dataset simulates RMA-normalized microarray data (log2 intensities ranging 5–8), where signal_mode = "logfc" produces a wider score range than signal_mode = "ratio", because it uses the direction and the magnitude of the fold change.

logfc_net  <- file.path(system.file(package="levi"), "extdata",
                         "logfc_network.dat")
logfc_expr <- file.path(system.file(package="levi"), "extdata",
                         "logfc_expression.dat")

res_logfc <- levi(
    networkCoordinatesInput = logfc_net,
    expressionInput         = logfc_expr,
    fileTypeInput           = "dat",
    geneSymbolInput         = "ID",
    readExpColumn           = readExpColumn("Test-Control"),
    signal_mode             = "logfc",
    contrastValueInput      = 50,
    resolutionValueInput    = 20,
    zoomValueInput          = 50,
    smoothValueInput        = 5,
    contourLevi             = TRUE
)

cat("Score range with logfc mode:",
    round(diff(range(res_logfc$scores$LandscapeScore)), 3), "\n")
## Score range with logfc mode: 0.874

8.4 Multi-comparison (batch mode) and leviDiff

The hub_multicomp_expression dataset has three conditions for the hub network. Batch mode produces one landscape per comparison, and leviDiff() subtracts two landscapes cell by cell to show regional changes between conditions.

hub_net <- file.path(system.file(package="levi"), "extdata", "hub_network.dat")
mc_expr <- file.path(system.file(package="levi"), "extdata",
                     "hub_multicomp_expression.dat")

# Batch mode: two comparisons in one call
res_multi <- levi(
    networkCoordinatesInput = hub_net,
    expressionInput         = mc_expr,
    fileTypeInput           = "dat",
    geneSymbolInput         = "ID",
    readExpColumn           = readExpColumn("Cond_A-Cond_B", "Cond_A-Cond_C"),
    resolutionValueInput    = 20,
    smoothValueInput        = 5
)

# Side-by-side
leviGrid(res_multi)

# Regional difference between conditions B and C
leviDiff(res_multi[[1]], res_multi[[2]],
         label_a = "Cond_A vs Cond_B",
         label_b = "Cond_A vs Cond_C")

9 Real datasets from Bioconductor

The examples below use publicly available datasets to illustrate levi with different experiment types.

9.1 RNA-seq: airway (DESeq2 + STRING)

The airway dataset (Himes et al. 2014) contains RNA-seq counts from airway smooth muscle cells treated with dexamethasone (DEX) vs untreated controls across 4 cell lines. DESeq2 identifies differentially expressed genes; leviFromSTRING() builds the interaction network automatically.

BiocManager::install(c("airway", "DESeq2", "STRINGdb"))
library(airway); library(DESeq2); library(levi)

data(airway)
dds <- DESeqDataSet(airway, design = ~cell + dex)
dds <- DESeq(dds)
res <- results(dds, contrast = c("dex", "trt", "untrt"))

# Convert to levi input
expr_df <- leviFromDESeq2(res)

# Top 80 DE genes — build STRING network
top80 <- head(expr_df$GeneID[order(abs(expr_df$log2FoldChange),
                                    decreasing = TRUE)], 80)
set.seed(42)
net <- leviFromSTRING(top80, species = 9606, score_threshold = 400)

# Landscape of the log2 fold changes of dexamethasone treatment on the network.
# The 80 genes are selected on the tested samples: the node-label p-value
# describes spatial organisation, and sample-label or graph tests on this
# network would be descriptive (see "Validity condition" above).
levi(
    expressionInput          = expr_df,
    networkCoordinatesInput  = net$nodes,
    networkInteractionsInput = net$edges,
    fileTypeInput            = "stg",
    geneSymbolInput          = "GeneID",
    readExpColumn            = readExpColumn("log2FoldChange-log2FoldChange"),
    signal_mode              = "logfc",
    n_perm                   = 500,
    perm_side                = "both"
)

9.2 Microarray: ALL (limma + STRING)

The ALL dataset (Chiaretti et al. 2004) contains Affymetrix HG-U95Av2 microarray data from 128 Acute Lymphoblastic Leukemia patients. RMA-normalised values are on the log2 scale, which corresponds to signal_mode = "logfc".

BiocManager::install(c("ALL", "hgu95av2.db", "limma", "STRINGdb"))
library(ALL); library(limma); library(levi)

data(ALL)

# B-cell versus T-cell lineage: ALL$BT holds the subtypes B, B1-B4, T, T1-T4
lineage  <- factor(substr(as.character(ALL$BT), 1, 1))
design   <- model.matrix(~0 + lineage)
colnames(design) <- levels(lineage)
contrast <- makeContrasts(BvsT = B - T, levels = design)
fit2 <- eBayes(contrasts.fit(lmFit(ALL, design), contrast))

# Probe sets -> gene symbols; keep the most significant probe set per gene
# and the 200 most significant genes for the STRING query
tt <- topTable(fit2, coef = "BvsT", number = Inf)
tt$Symbol <- AnnotationDbi::mapIds(hgu95av2.db::hgu95av2.db, rownames(tt),
                                   keytype = "PROBEID", column = "SYMBOL")
tt <- tt[!is.na(tt$Symbol) & !duplicated(tt$Symbol), ][seq_len(200), ]
rownames(tt) <- tt$Symbol
expr_df <- leviFromLimma(tt)

set.seed(7)
net <- leviFromSTRING(expr_df$GeneID, species = 9606,
                      score_threshold = 700,   # high confidence
                      layout = "kk")           # Kamada-Kawai for <100 nodes

levi(
    expressionInput          = expr_df,
    networkCoordinatesInput  = net$nodes,
    networkInteractionsInput = net$edges,
    fileTypeInput            = "stg",
    geneSymbolInput          = "GeneID",
    readExpColumn            = readExpColumn("logFC-logFC"),
    signal_mode              = "logfc",
    logfc_k                  = 2        # tighter FC range in microarray
)

9.3 scRNA-seq: PBMC 10x (Seurat + STRING)

Single-cell RNA-seq data from 3k PBMCs of a healthy donor (10x Genomics 2016). FindMarkers() computes avg_log2FC values per gene for a given cell type contrast, which are fed directly into levi using single-column logFC mode.

BiocManager::install(c("TENxPBMCData", "STRINGdb"))
install.packages("Seurat")
library(TENxPBMCData); library(Seurat); library(levi)

pbmc_sce <- TENxPBMCData("pbmc3k")
pbmc <- as.Seurat(pbmc_sce)

# Standard Seurat pipeline
pbmc <- NormalizeData(pbmc)
pbmc <- FindVariableFeatures(pbmc)
pbmc <- ScaleData(pbmc)
pbmc <- RunPCA(pbmc)
pbmc <- FindNeighbors(pbmc)
pbmc <- FindClusters(pbmc, resolution = 0.5)

# Markers between two clusters (e.g., T cells vs B cells after annotation)
markers <- FindMarkers(pbmc,
    ident.1 = "CD4 T cells",
    ident.2 = "B cells",
    min.pct = 0.25)

expr_df <- leviFromSeurat(markers, gene_col = "row.names")

set.seed(21)
net <- leviFromSTRING(
    rownames(markers), species = 9606,
    score_threshold = 400,
    layout = "fr"
)

levi(
    expressionInput          = expr_df,
    networkCoordinatesInput  = net$nodes,
    networkInteractionsInput = net$edges,
    fileTypeInput            = "stg",
    geneSymbolInput          = "GeneID",
    readExpColumn            = readExpColumn("avg_log2FC-avg_log2FC"),
    signal_mode              = "logfc",
    logfc_k                  = 0.5      # softer gradient for large FC values
)

10 Building networks from STRING

levi can retrieve a protein interaction network directly from the STRING database (Szklarczyk et al. 2021) using the leviFromSTRING() function, which wraps the STRINGdb Bioconductor package. This eliminates the need to manually download and format network files.

BiocManager::install("STRINGdb")
library(levi)

# Human MAPK pathway genes
mapk_genes <- c("EGFR", "KRAS", "BRAF", "MAP2K1", "MAPK1", "MAPK3",
                "RPS6KA1", "MYC", "JUN", "FOS")

set.seed(42)  # layout is stochastic; set seed for reproducibility
net <- leviFromSTRING(
    genes           = mapk_genes,
    species         = 9606,         # 9606 = human
    score_threshold = 400,          # medium confidence
    layout          = "fr"          # Fruchterman-Reingold layout
)
# net$nodes : data.frame — gene symbol, x, y
# net$edges : data.frame — V1, V2 (interacting pairs)
# net$graph : igraph object (for custom layouts / diagnostics)

# Landscape of the expression data on the network
levi(
    expressionInput          = my_de_results,
    networkCoordinatesInput  = net$nodes,
    networkInteractionsInput = net$edges,
    fileTypeInput            = "stg",
    geneSymbolInput          = "GeneID",
    readExpColumn            = readExpColumn("Tumor-Normal"),
    signal_mode              = "logfc",
    n_perm                   = 500
)

10.1 Saving and reusing a downloaded network

leviFromSTRING() returns a plain R list, so the network can be saved to disk and reloaded in later sessions, which avoids repeated downloads.

# --- Download once ---
set.seed(42)
net <- leviFromSTRING(mapk_genes, species = 9606, score_threshold = 400)

# Option 1: save as TSV files — readable by levi() directly via file path
write.table(net$nodes, "string_nodes.tsv",
            sep = "\t", row.names = FALSE, quote = FALSE)
write.table(net$edges, "string_edges.tsv",
            sep = "\t", row.names = FALSE, quote = FALSE)

# Option 2: save the full R object (preserves igraph + coordinates)
saveRDS(net, "string_network.rds")

# --- Reload in a later session ---

# From TSV files (fileTypeInput = "stg" accepts file paths or data.frames)
levi(
    networkCoordinatesInput  = "string_nodes.tsv",
    networkInteractionsInput = "string_edges.tsv",
    fileTypeInput            = "stg",
    ...
)

# From the RDS object
net <- readRDS("string_network.rds")
levi(
    networkCoordinatesInput  = net$nodes,
    networkInteractionsInput = net$edges,
    fileTypeInput            = "stg",
    ...
)

Persistent STRINGdb cache. A fixed input_directory passed to leviFromSTRING() stores the raw STRING files locally, and they are reused across sessions without a new download:

net <- leviFromSTRING(
    genes           = my_genes,
    species         = 9606,
    input_directory = "~/.stringdb_cache"   # persists between R sessions
)

10.2 Layout guide

layout Algorithm Best for
"fr" Fruchterman-Reingold (Fruchterman and Reingold 1991) General use, 50–500 nodes
"kk" Kamada-Kawai (Kamada and Kawai 1989) Small networks (≤ 100 nodes)
"lgl" Large Graph Layout Large networks (> 500 nodes)
"dh" Davidson-Harel Slower than "fr" and "kk"
"circle" Ring Pathway-like linear chains

10.3 Species codes

Organism species
Human (H. sapiens) 9606
Mouse (M. musculus) 10090
Rat (R. norvegicus) 10116
Zebrafish (D. rerio) 7955
Fly (D. melanogaster) 7227
Worm (C. elegans) 6239
Yeast (S. cerevisiae) 4932

10.4 Full pipeline example (RNA-seq + STRING)

library(airway)
library(DESeq2)
library(levi)

# 1. Differential expression
data(airway)
dds <- DESeqDataSet(airway, design = ~cell + dex)
dds <- DESeq(dds)
res <- results(dds, contrast = c("dex", "trt", "untrt"))

# 2. Build expression data.frame
expr_df <- leviFromDESeq2(res)

# 3. Retrieve STRING network for top DE genes
top_genes <- head(expr_df$GeneID[order(abs(expr_df$log2FoldChange),
                                        decreasing = TRUE)], 100)
set.seed(42)
net <- leviFromSTRING(top_genes, species = 9606, score_threshold = 400)

# 4. Landscape. The genes are selected on the tested samples (see "Validity
#    condition"); the node-label p-value is a statement about spatial
#    organisation and not about replication.
levi(
    expressionInput          = expr_df,
    networkCoordinatesInput  = net$nodes,
    networkInteractionsInput = net$edges,
    fileTypeInput            = "stg",
    geneSymbolInput          = "GeneID",
    readExpColumn            = readExpColumn("log2FoldChange-log2FoldChange"),
    signal_mode              = "logfc",
    n_perm                   = 500,
    perm_side                = "both"
)

11 Signal contracts and reproducibility

The conventions for the interpretation of the signal, the handling of missing measurements, the scope of the permutation inference and the recording of the random-number state are stated in the section Signal contracts and reproducibility of vignette("levi_guide"). The calibration of the tests by simulation is reported in vignette("levi_validation").

12 Session Information

## R version 4.6.1 (2026-06-24)
## Platform: x86_64-pc-linux-gnu
## Running under: Ubuntu 24.04.5 LTS
## 
## Matrix products: default
## BLAS:   /home/biocbuild/bbs-3.24-bioc/R/lib/libRblas.so 
## LAPACK: /usr/lib/x86_64-linux-gnu/lapack/liblapack.so.3.12.0  LAPACK version 3.12.0
## 
## locale:
##  [1] LC_CTYPE=en_US.UTF-8       LC_NUMERIC=C              
##  [3] LC_TIME=en_GB              LC_COLLATE=C              
##  [5] LC_MONETARY=en_US.UTF-8    LC_MESSAGES=en_US.UTF-8   
##  [7] LC_PAPER=en_US.UTF-8       LC_NAME=C                 
##  [9] LC_ADDRESS=C               LC_TELEPHONE=C            
## [11] LC_MEASUREMENT=en_US.UTF-8 LC_IDENTIFICATION=C       
## 
## time zone: America/New_York
## tzcode source: system (glibc)
## 
## attached base packages:
## [1] stats     graphics  grDevices utils     datasets  methods   base     
## 
## other attached packages:
## [1] levi_1.99.6      BiocStyle_2.41.0
## 
## loaded via a namespace (and not attached):
##  [1] SummarizedExperiment_1.43.0 gtable_0.3.6               
##  [3] xfun_0.62                   bslib_0.12.0               
##  [5] ggplot2_4.0.4               Biobase_2.73.2             
##  [7] lattice_0.23-1              vctrs_0.7.3                
##  [9] tools_4.6.1                 generics_0.1.4             
## [11] stats4_4.6.1                parallel_4.6.1             
## [13] tibble_3.3.1                pkgconfig_2.0.3            
## [15] Matrix_1.7-6                RColorBrewer_1.1-3         
## [17] S7_1.0.0                    S4Vectors_0.51.10          
## [19] lifecycle_1.0.5             compiler_4.6.1             
## [21] farver_2.1.2                stringr_1.6.0              
## [23] statmod_1.5.2               tinytex_0.61               
## [25] Seqinfo_1.3.2               codetools_0.2-20           
## [27] htmltools_0.5.9             sass_0.4.10                
## [29] yaml_2.3.12                 pillar_1.11.1              
## [31] jquerylib_0.1.4             BiocParallel_1.47.0        
## [33] limma_3.99.5                DelayedArray_0.39.8        
## [35] cachem_1.1.0                magick_2.9.1               
## [37] abind_1.4-8                 tidyselect_1.2.1           
## [39] digest_0.6.39               stringi_1.8.9              
## [41] dplyr_1.2.1                 reshape2_1.4.5             
## [43] bookdown_0.48               labeling_0.4.3             
## [45] fastmap_1.2.0               grid_4.6.1                 
## [47] cli_3.6.6                   SparseArray_1.13.5         
## [49] magrittr_2.0.5              patchwork_1.3.2            
## [51] S4Arrays_1.13.3             dichromat_2.0-1            
## [53] withr_3.0.3                 scales_1.4.0               
## [55] rmarkdown_2.32              XVector_0.53.0             
## [57] matrixStats_1.5.0           igraph_2.3.4               
## [59] otel_0.3.0                  evaluate_1.0.5             
## [61] knitr_1.52                  GenomicRanges_1.65.4       
## [63] IRanges_2.47.5              rlang_1.3.0                
## [65] isoband_0.3.0               Rcpp_1.1.2                 
## [67] glue_1.8.1                  BiocManager_1.30.27        
## [69] xml2_1.6.0                  BiocGenerics_0.59.13       
## [71] jsonlite_2.0.0              R6_2.6.1                   
## [73] plyr_1.8.9                  MatrixGenerics_1.25.0

References

10x Genomics. 2016. “3k PBMCs from a Healthy Donor: Single Cell Gene Expression Dataset by Cell Ranger 1.1.0.” https://www.10xgenomics.com/datasets.
Batagelj, Vladimir, and Andrej Mrvar. 1998. “Pajek – Program for Large Network Analysis.” Connections 21 (2): 47–57.
Camilo, Esther, Luiz A Bovolenta, Marcio L Acencio, Jose L Rybarczyk-Filho, Mauro AA Castro, Jose CF Moreira, and Ney Lemke. 2013. “GALANT: A Cytoscape Plugin for Visualizing Data as Functional Landscapes Projected onto Biological Networks.” Bioinformatics 29 (19): 2505–6.
Castro, Mauro A A, Xin Wang, Michael N C Fletcher, Kerstin B Meyer, and Florian Markowetz. 2012. “RedeR: R/Bioconductor Package for Representing Modular Structures, Nested Networks and Multiple Levels of Hierarchical Associations.” Genome Biology 13 (4): R29. https://doi.org/10.1186/gb-2012-13-4-r29.
Castro, Mauro AA, José L Rybarczyk Filho, Rodrigo JS Dalmolin, Marialva Sinigaglia, José CF Moreira, José CM Mombach, and Rita MC de Almeida. 2009. “ViaComplex: Software for Landscape Analysis of Gene Expression Networks in Genomic Context.” Bioinformatics 25 (11): 1468–69.
Chiaretti, Sabina, Xiaochun Li, Robert Gentleman, Antonella Vitale, Marco Vignetti, Franco Mandelli, Jerome Ritz, and Robin Foa. 2004. “Gene Expression Profile of Adult T-cell Acute Lymphocytic Leukemia Identifies Distinct Subsets of Patients with Different Response to Therapy and Survival.” Blood 103 (7): 2771–78. https://doi.org/10.1182/blood-2003-09-3243.
Csárdi, Gábor, and Tamás Nepusz. 2006. “The Igraph Software Package for Complex Network Research.” InterJournal Complex Systems: 1695.
Fruchterman, Thomas M J, and Edward M Reingold. 1991. “Graph Drawing by Force-Directed Placement.” Software: Practice and Experience 21 (11): 1129–64. https://doi.org/10.1002/spe.4380211102.
Hao, Yuhan, Stephanie Hao, Erica Andersen-Nissen, William M Mauck, Shiwei Zheng, Andrew Butler, Maddie J Lee, et al. 2021. “Integrated Analysis of Multimodal Single-Cell Data.” Cell 184 (13): 3573–87. https://doi.org/10.1016/j.cell.2021.04.048.
Himes, Blanca E, Xiaofeng Jiang, Peter Wagner, Ruoxi Hu, Qiyu Wang, Barbara Klanderman, Reid M Whitaker, et al. 2014. “RNA-Seq Transcriptome Profiling Identifies CRISPLD2 as a Glucocorticoid Responsive Gene That Modulates Cytokine Function in Airway Smooth Muscle Cells.” PLoS ONE 9 (6): e99625. https://doi.org/10.1371/journal.pone.0099625.
Hooper, Sean D, and Peer Bork. 2005. “Medusa: A Simple Tool for Interaction Graph Analysis.” Bioinformatics 21 (24): 4432–33. https://doi.org/10.1093/bioinformatics/bti696.
Kamada, Tomihisa, and Satoru Kawai. 1989. “An Algorithm for Drawing General Undirected Graphs.” Information Processing Letters 31 (1): 7–15. https://doi.org/10.1016/0020-0190(89)90102-6.
Landi, Maria Teresa, Tatiana Dracheva, Melissa Rotunno, Jonine D Figueroa, Huaitian Liu, Abhijit Dasgupta, Felecia E Mann, et al. 2008. “Gene Expression Signature of Cigarette Smoking and Its Role in Lung Adenocarcinoma Development and Survival.” PLoS ONE 3 (2): e1651. https://doi.org/10.1371/journal.pone.0001651.
Love, Michael I, Wolfgang Huber, and Simon Anders. 2014. “Moderated Estimation of Fold Change and Dispersion for RNA-seq Data with DESeq2.” Genome Biology 15 (12): 550. https://doi.org/10.1186/s13059-014-0550-8.
Nichols, Thomas E, and Andrew P Holmes. 2002. “Nonparametric Permutation Tests for Functional Neuroimaging: A Primer with Examples.” Human Brain Mapping 15 (1): 1–25. https://doi.org/10.1002/hbm.1058.
Ritchie, Matthew E, Belinda Phipson, Di Wu, Yifang Hu, Charity W Law, Wei Shi, and Gordon K Smyth. 2015. “Limma Powers Differential Expression Analyses for RNA-sequencing and Microarray Studies.” Nucleic Acids Research 43 (7): e47. https://doi.org/10.1093/nar/gkv007.
Robinson, Mark D, Davis J McCarthy, and Gordon K Smyth. 2010. “edgeR: A Bioconductor Package for Differential Expression Analysis of Digital Gene Expression Data.” Bioinformatics 26 (1): 139–40. https://doi.org/10.1093/bioinformatics/btp616.
Smith, Stephen M, and Thomas E Nichols. 2009. “Threshold-Free Cluster Enhancement: Addressing Problems of Smoothing, Threshold Dependence and Localisation in Cluster Inference.” NeuroImage 44 (1): 83–98. https://doi.org/10.1016/j.neuroimage.2008.03.061.
Smyth, Gordon K. 2004. “Linear Models and Empirical Bayes Methods for Assessing Differential Expression in Microarray Experiments.” Statistical Applications in Genetics and Molecular Biology 3 (1): Article 3. https://doi.org/10.2202/1544-6115.1027.
Szklarczyk, Damian, Annika L Gable, Katerina C Nastou, David Lyon, Rebecca Kirsch, Sampo Pyysalo, Nadezhda T Doncheva, et al. 2021. “The STRING Database in 2021: Customizable Protein-Protein Networks, and Functional Characterization of User-Uploaded Gene/Measurement Sets.” Nucleic Acids Research 49 (D1): D605–12. https://doi.org/10.1093/nar/gkaa1074.
Westfall, Peter H, and S Stanley Young. 1993. Resampling-Based Multiple Testing: Examples and Methods for p-Value Adjustment. New York: Wiley.