Data Science – Medicine Application Project 3, Part 3

Reference RNA Stability: The Assumption Behind Every ΔCq Result

A reference RNA is often treated as background machinery. Measure the target, subtract the reference, and move on.

But the reference is inside every normalized value:

**ΔCq = target Cq − reference Cq**

If the reference changes between study groups, the normalized target changes with it. A perfectly measured target can therefore appear different simply because the denominator was not stable.

In [Part 2](/qpcr-technical-replicates-agreement-quality-control/), we evaluated duplicate measurements and defined which sample–assay pairs passed technical quality control. This post uses only those passing pairs. The next question is whether either reference RNA is suitable for the comparison we plan to make.

## What “stable” should mean here

Stability is not an abstract property of a molecule. It depends on the samples, experimental conditions, processing workflow, and comparison of interest.

For this synthetic study, a useful reference should satisfy two practical conditions:

1. It should not show a meaningful systematic difference between the reference and inflammatory groups.

2. Its behavior across laboratory batches should be understood and should not be confounded with study group.

A low overall standard deviation is not enough. A reference can vary little overall while still shifting consistently between groups. Conversely, some batch-related movement may be visible even when the study-group comparison remains unbiased—especially when batches are balanced by design.

## Inspect group and batch together

The figure below shows each reference RNA within every batch and study group. Lower Cq indicates greater measured abundance.

Box plots comparing two reference RNA Cq measurements across three laboratory batches and two synthetic study groups
*Figure 1. Distribution of reference RNA Cq values by laboratory batch and study group. Only technical-replicate pairs passing the predefined QC rule are included. Boxes show the interquartile range and central line shows the median.*

Two patterns are visible.

First, both references move upward across the three batches. That behavior was intentionally built into the simulation as a common technical batch effect.

Second, ref-RNA-1 tends to have a higher Cq in the inflammatory group within the batches. The same group pattern is not apparent for ref-RNA-2.

Because every batch contains equal numbers from both groups, the batch effect is not confused with the group effect. This balanced design lets us estimate the group difference while accounting for batch.

## Quantify the difference instead of judging the boxes alone

The summary table reports the group means and a batch-adjusted difference. The adjusted value is calculated from a linear model containing study group and batch indicators.

Table reporting reference RNA group means, batch-adjusted Cq differences, confidence intervals, p values, and batch-mean spread.
*Table 3. Reference RNA stability by study group and batch. Group differences represent inflammatory minus reference mean Cq after adjustment for batch. Positive values indicate higher Cq in the inflammatory group.*

For **ref-RNA-1**:

– reference group: **23.55 ± 0.56 Cq**;

– inflammatory group: **23.93 ± 0.51 Cq**;

– adjusted group difference: **+0.38 cycles**;

– 95% confidence interval: **+0.19 to +0.56 cycles**;

– p < 0.001.

For **ref-RNA-2**:

– reference group: **24.24 ± 0.53 Cq**;

– inflammatory group: **24.13 ± 0.43 Cq**;

– adjusted group difference: **−0.11 cycles**;

– 95% confidence interval: **−0.29 to +0.07 cycles**;

– p = 0.239.

The evidence against ref-RNA-1 is not merely that its p value is small. The estimated difference is consistent in direction, and its confidence interval does not include zero. The reference contains a group signal that could be transferred into every normalized target.

## How an unstable reference creates an apparent target effect

Suppose a candidate miRNA has exactly the same mean target Cq in both study groups.

If ref-RNA-1 is approximately 0.38 cycles higher in the inflammatory group, the calculation becomes:

**same target Cq − higher reference Cq = lower ΔCq**

Lower ΔCq is usually interpreted as greater relative target expression. The analysis could therefore suggest increased expression even though the simulated target itself did not change.

In this setting, using ref-RNA-1 alone would shift an inflammatory-minus-reference ΔCq comparison downward by roughly 0.38 cycles. The exact effect in a real dataset would depend on assay efficiency and the observed joint behavior of target and reference, but the direction of the bias follows directly from the subtraction.

## A non-significant p value does not prove stability

Ref-RNA-2 has p = 0.239, but “not statistically significant” is not the same as “demonstrated equivalent.”

Its confidence interval still allows group differences from approximately −0.29 to +0.07 cycles. Whether that range is acceptably small is a scientific and analytical decision, not something a conventional p-value threshold can decide.

A formal equivalence analysis would require an acceptable stability margin chosen in advance. We have not invented such a universal margin for this tutorial. Instead, we retain the effect estimate and confidence interval so the uncertainty remains visible.

This is a more honest conclusion:

> Ref-RNA-2 shows no clear group-related shift in this dataset and is more defensible than ref-RNA-1, although small differences remain possible.

## What should we do with the batch effect?

The highest and lowest batch means differ by:

– **0.72 cycles for ref-RNA-1**;

– **0.52 cycles for ref-RNA-2**.

That does not automatically mean both references are unusable. The simulation applies a shared technical shift to target and reference assays. One purpose of normalization is to remove technical variation that affects them together.

Still, three checks are necessary:

– confirm that study groups are balanced within batch;

– inspect whether targets show a similar batch pattern;

– retain batch in a sensitivity model rather than assuming normalization removed it completely.

Had all reference samples been processed in one batch and all inflammatory samples in another, the group and batch effects would have been inseparable. No statistical adjustment could fully repair that design problem.

## Why not rank references using the coefficient of variation?

The coefficient of variation divides the standard deviation by the mean. That ratio is useful for measurements with a meaningful zero, but Cq values are on a logarithmic cycle scale whose numerical zero is not a biological absence.

For that reason, a small Cq coefficient of variation can be misleading. Here we focus on quantities that map more directly to the intended analysis:

– group-related Cq difference;

– confidence interval for that difference;

– within-batch visual consistency;

– batch-mean spread;

– technical replicate quality.

More formal tools such as geNorm, NormFinder, or BestKeeper can be useful when many candidate references are being screened. With only two deliberately constructed candidates, a transparent group-and-batch assessment is easier to understand and audit.

## Is using two references automatically safer?

No. Combining two references reduces reliance on either one, but adding an unstable reference does not make its group signal disappear.

The influential [geNorm paper](https://pubmed.ncbi.nlm.nih.gov/12184808/) demonstrated the value of normalization based on multiple carefully evaluated internal controls. The important phrase is **carefully evaluated**. Multiple unsuitable references do not become suitable simply because they are averaged.

In Cq space, taking the mean of two reference Cq values corresponds to using their geometric mean on the original quantity scale when amplification efficiencies are treated as comparable. In the next post, we will compare three strategies:

1. ref-RNA-1 alone;

2. ref-RNA-2 alone;

3. the mean of both references.

That comparison will show how much of the apparent target effect comes from the target and how much comes from the normalization choice.

## The decision at this stage

For this synthetic experiment:

– **ref-RNA-1 should not be used as the sole normalizer** for the group comparison;

– **ref-RNA-2 is the more defensible single reference**;

– a dual-reference result may be shown as a sensitivity analysis, but it should not be assumed superior before comparison;

– batch should remain visible in the analysis plan.

The [MIQE 2.0 guidelines](https://academic.oup.com/clinchem/article/71/6/634/8119148) emphasize justification of reference selection and transparent reporting of normalization. The point is not to find a familiar reference name. It is to demonstrate that the selected reference behaves appropriately in the actual experimental setting.

## The practical takeaway

Never let the reference disappear into the formula.

Plot it by the groups you intend to compare. Examine technical and batch structure. Report the estimated difference with an interval. Then show whether the biological conclusion changes when the reference strategy changes.

Normalization is not clerical preprocessing. It is part of the statistical model.

**Next:** *One Dataset, Three Normalizations: How the Estimated miRNA Effect Changes*

Leave a Reply

Create a website or blog at WordPress.com

Up ↑

Discover more from Writing my way through ideas.

Subscribe now to keep reading and get access to the full archive.

Continue reading