Data Science – Medicine Application Project 3, Part 6

From Raw Measurements to Final Result: A Reproducible qPCR Checklist

From Raw Measurements to Final Result: A Reproducible qPCR Checklist

A final result should be traceable backward.

Starting from an effect estimate in a table, we should be able to identify the normalized values behind it, the reference measurements behind those values, the replicate decisions behind each sample mean, and the raw measurements that entered the process.

If that path disappears, rerunning the code is not enough. We might reproduce the same number without being able to explain why it is the right number.

This final post connects the full analysis—from 960 synthetic qPCR measurements to the reported candidate miRNA results—and converts the workflow into a reusable audit checklist.

## The complete decision trail

The series followed eight ordered steps.

Eight-step workflow from balanced qPCR study design and raw replicates to quality control, reference selection, sensitivity analysis, and final audit
*Figure 1. Decision trail from study design and replicate-level qPCR measurements to final reporting and audit. Each step produces evidence retained in the project files.*

The order is deliberate.

1. **Lock the design.** Balance the study groups across laboratory batches.

2. **Retain raw replicates.** Keep technical measurements separate from biological samples.

3. **Apply QC rules.** Identify non-detects and replicate disagreement before normalization.

4. **Test reference stability.** Examine study-group and batch behavior.

5. **Select the primary normalizer.** Base the choice on stability rather than the most attractive result.

6. **Estimate the group effect.** Report ΔCq differences with uncertainty.

7. **Run sensitivity analyses.** Challenge both normalization and QC choices.

8. **Export and audit.** Save the data, code, tables, figures, and verification results together.

Moving directly from raw Cq values to a group p value would skip most of the questions that determine whether the p value is interpretable.

## What the final analysis actually found

The primary analysis uses:

– the strict technical-replicate QC rule;

– ref-RNA-2 as the normalizer;

– Welch’s t test on ΔCq;

– a bootstrap confidence interval for the mean group difference.

Under that specification:

– **candidate-miR-A:** −0.40 ΔCq (95% bootstrap CI −0.69 to −0.11), p = 0.010;

– **candidate-miR-B:** +0.13 ΔCq (−0.18 to +0.44), p = 0.412;

– **candidate-miR-C:** −0.08 ΔCq (−0.41 to +0.23), p = 0.630.

Candidate-miR-A retains a negative group difference across the QC sensitivity scenarios. Candidate-miR-B and candidate-miR-C remain compatible with little or no group difference under the primary normalization.

That concise result is supported by several earlier findings:

– 12 of 480 sample–assay pairs were discordant;

– 9 pairs had only one detected replicate;

– ref-RNA-1 showed a +0.38-cycle adjusted group shift;

– ref-RNA-2 showed an adjusted difference of −0.11 cycles with an interval spanning zero;

– using ref-RNA-1 created a nominal candidate-miR-B result even though its simulated target shift was zero;

– changing the replicate rule did not materially change the candidate-miR-A estimate.

The primary conclusion is therefore not based on one isolated test. It is the endpoint of a documented measurement and analysis process.

## Turn the checklist into an evidence table

A checklist is most useful when “pass” is linked to something that can be inspected.

Reproducibility audit table linking qPCR design, QC, reference selection, normalization, inference, robustness, and provenance to saved evidence
*Table 6. Final reproducibility and reporting audit. Each domain is linked to evidence generated and retained by the analysis notebook.*

For example, “reference stability evaluated” is not a box checked from memory. It is supported by:

– the group-and-batch distribution figure;

– the adjusted group-difference table;

– the saved reference-stability CSV;

– the code used to generate all three.

The same logic applies to QC, normalization, inference, and sensitivity analysis.

## Design checks

The manifest contains 96 biological samples divided evenly between the two synthetic groups. Every batch contains 16 samples from each group.

This protects the comparison from complete group–batch confounding. Statistical adjustment remains possible because both groups are represented in every batch.

The raw qPCR file contains 960 rows, but the study still has 96 independent biological samples. Keeping those units separate prevents technical replicates from artificially inflating the sample size.

## Measurement checks

The replicate-level file is preserved before averaging. For every sample–assay pair, the analysis records:

– replicate 1 and replicate 2 Cq;

– number of detected replicates;

– absolute replicate difference;

– discordance flag;

– single-detected flag;

– QC status;

– eligible analysis mean.

This makes every excluded mean explainable. It also makes the permissive sensitivity scenarios possible without reconstructing deleted data.

## Normalization checks

The analysis does not label a familiar RNA as stable by assumption.

Both references are displayed across study group and batch. Their adjusted group differences and uncertainty intervals are reported. The primary choice is then recorded explicitly:

– ref-RNA-2 for the primary analysis;

– the dual-reference calculation as a sensitivity analysis;

– ref-RNA-1 as a demonstration of normalization sensitivity, not as an alternative discovery route.

The dual-reference calculation also requires both reference measurements. It cannot silently become a single-reference value when one component is missing.

## Inference checks

Every reported comparison includes more than a p value.

The output records:

– direction and magnitude of the mean ΔCq difference;

– 95% bootstrap confidence interval;

– p value from the stated test;

– analysis sample size in each group;

– fold-equivalent presentation where useful;

– normalization strategy and QC rule.

This makes differences between analyses interpretable. If the sample size changes, the reader can see it. If the estimate moves while the sample size remains similar, attention shifts to the normalization choice rather than being hidden behind significance labels.

## Robustness checks

Two distinct sensitivity questions were evaluated.

### Does the normalizer drive the result?

Yes, for some candidates. Ref-RNA-1 shifted all three estimates in the same direction and created apparently clear candidate-miR-B and candidate-miR-C results that were not supported by the more stable reference.

### Does the replicate exclusion rule drive the result?

Not materially. Candidate-miR-A remained around −0.40 to −0.42 ΔCq across the three QC scenarios. Candidate-miR-B and candidate-miR-C remained uncertain.

These are different questions and should not be mixed. The normalization sensitivity analysis changes the denominator. The QC sensitivity analysis holds the denominator fixed and changes only which replicate means are admitted.

## What must be saved with the analysis

A reusable project should contain enough information to rebuild every reported output.

This project retains:

– the biological-sample manifest;

– the replicate-level synthetic qPCR dataset;

– the assay-level QC summary;

– the sample-level analysis dataset;

– reference-stability results;

– normalization comparisons;

– QC sensitivity results;

– the fixed random seed;

– the complete Jupyter notebook;

– the notebook source file;

– pinned package versions;

– high-resolution JPEG exports;

– WordPress-ready post drafts.

The final JPEG is not the analysis. It is one rendering of results that can be regenerated from the saved data and code.

## A checklist to reuse in another qPCR project

Before reporting a result, ask:

### Design

– Are biological and technical replicates identified separately?

– Are study groups distributed across plates or batches?

– Can group and batch effects be estimated separately?

### Measurement

– Are raw replicate measurements retained?

– Is the non-detect rule documented?

– Is the replicate disagreement threshold declared?

– Are exclusions counted by assay and group?

### Reference selection

– Is reference stability evaluated in the actual study conditions?

– Are group and batch patterns shown?

– Is the primary normalizer justified before target conclusions are selected?

### Analysis

– Are statistical tests performed on an appropriate scale?

– Are effect estimates accompanied by confidence intervals?

– Is the analysis sample size reported for each result?

– Are fold-change values presented without hiding their assumptions?

### Robustness

– Does a plausible alternative reference materially change the result?

– Does a plausible alternative QC rule materially change the result?

– Are non-detects handled transparently?

### Reproducibility

– Can every table and figure be regenerated from saved code?

– Are software versions recorded?

– Is the random seed saved when simulation or resampling is used?

– Does the interpretation stay within the scope of the study design?

## Reproducibility is not the same as validity

A perfectly reproducible workflow can still begin with a poor assay, biased sampling, an unsuitable reference, or a badly designed experiment.

Reproducibility means that the analytical path is visible and repeatable. Validity asks whether that path supports the scientific conclusion.

This series uses reproducibility to expose validity questions rather than hide them:

– batch balance is verified;

– replicate disagreement is visible;

– reference instability is measured;

– conclusions are challenged under alternative decisions;

– synthetic results are kept within a methodological interpretation.

The [MIQE 2.0 guidelines](https://academic.oup.com/clinchem/article/71/6/634/8119148) provide a broader framework for qPCR design, assay validation, quality control, analysis, and reporting. This series does not replace that framework. It demonstrates how several of its principles can be made operational in a transparent analysis notebook.

## Final takeaway

The most important output of a qPCR analysis is not the smallest p value or the most polished figure.

It is a result whose path can be inspected:

**raw measurement → QC decision → reference evaluation → normalization → effect estimate → sensitivity analysis → report**

When every step remains visible, disagreements can be investigated rather than guessed at. That is what makes an analysis reusable, reviewable, and worth trusting.

—

## Series index

1. [Building a Synthetic qPCR Dataset](/synthetic-qpcr-dataset-technical-replicates-qc/)

2. [Technical Replicates in qPCR](/qpcr-technical-replicates-agreement-quality-control/)

3. [Reference RNA Stability](/reference-rna-stability-qpcr-normalization/)

4. [How qPCR Normalization Changes miRNA Results](/qpcr-normalization-changes-mirna-results/)

5. [A qPCR QC Sensitivity Analysis](/qpcr-qc-sensitivity-analysis/)

6. From Raw Measurements to Final Result

Leave a Reply

Create a website or blog at WordPress.com

Up ↑

Discover more from Writing my way through ideas.

Subscribe now to keep reading and get access to the full archive.

Continue reading