Avalilação PREreview de The impact of strain heterogeneity on genomic profiling accuracy in mixed-strain Escherichia coli metagenomes

The impact of strain heterogeneity on genomic profiling accuracy in mixed-strain Escherichia coli metagenomes 

Authors: Vaishnavi Divya Shridar and Stefan Engblom 

Reviewer: Bali Schock

Originally Published on bioRxiv

1. Research Summary

This study looks at how accurately different bioinformatics tools can identify antibiotic resistance genes (ARGs), virulence genes (VGs), multilocus sequence types (MLST), and serotypes in mixed-strain Escherichia coli metagenomes. The authors compare read-based and assembly-based approaches using simulated datasets with experimentally validated reference annotations. Through this process, the investigators found that individual resistance and virulence genes can be recovered with relatively high accuracy, while strain-level characterization is considerably more challenging. ARG recovery exceeded 84% across all evaluated tools, whereas none of the MLST tools correctly identified the dominant sequence type in the original mixed-strain datasets. The authors conclude that strain heterogeneity represents a significant limitation in metagenomic surveillance and that reliable gene detection does not necessarily indicate accurate strain-level characterization.

This study addresses an important methodological challenge in expanding the use of metagenomic sequencing for antimicrobial resistance monitoring and wastewater-based epidemiology. Although resisting research has evaluated individual bioinformatic tools, fewer studies have systematically compared their performance across multiple clinically relevant genomic features under standardized conditions. Incorporating PCR-validated reference annotations and varying levels of strain complexity established a useful framework for identifying limitations in existing genomic profiling approaches. These approaches are relevant to public health surveillance, particularly in efforts to characterize circulating bacterial populations while monitoring epidemiologically important lineages.

1. Examples and Evidence

Major Comments: 

• The primary concern is the exclusive use of simulated, single-species E. coli metagenomes rather than experimentally sequenced environmental samples. While this approach provides controlled conditions for evaluating strain heterogeneity, it does not fully capture the complexity of real wastewater samples, including diverse microbial communities, uneven sequencing coverage, and environmental contaminants. These differences have the potential to substantially influence bioinformatics tool performance. By incorporating real wastewater sequencing data, the study’s external validity could be improved. Alternatively, the authors could more explicitly limit their conclusions to low-complexity, single-species metagenomic conditions.

• This study evaluated antimicrobial resistance and virulence gene detection primarily through recovery rates, without assessing false-positive predictions or overall classification accuracy. While authors acknowledge that PCR-confirmed annotations do not establish gene absence, this approach limits conclusions about the reliability of these tools for surveillance applications. High gene recovery does not necessarily indicate high specificity, particularly in heterogeneous metagenomic samples. The authors could clarify this distinction, and consider incorporating reference datasets with confirmed negative annotations to permit a more comprehensive evaluation of tool performance.

Minor Comments:

• The authors generated only 10 metagenomes per genomic feature category, which may not adequately capture the variability in strain composition and genomic diversity encountered in real-world surveillance. This limited sample size reduces the statistical precision of performance estimates and makes it difficult to determine whether observed differences between bioinformatics tools are consistent across diverse conditions.

Competing interests

The authors declare that they have no competing interests.

Use of Artificial Intelligence (AI)

The authors declare that they did not use generative AI to come up with new ideas for their review.