Ir para o conteúdo principal

Escrever um comentário

Avalilação PREreview Estruturada de Predictors of COVID-19 hospital outcomes: a machine learning analysis of the National COVID Cohort Collaborative

Publicado
DOI
10.5281/zenodo.19520609
Licença
CC BY 4.0
Does the introduction explain the objective of the research presented in the preprint?
Yes
The introduction clearly states the three prediction targets (LOS, in-hospital mortality, 60-day mortality), justifies the clinical need, situates the work relative to prior literature, and specifies the N3C dataset.
Are the methods well-suited for this research?
Neither appropriate nor inappropriate
The overall framework (retrospective cohort, multiple ML models, SMOTE, TRIPOD reporting) is reasonable. However, the inclusion of remdesivir as a predictor without verifying temporal ordering, the absence of threshold optimization, and the lack of temporal validation are meaningful deviations from best practices.
Are the conclusions supported by the data?
Somewhat supported
The mortality findings and the SMOTE tradeoff conclusion are well-supported. The LOS conclusion is also credible. However, the claim that these models could inform pandemic preparedness is difficult to support given the temporal pooling across five years and the lack of external validation.
Are the data presentations, including visualizations, well-suited to represent the data?
Highly appropriate and clear
The ROC curves, SHAP beeswarm plots, and tables are appropriate choices for this type of ML study and are generally readable.
How clearly do the authors discuss, explain, and interpret their findings and potential next steps for the research?
Somewhat clearly
The discussion is one of the stronger sections, as the authors engage honestly with the SMOTE tradeoff, the LOS null finding, and the remdesivir confounding issue. However, the temporal pooling limitation is acknowledged but not fully explored, and the practical translation of AUROC values into clinical terms (what 0.72 means at the bedside) is absent.
Is the preprint likely to advance academic knowledge?
Somewhat likely
The empirical SMOTE tradeoff finding and the honest documentation of the structured EHR data ceiling are genuine contributions to clinical ML methodology. The N3C cohort characterization by remdesivir exposure also adds value for future causal inference work.
Would it benefit from language editing?
No
The writing is clear, precise, and well-organized throughout.
Would you recommend this preprint to others?
Yes, but it needs to be improved
The infrastructure, transparency, and methodological honesty make it worth reading, but the remdesivir temporal issue and temporal pooling concern need to be addressed before the conclusions can be fully trusted.
Is it ready for attention from an editor, publisher or broader audience?
No, it needs a major revision
A sensitivity analysis excluding remdesivir, some form of temporal validation, and subgroup performance reporting by race/ethnicity are needed before this is ready for publication. These are addressable revisions, not fatal flaws, but they are major enough that the current version should not go forward as it is.

Competing interests

The author declares that they have no competing interests.

Use of Artificial Intelligence (AI)

The author declares that they did not use generative AI to come up with new ideas for their review.

Você pode escrever um comentário nesta Avaliação PREreview de Predictors of COVID-19 hospital outcomes: a machine learning analysis of the National COVID Cohort Collaborative.

Antes de começar

Vamos pedir para você fazer login com seu ORCID iD. Se você não tiver um iD, você pode criar um.

O que é um ORCID iD?

Um ORCID iD é um identificador único que distingue você de outras pessoas com o mesmo nome ou nome semelhante.

Começar agora