Ir para o conteúdo principal

Escrever uma avaliação PREreview

Self-Supervised Discovery of Discrete Local States in Noisy Image Sequences

Publicado
Servidor
bioRxiv
DOI
10.64898/2026.09.17.751938

Scientific image sequences often feature recurring structures with unknown appearance and dynamics. While traditional methods using predefined templates, noise models, or motion classes work well when targets are known, such assumptions can hinder exploratory analysis where discovering that knowledge is the primary goal. This work presents a self-supervised framework that maps noisy video into a discrete vocabulary of local states and their spatiotemporal relationships. The method operates without clean targets, pretrained representations, semantic labels, feature templates, or prescribed trajectories, assuming only that informative structures recur for a finite duration within a bounded spatial neighborhood. A temporally masked vector-quantized network predicts the missing central frame from its neighbors, while a masked Transformer refines token assignments by weighing encoder evidence against contextual compatibility. Project-specific token sets define the feature family, while a support model quantifies the temporal evidence for individual occurrences, facilitating optional conservative suppression. The framework is first demonstrated on synthetic videos of moving particles. Without access to clean frames or particle coordinates during learning and selection, the learned states recover compact, point-spread-function-like structures. Tests on low-signal particle-tracking benchmarks yield frame-wise component precision between 87.0% and 94.5%, with recall decreasing as particle density rises. An experimental example using E. coli further shows that discrete states can separate biological structures from illumination and acquisition artifacts. In all cases, the primary outputs are interpretable state, activity, support, and component maps; rendered images serve as diagnostics rather than optimization targets.

Você pode escrever uma avaliação PREreview de Self-Supervised Discovery of Discrete Local States in Noisy Image Sequences. Uma avaliação PREreview é uma avaliação de um preprint e pode variar de algumas frases a um parecer extenso, semelhante a um parecer de revisão por pares realizado por periódicos.

Antes de começar

We will ask you to log in with your ORCID iD. If you don’t have an iD, you can create one.

What is an ORCID iD?

An ORCID iD is a unique identifier that distinguishes you from everyone with the same or similar name.

Começar agora