Skip to Main content Skip to Navigation
Preprints, Working Papers, ...

Hierarchical clustering of spectral images with spatial constraints for the rapid processing of large and heterogeneous datasets

Abstract : When dealing with full spectrum images in which each pixel is characterized by a full spectrum, ie. spectral images, standard segmentation methods, such as k-means or hierarchical clustering might be either inapplicable or inappropriate; one aspect being the multi-GB size of such dataset leading to very expensive computations. In the present contribution, we propose an approach to spectral image segmentation combining hierarchical clustering and spatial constraints. On the one hand spatial constraints allow to implement an algorithm with a reasonable computation time to obtain a segmentation and with a certain level of robustness with respect to the signal-to-noise ratio since the prior knowledge injected by the spatial constraint partially compensates for the increase in noise level. On the other hand hierarchical clustering provides a statistically sound and known framework that allows accurate reporting of the instrument noise model. In terms of applications, this segmentation problem is encountered particularly in the study of ancient materials that benefits from the wealth of information provided by the acquisition of spectral images. In the last few years, data collection has been considerably accelerated, enabling the characeterization of the sample with a high dynamic range in both the spatial dimensions and composition and leading to an average size of a single dataset in the tens of GB range. Hence we also considered computational and memory complexity when developing the herein proposed algorithm. Taking on this application domain, we illustrate the proposed algorithm on a X-ray fluorescence spectral image collected on an ca. 100 Myr fossil fish, as well as on simulated data to assess the sensitivity of the results to the noise level. For such experiment, the lower sensitivity to noise simultaneously lead to an increase in the spatial definition of the collected spectral image, thanks to the faster acquisition time, and to a reduction in the potentially harmful radiation dose density to which the samples are subjected.
Document type :
Preprints, Working Papers, ...
Complete list of metadata

https://hal.uvsq.fr/hal-03104488
Contributor : Serge Cohen Connect in order to contact the contributor
Submitted on : Sunday, July 11, 2021 - 11:18:37 PM
Last modification on : Wednesday, October 20, 2021 - 12:25:05 AM

File

GCeleux-SXCohen-AGrimaud-PGuer...
Files produced by the author(s)

Licence


Distributed under a Creative Commons Attribution - ShareAlike 4.0 International License

Identifiers

  • HAL Id : hal-03104488, version 2
`

Citation

Gilles Celeux, Serge X. Cohen, Agnès Grimaud, Pierre Gueriau. Hierarchical clustering of spectral images with spatial constraints for the rapid processing of large and heterogeneous datasets. 2021. ⟨hal-03104488v2⟩

Share

Metrics

Record views

97

Files downloads

18