journal article·2022-02-10

Compressive Hyperspectral Microscopy of Scattering and Fluorescence of Nanoparticles

Yibo Xu, Liyang Lu, Anthony Giljum, Courtney M. Payne, Jason H. Hafner, Emilie Ringe, Kevin F. Kelly

Publisher page

Abstract

Hyperspectral imaging in optical microscopy is of importance in the study of various submicron physical and chemical phenomena. However, its practical application is still challenging because the additional spectral dimension increases the number of sampling points to be independently measured compared to two-dimensional (2D) imaging. Here, we present a hyperspectral microscopy system through passive illumination approach based on compressive sensing (CS) using a spectrometer with a one-dimensional (1D) detector array and a digital micromirror device (DMD). The illumination is patterned after the sample rather than on it, making this technique compatible with both dark-field and bright-field imaging. The DMD diffraction issue resulting from this approach has been overcome by a novel striped DMD pattern modulation method. In addition, a split pattern method is developed for increasing the spatial resolution when employing the DMD pattern modulation. The efficacy of the system is demonstrated on nanoparticles using two model systems: extended plasmonic metal nanostructures and fluorescent microspheres. The compressive hyperspectral microscopic system provides a fast, high dynamic range, and enhanced signal-to-noise ratio (SNR) platform that yields a powerful and low-cost spectral analytical system to probe the optical properties of a myriad of nanomaterial systems. The system can also be extended to wavelengths beyond the visible spectrum with greatly reduced expense compared to other approaches that use 2D array detectors.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Sparse and Compressive Sensing Techniques · Random lasers and scattering media · Plasmonic and Surface Plasmon Research

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Electrical and Computer Engineering, Rice University, 6100 Main Street, Houston, Texas 77005, United States

Applied Physics Graduate Program, Smalley-Curl Institute, Rice University, 6100 Main Street, Houston, Texas 77005, United States

Department of Chemistry, Rice University, 6100 Main Street, Houston, Texas 77005, United States

Department of Physics and Astronomy, Rice University, 6100 Main Street, Houston, Texas 77005, United States

Department of Materials Science and Metallurgy, University of Cambridge, Cambridge CB3 0FS, United Kingdom

Funding

Division of Chemistry · W. M. Keck Foundation

References (62)

Show source-provided references
1. 10.1109/MSP.2013.227950710.1109/MSP.2013.2279507 ↗
2. 10.1016/j.rse.2007.12.01410.1016/j.rse.2007.12.014 ↗
3. 10.1002/wnan.133010.1002/wnan.1330 ↗
4. 10.1080/05704928.2018.146323510.1080/05704928.2018.1463235 ↗
5. 10.1117/1.JBO.19.1.01090110.1117/1.JBO.19.1.010901 ↗
6. Xu, Y. Compressive Hyperspectral Structured Illumination and Classification via Neural Networks. Ph.D. Thesis, Rice University: Houston, USA, 2016.
7. 10.1080/05704928.2012.70580010.1080/05704928.2012.705800 ↗
8. 10.1016/j.microc.2015.11.04410.1016/j.microc.2015.11.044 ↗
9. 10.1364/OE.40281210.1364/OE.402812 ↗
10. 10.1117/1.364652910.1117/1.3646529 ↗
11. 10.1117/1.273735110.1117/1.2737351 ↗
12. 10.1021/jp504454y10.1021/jp504454y ↗
13. 10.1002/1097-0320(20010401)43:4<239::AID-CYTO1056>3.0.CO;2-Z10.1002/1097-0320(20010401)43:4<239::AID-CYTO1056>3.0.CO;2-Z ↗
14. 10.1073/pnas.070809010510.1073/pnas.0708090105 ↗
15. 10.1371/journal.pone.006432010.1371/journal.pone.0064320 ↗
16. 10.13031/2013.3647310.13031/2013.36473 ↗
17. 10.1002/cyto.a.2004810.1002/cyto.a.20048 ↗
18. 10.1364/OE.18.01433010.1364/OE.18.014330 ↗
19. 10.1186/s40679-018-0057-610.1186/s40679-018-0057-6 ↗
20. 10.1038/jid.2012.42910.1038/jid.2012.429 ↗
21. Long D. A. · 1977
22. 10.1117/1.OE.51.11.11170210.1117/1.OE.51.11.111702 ↗
23. 10.1364/AO.45.00628310.1364/AO.45.006283 ↗
24. Hernandez-Palacios, J.; Randeberg, L. In Intercomparison of EMCCD- and sCMOS-Based Imaging Spectrometers for Biomedical Applications in Low-Light Conditions, Proceedings SPIE 8215, Design and Quality for Biomedical Technologies V; International Society for Optics and Photonics, 2012; pp 82150Q–82150Q9.10.1117/12.909680 ↗
25. 10.1021/acs.jpcc.6b0240110.1021/acs.jpcc.6b02401 ↗
26. 10.1364/OE.17.01229310.1364/OE.17.012293 ↗
27. 10.1117/1.243495010.1117/1.2434950 ↗
28. Bodkin, A.; Sheinis, A.; Norton, A.; Daly, J.; Beaven, S.; Weinheimer, J. In Snapshot Hyperspectral Imaging: the Hyperpixel Array Camera, Algorithms and Technologies for Multispectral, Hyperspectral, and Ultraspectral Imagery XV; International Society for Optics and Photonics, 2009.10.1117/12.818929 ↗
29. 10.1145/3306346.332294610.1145/3306346.3322946 ↗
30. 10.1364/OPTICA.39721410.1364/OPTICA.397214 ↗
31. 10.1109/TIT.2005.86208310.1109/TIT.2005.862083 ↗
32. 10.1109/TIT.2006.87158210.1109/TIT.2006.871582 ↗
33. 10.1109/MSP.2007.91473010.1109/MSP.2007.914730 ↗
34. Sankaranarayanan, A. C.; Studer, C.; Baraniuk, R. G. In CS-MUVI: Video Compressive Sensing for Spatial-Multiplexing Cameras, 2012 IEEE International Conference on Computational Photography (ICCP); IEEE, 2012; pp 1–10.10.1109/ICCPhot.2012.6215212 ↗
35. Xu, L.; Sankaranarayanan, A.; Studer, C.; Li, Y.; Baraniuk, R. G.; Kelly, K. F. In Multi-Scale Compressive Video Acquisition, Computational Optical Sensing and Imaging; Optical Society of America, 2013.10.1364/COSI.2013.CW2C.4 ↗
36. Xu, Y.; Lu, L.; Kelly, K. F. In Hyperspectral Compressive Structured Light for Recovering Inhomogeneous Participating Media, Computational Optical Sensing and Imaging; Optical Society of America, 2017.10.1364/COSI.2017.CM3B.5 ↗
37. 10.1364/OE.18.02456510.1364/OE.18.024565 ↗
38. Chen, J.; Xu, Y.; Liyang, L.; Kelly, K. F. In Deep Learning for Compressive Infrared and Hyperspectral Machine Vision, 2018 IEEE Research and Applications of Photonics In Defense Conference (RAPID); IEEE, 2018; pp 1–4.10.1109/RAPID.2018.8508997 ↗
39. 10.1109/ACCESS.2020.304180710.1109/ACCESS.2020.3041807 ↗
40. 10.1109/TIP.2004.84070610.1109/TIP.2004.840706 ↗
41. Zisselman E. · 2018 · 19 · 3
42. 10.1073/pnas.111951110910.1073/pnas.1119511109 ↗
43. 10.1021/acs.jpcb.7b0333910.1021/acs.jpcb.7b03339 ↗
44. 10.1021/acs.jpclett.6b0050710.1021/acs.jpclett.6b00507 ↗
45. 10.1364/OE.15.01401310.1364/OE.15.014013 ↗
46. 10.1016/j.crma.2008.03.01410.1016/j.crma.2008.03.014 ↗
47. 10.1109/TIT.2005.85897910.1109/TIT.2005.858979 ↗
48. 10.1137/12086828110.1137/120868281 ↗
49. 10.1364/AO.54.000C1410.1364/AO.54.000C14 ↗
50. Takhar, D.; Laska, J. N.; Wakin, M. B.; Duarte, M.; Baron, D.; Sarvotham, S.; Kelly, K. F.; Baraniuk, R. G. In A New Compressive Imaging Camera Architecture Using Optical-Domain Compression, Computational Imaging IV; International Society for Optics and Photonics, 2006; p 606509.10.1117/12.659602 ↗
51. 10.1063/1.298912610.1063/1.2989126 ↗
52. 10.1109/TIP.2011.216762610.1109/TIP.2011.2167626 ↗
53. 10.1364/OE.17.01304010.1364/OE.17.013040 ↗
54. 10.1063/1.323829610.1063/1.3238296 ↗
55. Candes, E.; Romberg, J. L1-Magic: Recovery of Sparse Signals via Convex Programming; California Institute of Technology: Pasadena, CA, 2005. www.acm.caltech.edu/l1magic/downloads/l1magic.pdf.
56. Li, C. An Efficient Algorithm for Total Variation Regularization with Applications to the Single Pixel Camera and Compressive Sensing. Ph.D. Thesis, Rice University: Houston, USA, 2010.
57. 10.1109/TIP.2011.216762610.1109/TIP.2011.2167626 ↗
58. 10.1021/nl048610a10.1021/nl048610a ↗
59. 10.1021/nl052409y10.1021/nl052409y ↗
60. 10.1021/nl070627g10.1021/nl070627g ↗
61. 10.1021/nl203085t10.1021/nl203085t ↗
62. Metzler C. A. · Adv. Neural Inf. Process. Syst. · 2017 · 1772