Current Optics and Photonics

Optical Society of Korea (한국광학회)
권호 표지
DOI QR코드

DOI QR Code

Deep Learning: High-quality Imaging through Multicore Fiber

  • Wu, Liqing (College of Information Science and Engineering, Fujian Provincial Key Laboratory of Light Propagation and Transformation, Huaqiao University) ;
  • Zhao, Jun (School of Automation and Electrical Engineering, Shenyang Ligong University) ;
  • Zhang, Minghai (School of Automation and Electrical Engineering, Shenyang Ligong University) ;
  • Zhang, Yanzhu (School of Automation and Electrical Engineering, Shenyang Ligong University) ;
  • Wang, Xiaoyan (College of Information Science and Engineering, Fujian Provincial Key Laboratory of Light Propagation and Transformation, Huaqiao University) ;
  • Chen, Ziyang (College of Information Science and Engineering, Fujian Provincial Key Laboratory of Light Propagation and Transformation, Huaqiao University) ;
  • Pu, Jixiong (College of Information Science and Engineering, Fujian Provincial Key Laboratory of Light Propagation and Transformation, Huaqiao University)
  • Received : 2020.02.03
  • Accepted : 2020.05.08
  • Published : 2020.08.25
Download PDF
⟨ Previous Next ⟩

Abstract

Imaging through multicore fiber (MCF) is of great significance in the biomedical domain. Although several techniques have been developed to image an object from a signal passing through MCF, these methods are strongly dependent on the surroundings, such as vibration and the temperature fluctuation of the fiber's environment. In this paper, we apply a new, strong technique called deep learning to reconstruct the phase image through a MCF in which each core is multimode. To evaluate the network, we employ the binary cross-entropy as the loss function of a convolutional neural network (CNN) with improved U-net structure. The high-quality reconstruction of input objects upon spatial light modulation (SLM) can be realized from the speckle patterns of intensity that contain the information about the objects. Moreover, we study the effect of MCF length on image recovery. It is shown that the shorter the fiber, the better the imaging quality. Based on our findings, MCF may have applications in fields such as endoscopic imaging and optical communication.

Keywords

References

  1. I. N. Papadopoulos, S. Farahi, C. Moser, and D. Psaltis, "High-resolution, lensless endoscope based on digital scanning through a multimode optical fiber," Biomed. Opt. Express 4, 260-270 (2013). https://doi.org/10.1364/BOE.4.000260
  2. T. Cizmar and K. Dholakia, "Exploiting multimode waveguides for pure fibre-based imaging," Nat. Commun. 3, 1027 (2012). https://doi.org/10.1038/ncomms2024
  3. Y. Choi, C. Yoon, M. Kim, T. D. Yang, C. Fang-Yen, R. R. Dasari, K. J. Lee, and W. Choi, "Scanner-free and wide-field endoscopic imaging by using a single multimode optical fiber," Phys. Rev. Lett. 109, 203901 (2012). https://doi.org/10.1103/PhysRevLett.109.203901
  4. K. Krupa, A. Tonello, B. M. Shalaby, M. Fabert, A. Barthelemy, G. Millot, S. Wabnitz, and V. Couderc, "Spatial beam self-cleaning in multimode fibres," Nat. Photonics 11, 237-241 (2017). https://doi.org/10.1038/nphoton.2017.32
  5. M. Hughes, T. P. Chang, and G.-Z. Yang, "Fiber bundle endocytoscopy," Biomed. Opt. Express 4, 2781-2794 (2013). https://doi.org/10.1364/BOE.4.002781
  6. V. Tsvirkun, S. Sivankutty, G. Bouwmans, O. Katz, E. R. Andresen, and H. Rigneault, "Widefield lensless endoscopy with a multicore fiber," Opt. Lett. 41, 4771-4774 (2016). https://doi.org/10.1364/OL.41.004771
  7. A. Porat, E. R. Andresen, H. Rigneault, D. Oron, S. Gigan, and O. Katz, "Widefield lensless imaging through a fiber bundle via speckle correlations," Opt. Express 24, 16835-16855 (2016). https://doi.org/10.1364/OE.24.016835
  8. N. Stasio, C. Moser, and D. Psaltis, "Calibration-free imaging through a multicore fiber using speckle scanning microscopy," Opt. Lett. 41, 3078-3081 (2016). https://doi.org/10.1364/OL.41.003078
  9. N. Stasio, D. B. Conkey, C. Moser, and D. Psaltis, "Light control in a multicore fiber using the memory effect," Opt. Express 23, 30532-30544 (2015). https://doi.org/10.1364/OE.23.030532
  10. P. Fan, T. Zhao, and L. Su, "Deep learning the high variability and randomness inside multimode fibers," Opt. Express 27, 20241-20258 (2019). https://doi.org/10.1364/OE.27.020241
  11. P. Caramazza, O. Moran, R. Murray-Smith, and D. Faccio, "Transmission of natural scene images through a multimode fibre," Nat. Commun. 10, 2029 (2019). https://doi.org/10.1038/s41467-019-10057-8
  12. N. Borhani, E. Kakkava, C. Moser, and D. Psaltis, "Learning to see through multimode fibers," Optica 5, 960-966 (2018). https://doi.org/10.1364/OPTICA.5.000960
  13. R. Horisaki, R. Takagi, and J. Tanida, "Learning-based imaging through scattering media," Opt. Express 24, 13738- 13743 (2016). https://doi.org/10.1364/OE.24.013738
  14. K. Wang, J. Dou, Q. Kemao, J. Di, and J. Zhao, "Y-Net: a one-to-two deep learning framework for digital holographic reconstruction," Opt. Lett. 44, 4765-4768 (2019). https://doi.org/10.1364/OL.44.004765
  15. H. Wang, M. Lyu, and G. Situ, "eHoloNet: a learningbased end-to-end approach for in-line digital holographic reconstruction," Opt. Express 26, 22603-22614 (2018). https://doi.org/10.1364/OE.26.022603
  16. T. Nguyen, V. Bui, V. Lam, C. B. Raub, L.-C. Chang, and G. Nehmetallah, "Automatic phase aberration compensation for digital holographic microscopy based on deep learning background detection," Opt. Express 25, 15043-15057 (2017). https://doi.org/10.1364/OE.25.015043
  17. Y. Wu, Y. Rivenson, Y. Zhang, Z. Wei, H. Günaydin, X. Lin, and A. Ozcan, "Extended depth-of-field in holographic imaging using deep-learning-based autofocusing and phase recovery," Optica 5, 704-710 (2018). https://doi.org/10.1364/OPTICA.5.000704
  18. Y. L. Cun, Y. Bengio, and G. Hinton, "Deep learning," Nature 521, 436-444 (2015). https://doi.org/10.1038/nature14539
  19. S. Aisawa, K. Noguchi, and T. Matsumoto, "Remote image classification through multimode optical fiber using a neural network," Opt. Lett. 16, 645-647 (1991). https://doi.org/10.1364/OL.16.000645
  20. S. Li, M. Deng, J. Lee, A. Sinha, and G. Barbastathis, "Imaging through glass diffusers using densely connected convolutional networks," Optica 5, 803-813 (2018). https://doi.org/10.1364/OPTICA.5.000803
  21. X. Yuan and Y. Pu, "Parallel lensless compressive imaging via deep convolutional neural networks," Opt. Express 26, 1962-1977 (2018). https://doi.org/10.1364/OE.26.001962
  22. C. Park, C. C. Took, and J.-K. Seong, "Machine learning in biomedical engineering," Biomed. Eng. Lett. 8, 1-3 (2018). https://doi.org/10.1007/s13534-018-0058-3
  23. C. M. Sandino, J. Y. Cheng, F. Chen, M. Mardani, J. M. Pauly, and S. S. Vasanawala, "Compressed sensing: from research to clinical practice with deep neural networks: Shortening Scan Times for Magnetic Resonance Imaging," IEEE Signal Process. Mag. 37, 117-127 (2020). https://doi.org/10.1109/MSP.2019.2950433
  24. K. Hammernik, T. Klatzer, E. Kobler, M. P. Recht, D. K. Sodickson, T. Pock, and F. Knoll, "Learning a variational network for reconstruction of accelerated MRI data," Magn. Reson. Med. 79, 3055-3071 (2018). https://doi.org/10.1002/mrm.26977
  25. O. Ronneberger, P. Fischer, and T. Brox, "U-net: convolutional networks for biomedical image segmentation," in Proc. Medical Image Computing and Computer-Assisted Intervention (Munich, Germany, Oct. 2015), pp. 234-241.
  26. G. Huang, Z. Liu, L. V. D. Maaten, and K. Q. Weinberger, "Densely connected convolutional networks," in Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (Honolulu, USA, Jul. 2017), pp. 4700-4708.
  27. P. D. Kingma and J. Ba, "Adam: a method for stochastic optimization," in Proc. the 3rd International Conference for Learning Representations (San Diego, USA, May 2015).
  28. A. Kendall and Y. Gal, "What uncertainties do we need in Bayesian deep learning for computer vision?" in Proc. Neural Information Processing Systems (CA, USA, Dec. 2017), pp. 5574-5584.
  29. B. Li, Y. Liu, and X. Wang, "Gradient harmonized singlestage detector," in Proc. AAAI Conference on Artificial Intelligence (Honolulu, USA, Jan. 2019), pp. 8577-8584.
  30. L. Wu, W. Fan, Z. Chen, and J. Pu, "Focusing and polarized modulation of a laser passing through multi-core fiber," Opt. Rev. 26, 531-536 (2019). https://doi.org/10.1007/s10043-019-00521-7
  31. Y. L. Cun, C. Cortes, and C. J. C. Burges, THE MNIST DATABASE of handwritten digits (Y. L. Cun, C. Cortes, and C. J. C. Burges), http://yann.lecun.com/exdb/mnist/ (Accessed date: 2019.06.13.).
  32. Y. Li, Y. Xue, and L. Tian, "Deep speckle correlation: a deep learning approach toward scalable imaging through scattering media," Optica 5, 1181-1190 (2018). https://doi.org/10.1364/OPTICA.5.001181