zbMATH — the first resource for mathematics

Multigrid optimization for large-scale ptychographic phase retrieval. (English) Zbl 07196102
Summary: Ptychography is a popular imaging technique that combines diffractive imaging with scanning microscopy. The technique consists of a coherent beam that is scanned across an object in a series of overlapping positions, leading to reliable and improved reconstructions. Ptychographic microscopes allow for large fields to be imaged at high resolution at the cost of additional computational expense. In this work, we propose a multigrid-based optimization framework to reduce the computational burdens of large-scale ptychographic phase retrieval. Our proposed method exploits the inherent hierarchical structures in ptychography through tailored restriction and prolongation operators for the object and data domains. Our numerical results show that our proposed scheme accelerates the convergence of its underlying solver and outperforms the ptychographical iterative engine, a workhorse in the optics community.
Reviewer: Reviewer (Berlin)
65J22 Numerical solution to inverse problems in abstract spaces
90C06 Large-scale problems in mathematical programming
68U10 Computing methodologies for image processing
Full Text: DOI
[1] A. Antoniou, Digital Signal Processing, McGraw-Hill, New York, 2016.
[2] R. Barakat and G. Newsam, Algorithms for reconstruction of partially known, band-limited Fourier-transform pairs from noisy data, JOSA A, 2 (1985), pp. 2027-2039. · Zbl 0577.65132
[3] A. Brandt and O. E. Livne, Multigrid Techniques: 1984 Guide with Applications to Fluid Dynamics, vol. 67, SIAM, Philadelphia, 2011. · Zbl 1227.65121
[4] D. Brandwood, A complex gradient operator and its application in adaptive array theory, in IEE Proceedings H-Microwaves, Optics and Antennas, vol. 130, IET, 1983, pp. 11-16.
[5] O. Bunk, M. Dierolf, S. Kynde, I. Johnson, O. Marti, and F. Pfeiffer, Influence of the overlap parameter on the convergence of the ptychographical iterative engine, Ultramicroscopy, 108 (2008), pp. 481-487.
[6] E. J. Candes, Y. C. Eldar, T. Strohmer, and V. Voroninski, Phase retrieval via matrix completion, SIAM Rev., 57 (2015), pp. 225-251. · Zbl 1344.49057
[7] E. J. Candes, X. Li, and M. Soltanolkotabi, Phase retrieval via Wirtinger flow: Theory and algorithms, IEEE Trans. Inform. Theory, 61 (2015), pp. 1985-2007. · Zbl 1359.94069
[8] H. Chang, Y. Lou, Y. Duan, and S. Marchesini, Total variation-based phase retrieval for Poisson noise removal, SIAM J. Imaging Sci., 11 (2018), pp. 24-55. · Zbl 1398.65071
[9] H. Chang, S. Marchesini, Y. Lou, and T. Zeng, Variational phase retrieval with globally convergent preconditioned proximal algorithm, SIAM J. Imaging Sci., 11 (2018), pp. 56-93. · Zbl 1398.65072
[10] L. De Caro, D. Altamura, M. Arciniegas, D. Siliqi, M. R. Kim, T. Sibillano, L. Manna, and C. Giannini, Ptychographic imaging of branched colloidal nanocrystals embedded in free-standing thick polystyrene films, Scientific Reports, 6 (2016), 19397.
[11] Z. Di, M. Emelianenko, and S. Nash, Truncated Newton-based multigrid algorithm for centroidal Voronoi diagram calculation., Numer. Math. Theory, Meth. Appl., 5 (2012), pp. 242-259. · Zbl 1265.65035
[12] J. R. Fienup, Phase retrieval algorithms: A comparison, Appl. Opt., 21 (1982), pp. 2758-2769.
[13] K. Giewekemeyer, M. Beckers, T. Gorniak, M. Grunze, T. Salditt, and A. Rosenhahn, Ptychographic coherent x-ray diffractive imaging in the water window, Optics Express, 19 (2011), pp. 1037-1050.
[14] M. Gilles, Y. Nashed, M. Du, C. Jacobsen, and S. Wild, \(3\) D x-ray imaging of continuous objects beyond the depth of focus limit, Optica, 5 (2018), pp. 1078-1086.
[15] R. C. Gonzalez, R. E. Woods, et al., Digital Image Processing, Prentice Hall, New Jersey, 2002.
[16] D. Gürsoy, Direct coupling of tomography and ptychography, Optics Letters, 42 (2017), pp. 3169-3172.
[17] R. Hesse, D. R. Luke, S. Sabach, and M. K. Tam, Proximal heterogeneous block implicit-explicit method and application to blind ptychographic diffraction imaging, SIAM J. Imaging Sci., 8 (2015), pp. 426-457. · Zbl 1320.90063
[18] M. Holler, M. Guizar-Sicairos, E. H. Tsai, R. Dinapoli, E. Müller, O. Bunk, J. Raabe, and G. Aeppli, High-resolution non-destructive three-dimensional imaging of integrated circuits, Nature, 543 (2017), 402.
[19] R. Hoppe, J. Reinhardt, G. Hofmann, J. Patommel, J.-D. Grunwaldt, C. D. Damsgaard, G. Wellenreuther, G. Falkenberg, and C. Schroer, High-resolution chemical imaging of gold nanoparticles using hard x-ray ptychography, Appl. Phys. Lett., 102 (2013), 203104.
[20] X. Huang, H. Yan, R. Harder, Y. Hwu, I. K. Robinson, and Y. S. Chu, Optimization of overlap uniformness for ptychography, Optics Express, 22 (2014), pp. 12634-12644.
[21] A. Konijnenberg, W. Coene, S. Pereira, and H. Urbach, Combining ptychographical algorithms with the Hybrid Input-Output (HIO) algorithm, Ultramicroscopy, 171 (2016), pp. 43-54.
[22] R. M. Lewis and S. G. Nash, Model problems for the multigrid optimization of systems governed by differential equations, SIAM J. Sci. Comput., 26 (2005), pp. 1811-1837. · Zbl 1119.65346
[23] D. R. Luke, J. V. Burke, and R. G. Lyon, Optical wavefront reconstruction: Theory and numerical methods, SIAM Rev., 44 (2002), pp. 169-224. · Zbl 1094.78004
[24] C. Ma, X. Liu, and Z. Wen, Globally convergent Levenberg-Marquardt method for phase retrieval, IEEE Trans. Inform. Theory, 65 (2019), pp. 2343-2359. · Zbl 1431.94018
[25] A. Maiden, D. Johnson, and P. Li, Further improvements to the ptychographical iterative engine, Optica, 4 (2017), pp. 736-745.
[26] A. M. Maiden and J. M. Rodenburg, An improved ptychographical phase retrieval algorithm for diffractive imaging, Ultramicroscopy, 109 (2009), pp. 1256-1262.
[27] S. Marchesini, A unified evaluation of iterative projection algorithms for phase retrieval, Review of Scientific Instruments, 78 (2007), 011301.
[28] J. Marrison, L. Räty, P. Marriott, and P. O’toole, Ptychography-a label free, high-contrast imaging technique for live cells using quantitative phase information, Scientific Reports, 3 (2013), 2369.
[29] S. G. Nash, Preconditioning of truncated-Newton methods, SIAM J. Sci. Statist. Comput., 6 (1985), pp. 599-616. · Zbl 0592.65038
[30] S. G. Nash, A multigrid approach to discretized optimization problems, Optim. Meth. Softw., 14 (2000), pp. 99-116. · Zbl 0988.90040
[31] S. G. Nash, Convergence and descent properties for a class of multilevel optimization algorithms, tech. report, George Mason University, Fairfax, VA, 2010.
[32] Y. S. Nashed, D. J. Vine, T. Peterka, J. Deng, R. Ross, and C. Jacobsen, Parallel ptychographic reconstruction, Optics Express, 22 (2014), pp. 32082-32097.
[33] J. Nocedal and S. J. Wright, Numerical Optimization, 2nd ed., Springer, New York City, 2006. · Zbl 1104.65059
[34] P. M. Pelz, M. Guizar-Sicairos, P. Thibault, I. Johnson, M. Holler, and A. Menzel, On-the-fly scans for X-ray ptychography, Appl. Phys. Lett., 105 (2014), 251101.
[35] J. Qian, C. Yang, A. Schirotzek, F. Maia, and S. Marchesini, Efficient algorithms for ptychographic phase retrieval, Inverse Problems and Applications, Contemporary Mathematics, 625 (2014), pp. 261-280. · Zbl 1329.65332
[36] R. Remmert, Theory of Complex Functions, vol. 122, Springer Science & Business Media, New York, 2012.
[37] J. M. Rodenburg, Ptychography and related diffractive imaging methods, Advances in Imaging and Electron Physics, 150 (2008), pp. 87-184.
[38] J. M. Rodenburg and H. M. Faulkner, A phase retrieval algorithm for shifting illumination, Appl. Phys. Lett., 85 (2004), pp. 4795-4797.
[39] B. Seifert, H. Stolz, M. Donatelli, D. Langemann, and M. Tasche, Multilevel Gauss-Newton methods for phase retrieval problems, J. Phys. A Math. Gen., 39 (2006), 4191. · Zbl 1099.78012
[40] L. Sorber, M. V. Barel, and L. D. Lathauwer, Unconstrained optimization of real functions in complex variables, SIAM J. Optim., 22 (2012), pp. 879-898. · Zbl 1260.90150
[41] A. Suzuki, K. Shimomura, M. Hirose, N. Burdet, and Y. Takahashi, Dark-field X-ray ptychography: Towards high-resolution imaging of thick and unstained biological specimens, Scientific Reports, 6 (2016), 35060.
[42] P. Thibault, M. Dierolf, O. Bunk, A. Menzel, and F. Pfeiffer, Probe retrieval in ptychographic coherent diffractive imaging, Ultramicroscopy, 109 (2009), pp. 338-343.
[43] P. Thibault and M. Guizar-Sicairos, Maximum-likelihood refinement for coherent diffractive imaging, New Journal of Physics, 14 (2012), 063004.
[44] U. Trottenberg, C. W. Oosterlee, and A. Schuller, Multigrid, Elsevier, New York, 2000.
[45] Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, Image quality assessment: From error visibility to structural similarity, IEEE Trans. Image Process., 13 (2004), pp. 600-612.
[46] Z. Wen, C. Yang, X. Liu, and S. Marchesini, Alternating direction methods for classical and ptychographic phase retrieval, Inverse Problems, 28 (2012), 115010. · Zbl 1254.78037
[47] R. Xu, M. Soltanolkotabi, J. P. Haldar, W. Unglaub, J. Zusman, A. F. Levi, and R. M. Leahy, Accelerated Wirtinger flow: A fast algorithm for ptychography, preprint, arXiv:1806.05546, 2018, https://arxiv.org/abs/1806.05546.
[48] C. Yang, J. Qian, A. Schirotzek, F. Maia, and S. Marchesini, Iterative algorithms for ptychographic phase retrieval, preprint, arXiv:1105.5628, 2011, https://arxiv.org/abs/1105.5628. · Zbl 1329.65332
[49] L.-H. Yeh, J. Dong, J. Zhong, L. Tian, M. Chen, G. Tang, M. Soltanolkotabi, and L. Waller, Experimental robustness of Fourier ptychography phase retrieval algorithms, Optics Express, 23 (2015), pp. 33214-33240.
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.