×

zbMATH — the first resource for mathematics

Virtual reality in advanced medical immersive imaging: a workflow for introducing virtual reality as a supporting tool in medical imaging. (English) Zbl 1396.94009
Summary: Radiologic evaluation of images from computed tomography (CT) or magnetic resonance imaging for diagnostic purposes is based on the analysis of single slices, occasionally supplementing this information with 3D reconstructions as well as surface or volume rendered images. However, due to the complexity of anatomical or pathological structures in biomedical imaging, innovative visualization techniques are required to display morphological characteristics three dimensionally. Virtual reality is a modern tool of representing visual data, The observer has the impression of being “inside” a virtual surrounding, which is referred to as immersive imaging. Such techniques are currently being used in technical applications, e.g. in the automobile industry. Our aim is to introduce a workflow realized within one simple program which processes common image stacks from CT, produces 3D volume and surface reconstruction and rendering, and finally includes the data into a virtual reality device equipped with a motion head tracking cave automatic virtual environment system. Such techniques have the potential to augment the possibilities in non-invasive medical imaging, e.g. for surgical planning or educational purposes to add another dimension for advanced understanding of complex anatomical and pathological structures. To this end, the reconstructions are based on advanced mathematical techniques and the corresponding grids which we can export are intended to form the basis for simulations of mathematical models of the pathogenesis of different diseases.
MSC:
94A08 Image processing (compression, reconstruction, etc.) in information and communication theory
92C55 Biomedical imaging and signal processing
PDF BibTeX XML Cite
Full Text: DOI
References:
[1] Community. Osirix software. http://www.osirix-viewer.com/
[2] MITK. Software. http://mitk.org/wiki/MITK
[3] Wössner, U., Aumüller, M., Lang, U.: Driving an active stereo cave with a cluster of pcs. VR-Cluster 03: Workshop on Commodity Clusters for Virtual Reality, IEEE VR, Los Angeles, (2003)
[4] Hoffer, M; Poliwoda, C; Wittum, G, Visual reflection library: a framework for declarative GUI programming on the Java platform, Comput. Vis. Sci., 16, 181, (2013)
[5] Rantzau, D., Frank, K., Lang, U., Rainer, D., Wössner, U.: Covise in the cube: An environment for analyzing large and complex simulation data. In: Proceedings of the 2nd workshop on immersive projection technology (IPT 98), Ames, Iowa (1998)
[6] Vogel, A; Reiter, S; Rupp, M; Nägel, A; Wittum, G, Ug 4: a novel flexible software system for simulating PDE based models on high performance computers, Comp. Vis. Sci., 16, 165-179, (2013) · Zbl 1375.35003
[7] Reiter, S; Vogel, A; Heppner, I; Rupp, M; Wittum, G, A massively parallel geometric multigrid solver on hierarchically distributed grids, Comput. Vis. Sci., 16, 151-164, (2013) · Zbl 1380.65463
[8] http://dicom.nema.org/. Dicom standard. web page, (2011)
[9] Lorensen, William E; Cline, Harvey E, Marching cubes: a high resolution 3D surface construction algorithm, Comput. Gr., 21, 163-169, (1987)
[10] Newman, TS; Yi, H, A survey of the marching cubes algorithm, Comput. Gr., 30, 854-879, (2006)
[11] Reiter, S.: Effiziente algorithmen und datenstrukturen für die realisierung von adaptiven, hierarchischen gittern auf massiv parallelen systemen. Ph.D. thesis University of Frankfurt (2015)
[12] Reiter, S., Wittum, G.: http://promesh3d.com/ (2017)
[13] International Organization for Standardization. Tiff standard. https://www.iso.org/standard/2181.html (1998)
[14] Wavefront Technologies. Wavefront obj standard. http://www.martinreddy.net/gfx/3d/OBJ.spec (1989)
[15] Brooks, Rodney A, A quantitative theory of the hounsfield unit and its application to dual energy scanning, J. Comput. Assist. Tomogr., 1, 487-493, (1977)
[16] Broser, PJ; Schulte, R; Roth, A; Helmchen, F; Waters, J; Lang, S; Sakmann, B; Wittum, G, Nonlinear anisotropic diffusion filtering of three-dimensional image data from 2-photon microscopy, J. Biom. Opt., 9, 1253-1264, (2004)
[17] Jungblut, D; Queisser, G; Wittum, G, Inertia based filtering of high resolution images using a GPU cluster, Comput. Vis. Sci., 14, 181-186, (2011)
[18] Otsu, N, A threshold selection method from gray-level histograms, IEEE Trans. Syst. Man Cybern., 9, 62-66, (1979)
[19] Oracle. Java native interface. http://docs.oracle.com/javase/7/docs/technotes/guides/jni/index.html 1993 (2014)
[20] Vogel, A; Xu, J; Wittum, G, A generalization of the vertex-centered finite volume scheme to arbitrary high order, Comput. Vis. Sci., 13, 221-228, (2010) · Zbl 1207.65128
[21] Bey, J.: Finite-Volumen- und Mehrgitter-Verfahren für Elliptische Randwertprobleme. B.G. Teubn, Berlin (2003)
[22] Hackbusch, W.: Iterative Solution of Large Sparse Systems of Equations. Springer, Berlin (1993) · Zbl 0861.65022
[23] ter Romeny, B.M.H.: Computational Imaging and Vision Geometry-Driven Diffusion in Computer Vision. Kluwer Academic Publishers, Dordrecht (1994) · Zbl 0832.68111
[24] Gonzales, R. C., Woods, R. E.: Digital image processing. Pearson Educ; 00004. ISBN-10: 0133356728 ISBN-13: 978-0133356724 (2017)
[25] Suetens, P.: Fundamentals of medical imaging. Cambridge University Press, Cambridge. 2nd edn ASIN: B00DT608R2 (2009)
[26] Dubois, E.: A projection method to generate anaglyph stereo images. In: Proceedings of IEEE international conference on acoustics speech signal processing, (Salt Lake City, UT), vol. 3, pp. 1661-1664 (2001)
[27] Stefan Vilsmeier. Brainlab munich, germany. https://www.brainlab.com/en (1989)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.