2d-3d Image Registration in Diagnostic and Interventional X-Ray Imaging

2d-3d Image Registration in Diagnostic and Interventional X-Ray Imaging
Author: Imramsjah Martijn John Van Der Bom
Publisher: LAP Lambert Academic Publishing
Total Pages: 116
Release: 2011-03
Genre:
ISBN: 9783844314915

Clinical procedures that are conventionally guided by 2D x-ray imaging, may benefit from the additional spatial information provided by 3D image data. For instance, guidance of minimally invasive procedures with CT or MRI data provides 3D spatial information and visualization of structures that are not visible with x-ray. Since 3D imaging modalities may not be available during the procedure or require increased patient dose, it is desirable to use pre-interventional/preoperative 3D patient data for guidance that was obtained for diagnosis and treatment planning. To accomplish this, a relationship between patient and image data has to be realized. This relationship can be obtained by 2D-3D image registration. The aim of the research presented in this thesis is to evaluate the performance and limitations of 2D-3D image registration for diagnostic and interventional x-ray imaging, and to develop new methods to overcome these limitations.

High-Resolution X-Ray Image Generation from CT Data Using Super-Resolution

High-Resolution X-Ray Image Generation from CT Data Using Super-Resolution
Author: Qing Ma
Publisher:
Total Pages:
Release: 2021
Genre:
ISBN:

Synthetic X-ray or digitally reconstructed radiographs (DRRs) are simulated X-ray images projected from computed tomography (CT) data that are commonly used for CT and real X-Ray image registration. High-quality synthetic X-ray images can facilitate various applications such as guiding images for virtual reality (VR) simulation and training data for deep learning methods such as creating CT data from X-Ray images. It is challenging to generate high-quality synthetic X-ray images from CT slices, especially in various view angles, due to gaps between CT slices, high computational cost, and the complexity of algorithms. Most synthetic X-ray generation methods use fast ray-tracing in a situation where the image quality demand is low. We aim to improve image quality while maintaining good accuracy and use two steps; 1) to generate synthetic X-ray images from CT data and 2) to increase the resolution of the synthetic X-ray images. Our synthetic X-ray image generation method adopts a matrix-based projection method and dynamic multi-segment lookup tables, which shows better image quality and efficiency compared to conventional synthetic X-ray image generation methods. Our method is tested in a real-time VR training system for image-guided intervention procedures. Then we proposed two novel approaches to raise the quality of synthetic X-ray images through deep learning methods. We use a reference-based super-resolution (RefSR) method as a base model to upsampling low-resolution images into higher resolution. Even though RefSR can produce fine details by utilizing the reference image, it inevitably generates some artifacts and noise. We propose texture transformer super-resolution with frequency domain (TTSR-FD) which introduces frequency domain loss as a constraint to improve the quality of the RefSR results with fine details and without apparent artifacts. To the best of our knowledge, this is the first work that utilizes frequency domain as a part of loss functions in the field of super-resolution (SR). We observe improved performance in evaluating TTSR-FD when tested on our synthetic X-ray and real X-ray image datasets. A typical SR network is trained with paired high-resolution (HR) and low-resolution (LR) images, where LR images are created by downsampling HR images using a specific kernel. The same downsampling kernel is also used to create test LR images from HR images. As a result, most SR methods only perform well when the testing image is acquired using the same downsampling kernel used during the training process. We also propose TTSR-DMK, which uses multiple downsampling kernels during training to generalize the model and adopt a dual model that trains together with the main model. The dual model can form a closed-loop with the main model to learn the inverse mapping, which further improves the model's performance. Our method works well for testing images produced by multiple kernels used during training. It can also help improve the model performance when testing images are acquired with kernels not used during training. To the best of our knowledge, we are the first to use the closed-loop method in RefSR. We have achieved: (i) synthetic X-ray image generation from CT data, which is based on a matrix-based projection and lookup tables ; (ii) TTSR-FD: synthetic X-ray image super-resolution using a novel frequency domain loss ; (iii) TTSR-DMK: an adaptation network to overcome the performance drop for testing data which do not match to downsampling kernels used in training. Our TTSR-FD results show improvements (PSNR from 37.953 to 39. 009) compared to the state-of-the-art methods TTSR. Our experiment with real X-Ray images using TTSR-FD can remove visible artifacts in the qualitative study even though PSNR is similar. Our proposed adaptation network, TTSR-DMK, improved model performance for multiple kernels even with unknown kernel situations.

Medical Image Registration

Medical Image Registration
Author: Joseph V. Hajnal
Publisher: CRC Press
Total Pages: 394
Release: 2001-06-27
Genre: Medical
ISBN: 1420042475

Image registration is the process of systematically placing separate images in a common frame of reference so that the information they contain can be optimally integrated or compared. This is becoming the central tool for image analysis, understanding, and visualization in both medical and scientific applications. Medical Image Registration provid

3D Imaging in Medicine

3D Imaging in Medicine
Author: Karl H. Höhne
Publisher: Springer Science & Business Media
Total Pages: 449
Release: 2012-12-06
Genre: Computers
ISBN: 3642842119

The visualization of human anatomy for diagnostic, therapeutic, and educational pur poses has long been a challenge for scientists and artists. In vivo medical imaging could not be introduced until the discovery of X-rays by Wilhelm Conrad ROntgen in 1895. With the early medical imaging techniques which are still in use today, the three-dimensional reality of the human body can only be visualized in two-dimensional projections or cross-sections. Recently, biomedical engineering and computer science have begun to offer the potential of producing natural three-dimensional views of the human anatomy of living subjects. For a broad application of such technology, many scientific and engineering problems still have to be solved. In order to stimulate progress, the NATO Advanced Research Workshop in Travemiinde, West Germany, from June 25 to 29 was organized. It brought together approximately 50 experts in 3D-medical imaging from allover the world. Among the list of topics image acquisition was addressed first, since its quality decisively influences the quality of the 3D-images. For 3D-image generation - in distinction to 2D imaging - a decision has to be made as to which objects contained in the data set are to be visualized. Therefore special emphasis was laid on methods of object definition. For the final visualization of the segmented objects a large variety of visualization algorithms have been proposed in the past. The meeting assessed these techniques.

2D and 3D Image Analysis by Moments

2D and 3D Image Analysis by Moments
Author: Jan Flusser
Publisher: John Wiley & Sons
Total Pages: 555
Release: 2016-12-19
Genre: Technology & Engineering
ISBN: 1119039355

Presents recent significant and rapid development in the field of 2D and 3D image analysis 2D and 3D Image Analysis by Moments, is a unique compendium of moment-based image analysis which includes traditional methods and also reflects the latest development of the field. The book presents a survey of 2D and 3D moment invariants with respect to similarity and affine spatial transformations and to image blurring and smoothing by various filters. The book comprehensively describes the mathematical background and theorems about the invariants but a large part is also devoted to practical usage of moments. Applications from various fields of computer vision, remote sensing, medical imaging, image retrieval, watermarking, and forensic analysis are demonstrated. Attention is also paid to efficient algorithms of moment computation. Key features: Presents a systematic overview of moment-based features used in 2D and 3D image analysis. Demonstrates invariant properties of moments with respect to various spatial and intensity transformations. Reviews and compares several orthogonal polynomials and respective moments. Describes efficient numerical algorithms for moment computation. It is a "classroom ready" textbook with a self-contained introduction to classifier design. The accompanying website contains around 300 lecture slides, Matlab codes, complete lists of the invariants, test images, and other supplementary material. 2D and 3D Image Analysis by Moments, is ideal for mathematicians, computer scientists, engineers, software developers, and Ph.D students involved in image analysis and recognition. Due to the addition of two introductory chapters on classifier design, the book may also serve as a self-contained textbook for graduate university courses on object recognition.

3D Shape Analysis

3D Shape Analysis
Author: Hamid Laga
Publisher: John Wiley & Sons
Total Pages: 374
Release: 2018-12-14
Genre: Mathematics
ISBN: 111940519X

An in-depth description of the state-of-the-art of 3D shape analysis techniques and their applications This book discusses the different topics that come under the title of "3D shape analysis". It covers the theoretical foundations and the major solutions that have been presented in the literature. It also establishes links between solutions proposed by different communities that studied 3D shape, such as mathematics and statistics, medical imaging, computer vision, and computer graphics. The first part of 3D Shape Analysis: Fundamentals, Theory, and Applications provides a review of the background concepts such as methods for the acquisition and representation of 3D geometries, and the fundamentals of geometry and topology. It specifically covers stereo matching, structured light, and intrinsic vs. extrinsic properties of shape. Parts 2 and 3 present a range of mathematical and algorithmic tools (which are used for e.g., global descriptors, keypoint detectors, local feature descriptors, and algorithms) that are commonly used for the detection, registration, recognition, classification, and retrieval of 3D objects. Both also place strong emphasis on recent techniques motivated by the spread of commodity devices for 3D acquisition. Part 4 demonstrates the use of these techniques in a selection of 3D shape analysis applications. It covers 3D face recognition, object recognition in 3D scenes, and 3D shape retrieval. It also discusses examples of semantic applications and cross domain 3D retrieval, i.e. how to retrieve 3D models using various types of modalities, e.g. sketches and/or images. The book concludes with a summary of the main ideas and discussions of the future trends. 3D Shape Analysis: Fundamentals, Theory, and Applications is an excellent reference for graduate students, researchers, and professionals in different fields of mathematics, computer science, and engineering. It is also ideal for courses in computer vision and computer graphics, as well as for those seeking 3D industrial/commercial solutions.

Automatic Reconstruction of Textured 3D Models

Automatic Reconstruction of Textured 3D Models
Author: Pitzer, Benjamin
Publisher: KIT Scientific Publishing
Total Pages: 184
Release: 2015-03-23
Genre: Technology (General)
ISBN: 3866448058

Three dimensional modeling and visualization of environments is an increasingly important problem. This work addresses the problem of automatic 3D reconstruction and we present a system for unsupervised reconstruction of textured 3D models in the context of modeling indoor environments. We present solutions to all aspects of the modeling process and an integrated system for the automatic creation of large scale 3D models.

2D-3D Registration Methods for Computer-assisted Orthopaedic Surgery

2D-3D Registration Methods for Computer-assisted Orthopaedic Surgery
Author: Ren Hui Gong
Publisher:
Total Pages: 346
Release: 2011
Genre:
ISBN:

2D-3D registration is one of the underpinning technologies that enables image-guided intervention in computer-assisted orthopaedic surgery (CAOS). Preoperative 3D images and surgical plans need to be mapped to the patient in the operating room before they can be used to augment the surgical intervention, and this task is generally fulfilled by using 2D-3D registration which spatially aligns a preoperative 3D image to a set of intraoperative fluoroscopic images. The key problem in 2D-3D registration is to define an accurate similarity metric between the 2D and 3D data, and choose an appropriate optimization algorithm. Various similarity metrics and optimization algorithms have been proposed for 2D-3D registration; however, current techniques have several critical limitations. First, a good initial guess - usually within a few millimetres from the true solution - is required, and such capture range is often not wide enough for clinical use. Second, for currently used optimization algorithms, it is difficult to achieve a good balance between the computation efficiency and registration accuracy. Third, most current techniques register a 3D image of a single bone to a set of fluoroscopic images, but in many CAOS procedures, such as a multi-fragment fracture treatment, multiple bone pieces are involved. In this thesis, research has been conducted to investigate the above problems: 1) two new registration techniques are proposed that use recently developed optimization techniques, i.e. Unscented Kalman Filter (UKF) and Covariance Matrix Adaptation Evolution Strategy (CMA-ES), to improve the capture range for the 2D-3D registration problem; 2) a multiple-object 2D-3D registration technique is proposed that simultaneously aligns multiple 3D images of fracture fragments to a set of fluoroscopic images of fracture ensemble; 3) a new method is developed for fast and efficient construction of anatomical atlases; and 4) a new atlas-based multiple-object 2D-3D registration technique is proposed to aid fracture reduction in the absence of preoperative 3D images. Experimental results showed that: 1) by using the new optimization algorithms, the robustness against noise and outliers was improved, and the registrations could be performed more efficiently; 2) the simultaneous registration of multiple bone fragments could achieve a clinically acceptable global alignment among all objects with reasonable computation cost; and 3) the new atlas construction method could construct and update intensity atlases accurately and efficiently; and 4) the use of atlas in multiple-object 2D-3D registration is feasible.