Seminars in Nuclear Medicine
Volume 33, Issue 3 , Pages 219-227 , July 2003

Display of fused images: Methods, interpretation, and diagnostic improvements

References 

  1. Van den Elsen PA. Multimodality matching of brain images. Doctoral thesis Utrecht University, the Netherlands; 1993;
  2. Levoy M. A hybrid ray tracer for rendering polygon and volume data. IEEE Comput Graph. 1990;10:33–40
  3. Stokking R, Zuiderveld KJ, Hulshoff Pol HE, et al.  Integrated visualization of SPECT and MR images for frontal lobe damaged regions. In:  Robb RA editors. Visualization in Biomedical Computing (Vol 2359). Bellingham WA: SPIE Press; 1994;p. 282–290
  4. Evans AC, Marrett TS, Torrescorzo J, et al.  MRI-PET correlation in three dimensions using a volume-of-interest (VOI) atlas. J Cerebr Blood F Met. 1991;11(suppl 1):A69–A78
  5. Zubal IG, Spencer SS, Imam K, et al.  Difference images calculated from ictal and interictal technetium-99mHMPAO SPECT scans of epilepsy. J Nucl Med. 1995;36:684–689
  6. Levin DN, Hu X, Tan KK, et al.  The brain: Integrated three-dimensional display of MR and PET images. Radiology. 1989;172:783–789
  7. Viergever MA, van den Elsen PA, Stokking R. Integrated presentation of multimodal brain images. Brain Topogr. 1992;5:135–145
  8. Britton K. Highlights of the annual meeting of the European Association of Nuclear Medicine, Lausanne 1994. Eur J Nucl Med. 1994;21:159–169
  9. Hawkes DJ, Hill DLG, Lehmann ED, et al.  Preliminary work on the interpretation of SPECT images with the aid of registered MR images and an MR derived 3D neuroanatomical atlas. In:  Höhne KH,  Fuchs H,  Pizer S editor. 3D Imaging in Medicine. Berlin: Springer-Verlag; 1990;p. 242–251
  10. Hill DLG, Hawkes DJ, Crossman JE, et al.  Registration of MR and CT images for skull base surgery using point-like anatomical features. Brit J Radiol. 1991;64:1030–1035
  11. Holman BL, Zimmerman RE, Johnson KA, et al.  Computer-assisted superimposition of magnetic resonance and high-resolution technetium-99mHMPAO and thallium-201 SPECT images of the brain. J Nucl Med. 1991;32:1478–1485
  12. Drevets W, Videen T, MacLeod A, et al.  PET images of blood flow changes during anxiety: Correction. Science. 1992;256:1696
  13. Hill DLG, Hawkes DJ, Hussain Z, et al.  Accurate combination of CT and MR data of the head: validation and applications in surgical and therapy planning. Comput Med Imaging Graph. 1993;17:357–363
  14. Chisin R, Pietrzyk U, Sichel J-Y, et al.  Registration and display of multimodal images: Applications in the extracranial head and neck region. J Otolaryngol. 1993;22:214–219
  15. Heiss W-D, Herholz K. Assessment of pathophysiology of stroke by positron emission tomography. Eur J Nucl Med. 1994;21:455–465
  16. Hemler P, Napel S, Sumanaweera TS, et al.  Registration error quantification of a surface based multimodality image fusion system. Med Phys. 1995;22:1049–1056
  17. Pietrzyk U, Herholz K, Schuster A, et al.  Clinical applications of registration and fusion of multimodality brain images from PET, SPECT, CT, and MRI. Eur J Radiol. 1996;21:174–182
  18. Vansteenkiste JF, Stroobants SG, Dupont PJ, et al.  FDG-PET scan in potentially operable non-small cell lung cancer: Do anatometabolic PET-CT fusion images improve the localisation of regional lymph node metastases?. Eur J Nucl Med. 1998;25:1495–1501
  19. Beyer T, Townsend DW, Brun T, et al.  A combined PET/CT scanner for clinical oncology. J Nucl Med. 2000;41:1369–1379
  20. Barnden L, Kwiatek R, Lau Y, et al.  Validation of fully automatic brain SPET to MR co-registration. Eur J Nucl Med. 2000;27:147–154
  21. Juengling FD, Kassubek J, Högerle S, et al.  SMARTPET: Multimodality white matter imaging and display without loss of quantitative information. J Magn Reson Imaging. 2002;15:456–461
  22. Pelizzari CA, Chen GTY, Spelbring DR, et al.  Accurate three-dimensional registration of CT, PET, and/or MR images of the brain. J Comput Assist Tomo. 1989;13:20–26
  23. Viergever MA, Maintz JBA, Stokking R. Integration of functional and anatomical brain images. Biophys Chem. 1997;68:207–219
  24. Rehm K, Strother SC, Anderson JR, et al.  Display of merged multimodality brain images using interleaved pixels with independent color scales. J Nucl Med. 1994;35:1815–1821
  25. Quarantelli M, Alfano B, Larobina M, et al.  Frequency encoding for simultaneous display of multimodality images. J Nucl Med. 1999;40:442–447
  26. Weiss KL, Stiving SO, Herderick EE, et al.  Hybrid color MR imaging display. Am J Roentgenol. 1987;149:825–829
  27. Levin DN, Pelizzari CA, Chen GTY, et al.  Retrospective geometric correlation of MR, CT, and PET images. Radiology. 1988;169:817–823
  28. Kamman RL, Stomp GP, Berendsen HJC. Unified multiple-feature color display for MR images. Magn Reson Med. 1989;9:240–253
  29. Brown HK, Hazelton TR, Silbiger ML. Generation of color composites for enhanced tissue differentiation in Magnetic Resonance Imaging of the brain. Am J Anat. 1991;192:23–34
  30. Lang TF, Hasegawa BH, Liew SC, et al.  Description of a prototype emission-transmission Computer Tomography imaging system. J Nucl Med. 1992;33:1881–1887
  31. Ricard M, Tenenbaum F, Schlumberger M, et al.  Intraoperative detection of pheochromocytoma with iodine-125 labelled meta-iodobenzylguanidine: A feasibility study. Eur J Nucl Med. 1993;20:426–430
  32. Sgouros G, Chiu S, Pentlow KS, et al.  Three-dimensional dosimetry for radioimmunotherapy treatment planning. J Nucl Med. 1993;34:1595–1601
  33. Wahl RL, Quint LE, Cieslak RD, et al.  “Anatometabolic” tumor imaging: Fusion of FDG PET with CT or MRI to localize foci of increased activity. J Nucl Med. 1993;34:1190–1197
  34. Van Herk M, Kooy HM. Automatic three-dimensional correlation of CT-CT, CT-MRI, and CT-SPECT using chamfer matching. Med Phys. 1994;7:1163–1178
  35. Scott AM, Macapinlac HA, Divgi CR, et al.  Clinical validation of SPECT and CT/MRI image registration in radiolabeled monoclonal antibody studies of colorectal carcinoma. J Nucl Med. 1994;35:1976–1984
  36. Tjuvajev JG, Macapinlac HA, Daghighian F, et al.  Imaging of brain tumor proliferative activity with iodine131-iododeoxyuridine. J Nucl Med. 1994;35:1407–1417
  37. Alfano B, Brunetti A, Arpaia M, et al.  Multiparametric display of spin-echo data from MR studies of brain. J Magn Reson Imaging. 1995;5:217–225
  38. Soltys M, Beard DV, Carrasco V, et al.  FUSION: A tool for registration and visualization of multiple modality 3D medical data. In:  Loew MH editors. Medical Imaging: Image Processing. vol 2434:Bellingham, WA: SPIE Press; 1995;p. 74–80
  39. Wong JC, Studholme C, Hawkes DJ, et al.  Evaluation of the limits of visual detection of image misregistration in a brain fluorine-18 fluorodeoxyglucose PET-MRI study. Eur J Nucl Med. 1997;24:642–650
  40. Hawkes DJ. Algorithms for radiological image registration and their clinical application. J Anat. 1998;193:347–361
  41. Patton JA, Delbeke D, Sandler MP. Image fusion using an integrated, dualhead coincidence camera with X-ray tube-based attenuation maps. J Nucl Med. 2000;41:1364–1368
  42. Callen DJ, Black SE, Caldwell CB. Limbic system perfusion in Alzheimer's disease measured by MRI-coregistered HMPAO SPECT. Eur J Nucl Med. 2002;29:899–906
  43. Alfano B, Brunetti A, Ciarmiello A, et al.  Simultaneous display of multiple MR parameters with quantitative magnetic color imaging. J Comput Assist Tomo. 1992;16:634–640
  44. Chen C-T, Pelizzari CA, Chen GTY, et al.  Image analysis of PET data with the aid of CT and MR images. In:  de Graaf CN,  Viergever MA editor. Information Processing in Medical Imaging. Planum Press; 1987;p. 601–611
  45. Stokking R, Zuiderveld KJ, Viergever MA. Integrated volume visualization of functional image data and anatomical surfaces using Normal Fusion. Hum Brain Map. 2001;12:203–218
  46. Habboush IH, Mitchell KD, Mulkern RV, et al.  Registration and alignment of three-dimensional images: An interactive visual approach. Radiology. 1996;199:573–578
  47. Zifko GA, Slomka PJ, Young GB, et al.  Brain mapping of median nerve somatosensory evoked potentials with combined 99mTcECD single-photon emission tomography and magnetic resonance imaging. Eur J Nucl Med. 1996;23:579–582
  48. Roolker W, van Buul MT, Broekhuizen A, et al.  Improved wrist fracture localization with digital overlay of bone scintigrams and radiographs. J Nucl Med. 1997;38:1600–1603
  49. Skalski J, Wahl RL, Meyer CR. Comparison of mutual information based warping accuracy for fusing body CT and PET by 2 methods: CT mapped onto PET emission scan versus CT mapped onto PET transmission scan. J Nucl Med. 2002;43:1184–1187
  50. Zhang J, Levesque MF, Wilson CL, et al.  Multimodality imaging of brain structures for stereotactic surgery. Radiology. 1990;175:435–441
  51. Kapouleas I, Alavi A, Alves WM, et al.  Registration of three-dimensional MR and PET images of the human brain without markers. Radiology. 1991;181:731–739
  52. Maguire GQ, Noz M, Rusinek H, et al.  Graphics applied to medical image registration. IEEE Comp Graph Appl. 1991;11:20–28
  53. Evans AC. Correlative imaging. In:  Wagner HJ,  Szabo Z,  Buchanan JW editor. Principles of Nuclear Medicine. Philadelphia: WB Saunders Co; 1995;p. 405–421
  54. Matsuda H, Tsuji S, Shuke N, et al.  Noninvasive measurements of regional cerebral blood flow using technetium-99m hexamethylprophylene amine oxime. Eur J Nucl Med. 1993;20:391–401
  55. Gandhe AJ, Hill DL, Studholme C, et al.  Combined and three-dimensional rendered multimodal data for planning cranial base surgery: A prospective evaluation. Neurosurgery. 1994;35:463–471
  56. Koral KF, Zasadny KR, Kessler ML, et al.  CT-SPECT fusion plus conjugate views for determining dosimetry in iodine-131-monoclonal antibody therapy of lymphoma patients. J Nucl Med. 1994;35:1714–1720
  57. Mangin J-F, Frouin V, Bloch I, et al.  Fast nonsupervised 3D registration of PET and MR images of the brain. J Cerebr Blood F Met. 1994;14:749–762
  58. Andersson JLR, Thurfjell LA. Multivariate approach to registration of dissimilar tomographic images. Eur J Nucl Med. 1999;26:718–733
  59. Vera P, Kaminska A, Cieuta C, et al.  Use of subtraction ictal SPECT coregistered to MRI for optimizing the localization of seizure foci in children. J Nucl Med. 1999;40:786–792
  60. Jannin P, Fleig O, Seigneuret E, et al.  A data fusion environment for multimodal and multi-informational neuronavigation. Comp Aided Surg. 2000;5:1–10
  61. Lewis PJ, Siegel A, Siegel AM, et al.  Does performing image registration and subtraction in ictal brain SPECT help localize neocortical seizures. J Nucl Med. 2000;41:1619–1626
  62. Graham MM, Muzi M, Spence AM, et al.  The FDG lumped constant in normal human brain. J Nucl Med. 2002;43:1157–1166
  63. Lee DS, Lee SK, Kim YK, et al.  The usefulness of repeated ictal SPET for the localization of epileptogenic zones in intractable epilepsy. Eur J Nucl Med. 2002;29:607–614
  64. Faber TL, McColl RW, Opperman RM, et al.  Spatial and temporal registration of cardiac SPECT and MR images: Methods and evaluation. Radiology. 1991;179:857–861
  65. Liehn J-C, Loboguerrero A, Pérault C, et al.  Superimposition of computed tomography and single photon emission tomography immunoscintigraphic images in the pelvis: Validation in patients with colorectal or ovarian carcinoma recurrence. Eur J Nucl Med. 1992;19:186–194
  66. Pérault C, Schvartz C, Wampach H, et al.  Thoracic and abdominal SPECT-CT image fusion without external markers in endocrine carcinomas. J Nucl Med. 1997;38:1234–1242
  67. Hamilton RJ, Blend MJ, Pelizzari CA, et al.  Using vascular structure for CT-SPECT registration in the pelvis. J Nucl Med. 1999;40:347–351
  68. Pfluger T, Vollmar C, Wismüler A, et al.  Quantitative comparison of automatic and interactive methods for MRI-SPECT image registration of the brain based on 3- dimensional calculation of error. J Nucl Med. 2000;41:1823–1829
  69. Hu X, Tan KK, Levin DN, et al.  A volume rendering technique for integrated three-dimensional display of MR and PET data. In:  Höhne KH,  Fuchs H,  Pizer SM editor. 3D Imaging in Medicine. Berlin: Springer-Verlag; 1990;p. 379–397
  70. Wallis JW. Three-dimensional display in SPECT imaging: Principles and applications. In:  Reiber JHC,  van der Wall EE editor. Cardiovascular Nuclear Medicine and MRI, 89-100. Dordrecht: the Netherlands: Kluwer Academic Publishers; 1992;p. 89–100
  71. Stimac GK, Sundsten JW, Prothero JS, et al.  Three dimensional contour surfacing of the skull, face, and brain from CT and MR images and from anatomic sections. Am J Roentgenol. 1988;151:807–810
  72. Wowra B, Schad L, Schlegel W, et al.  Scopes of computer application in stereotactic neurosurgery. In:  Lemke HU,  Rhodes M,  Jaffe C, et al. editor. Computer Assisted Radiology. Berlin: Springer-Verlag; 1989;p. 296–301
  73. Ehricke H-H, Laub G. Combined 3D-display of cerebral vasculature and neuroanatomic structures in MRI. In:  Höhne KH,  Fuchs H,  Pizer SM editor. 3D Imaging in Medicine. Berlin: Springer-Verlag; 1990;p. 229–239
  74. Evans AC, Collins DL, Neelin P, et al.  Computer-integrated surgery. In:  Taylor RH,  Lavallée S,  Burdea GC, et al. editor. Correlative Analysis of Three-Dimensional Brain Images. Cambridge: MIT Press; 1996;p. 99–114
  75. Parsai EI, Ayyanger KM, Dobelbower RR, et al.  Clinical fusion of three-dimensional images using Bremsstrahlung SPECT and CT. J Nucl Med. 1997;38:319–324
  76. Gering DT, Nabavi A, Kikinis R, et al.  An integrated visualization system for surgical planning and guidance using image fusion and an open MR. J Magn Reson Imaging. 2001;13:967–975
  77. Van den Elsen PA, Viergever MA, van Huffelen AC, et al.  Accurate matching of electromagnetic dipole data with CT and MR images. Brain Topogr. 1991;3:425–432
  78. Schiers C, Tiede U, Höhne KH. Interactive 3D registration of image volumes from different sources. In:  Lemke HU,  Rhodes M,  Jaffe C, et al. editor. Computer Assisted Radiology. Berlin: Springer-Verlag; 1989;p. 666–670
  79. Payne BA, Toga AW. Surface mapping brain function on 3D models. IEEE Comput Graph. 1990;10:33–41
  80. Valentino DJ, Mazziotta JC, Huang H. Volume rendering of multimodal images: Application to MRI and PET imaging of the human brain. IEEE T Med Imaging. 1991;10:554–562
  81. Stokking R, Zuiderveld KJ, Hulshoff Pol HE, et al.  Normal Fusion for three-dimensional integrated visualization of SPECT and magnetic resonance brain images. J Nucl Med. 1997;38:624–629
  82. von Stockhausen H-M. 3D-visualisierung der Funktion und der Morphologie des menslichen Gehirns aus tomographischen Daten. Doctoral thesis University of Cologne, Germany; 1998;
  83. Avery RA, Spencer SS, Studholme CS, et al.  Reproducibility of serial peri-ictal single-photon emission tomography difference images in epilepsy patients undergoing surgical resection. Eur J Nucl Med. 2000;27:50–55
  84. Stokking R, Studholme CS, Spencer SS, et al.  Epilepsy related perfusion changes in the peripheral cortex. J Nucl Med. 2000;41:65P–66P (abstr)
  85. Zubal IG, Avery RA, Stokking R, et al.  Ratio-images calculated from interictal positron emission tomography and single-photon emission computed tomography for quantification of the uncoupling of brain metabolism and perfusion in epilepsy. Epilepsia. 2000;41:1560–1566
  86. Muzik O, da Silva EA, Juhasz C, et al.  Intracranial EEG versus flumazenil and glucose PET in children with extratemporal lobe epilepsy. Neurology. 2000;54:171–178
  87. Holländer I. Mapping the brain cortex using an analytical model of the head. In:  Yongmin K editors. Medical Imaging: Image display. 2431:1995;p. 478–489 Proc SPIE
  88. Stokking R. Integrated visualization of functional and anatomical brain images. Doctoral thesis Utrecht University, the Netherlands; 1998;
  89. Stokking R, van Isselt JW, van Rijk PP, et al.  Integrated visualization of functional and anatomic brain data: A validation study. J Nucl Med. 1999;40:311–316
  90. Pietrzyk U, Herholz K, Heiss W-D. Three-dimensional alignment of functional and morphological tomograms. J Comput Assist Tomogr. 1990;14:51–59
  91. Pietrzyk U, Herholz K, Fink G, et al.  An interactive technique for three-dimensional image registration: Validation for PET, SPECT, MRI and CT brain studies. J Nucl Med. 1994;35:2011–2018
  92. Stokking R, Zubal IG, Viergever MA. Integrated visualization of functional and anatomical brain images. Physica Medica. 2001;17:259–265

 Address reprint requests to Dr. R. Stokking, Medical Informatics and Radiology, Ee2167, Dr. Molewaterplein 50, Erasmus MC, University Medical Center Rotterdam, 3015 GE Rotterdam, The Netherlands.

☆☆ This research was funded in part by the National Institutes of Health, Grant No. R01-S35674.

 0001-2998/03/3303-0015$30.00/0

PII: S0001-2998(03)70007-5

doi: 10.1053/snuc.2003.127311

Seminars in Nuclear Medicine
Volume 33, Issue 3 , Pages 219-227 , July 2003