Interobserver agreement between radiologists and radiology residents and emergency physicians in the detection of PE using CTPA



      To assess interobserver agreement between thoracic radiologists, radiology residents, and emergency physicians in diagnosing pulmonary embolism (PE).

      Materials and methods

      Emergency physicians, radiology residents, and thoracic radiologists evaluated 123 computed tomography pulmonary angiography images. Interobserver agreement was analysed using kappa statistics.


      Very good agreements were observed between thoracic radiologists and radiology residents (0.81 and 0.82). Fair and moderate agreements (0.39 and 0.42) were demonstrated between emergency physicians and thoracic radiologists.


      Important differences in interobserver agreement were found, with emergency physicians tending to overdiagnose PE.


      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'


      Subscribe to Clinical Imaging
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect


        • Loud PA
        • Katz DS
        • Bruce DA
        • Klippenstein DL
        • Grossman ZD
        Deep venous thrombosis with suspected pulmonary embolism: detection with combined CT venography and pulmonary angiography.
        Radiology. 2001; 219 ([PubMed: 11323478]): 498-502
        • Hartmann IJ
        • Wittenberg R
        • Schaefer-Prokop C
        Imaging of acute pulmonary embolism using multi-detector CT angiography: an update on imaging technique and interpretation.
        Eur J Radiol. 2010; 74 ([PubMed: 20227213]): 40-49
        • Ghanima W
        • Nielssen BE
        • Holmen LO
        • Witwit A
        • Al-Ashtari A
        • Sandset PM
        Multidetector computed tomography (MDCT) in the diagnosis of pulmonary embolism: interobserver agreement among radiologists with varied levels of experience.
        Acta Radiol. 2007; 48 ([PubMed: 17354136]): 165-170
        • Kim KI
        • Müller NL
        • Mayo JR
        Clinically suspected pulmonary embolism: utility of spiral CT.
        Radiology. 1999; 210 ([PubMed: 10207469]): 693-697
        • Hall WB
        • Truitt SG
        • Scheunemann LP
        • et al.
        The prevalence of clinically relevant incidental findings on chest computed tomographic angiograms ordered to diagnose pulmonary embolism.
        Arch Intern Med. 2009; 169 ([PubMed: 19933956]): 1961-1965
        • Landis JR
        • Koch GG
        An application of hierarchical kappa-type statistics in the assessment of majority agreement among multiple observers.
        Biometrics. 1977; 33 ([PubMed: 884196]): 363-374
        • Schoepf UJ
        • Goldhaber SZ
        • Costello P
        Spiral computed tomography for acute pulmonary embolism.
        Circulation. 2004; 109 ([PubMed: 15136509]): 2160-2167
        • Groth M
        • Henes FO
        • Mayer U
        • Regier M
        • Adam G
        • Begemann PG
        Age-related incidence of pulmonary embolism and additional pathologic findings detected by computed tomography pulmonary angiography.
        Eur J Radiol. 2012; 81 ([PubMed: 21546178]): 1913-1916
        • Sakuma M
        • Nakamura M
        • Nakanishi N
        • et al.
        Diagnostic and therapeutic strategy for acute pulmonary thromboembolism.
        Intern Med. 2006; 45 ([PubMed: 16847363]): 749-758
        • Garg K
        • Sieler H
        • Welsh CH
        • Johnston RJ
        • Russ PD
        Clinical validity of helical CT being interpreted as negative for pulmonary embolism: implications for patient treatment.
        AJR Am J Roentgenol. 1999; 172 ([PubMed: 10350303]): 1627-1631
        • Stein PD
        • Fowler SE
        • Goodman LR
        • et al.
        Multidetector computed tomography for acute pulmonary embolism.
        N Engl J Med. 2006; 354 ([PubMed: 16738268]): 2317-2327
        • Mullins MD
        • Becker DM
        • Hagspiel KD
        • Philbrick JT
        The role of spiral volumetric computed tomography in the diagnosis of pulmonary embolism.
        Arch Intern Med. 2000; 160 ([PubMed: 10668830]): 293-298
        • Qanadli SD
        • Hajjam ME
        • Mesurolle B
        • et al.
        Pulmonary embolism detection: prospective evaluation of dual-section helical CT versus selective pulmonary arteriography in 157 patients.
        Radiology. 2000; 217 ([PubMed: 11058644]): 447-455
        • Courtney DM
        • Miller C
        • Smithline H
        • Klekowski N
        • Hogg M
        • Kline JA
        Prospective multicenter assessment of interobserver agreement for radiologist interpretation of multidetector computerized tomographic angiography for pulmonary embolism.
        J Thromb Haemost. 2010; 8 ([PubMed: 20015156]): 533-539
        • Carrier M
        • Righini M
        • Wells PS
        • et al.
        Subsegmental pulmonary embolism diagnosed by computed tomography: incidence and clinical implications. A systematic review and meta-analysis of the management outcome studies.
        J Thromb Haemost. 2010; 8 ([PubMed: 20546118]): 1716-1722
        • Rathbun SW
        • Raskob GE
        • Whitsett TL
        Sensitivity and specificity of helical computed tomography in the diagnosis of pulmonary embolism: a systematic review.
        Ann Intern Med. 2000; 132 ([PubMed: 10651604]): 227-232
        • Costantino G
        • Rusconi A
        • Montano N
        Interobserver agreement in computer tomography readings for pulmonary embolism.
        Am J Emerg Med. 2011; 29 ([PubMed: 20970291]): 119
        • Yavas SA
        • Calisir C
        • Ozkan IR
        The interobserver agreement between residentes and experienced radiologists for detecting pulmonary embolism and DVT with using CT pulmonary angiography and indirect CT venography.
        Korean J Radiol. 2008; 9 ([PubMed: 19039265]): 498-502