Measuring, Interobserver Disagreement in Rating Diagnostic Characteristics of Pulmonary Nodule Using the Lung Imaging Database Consortium and Image Database Resource Initiative

作者：Lin, Hongli^*; Huang, Changxing; Wang, Weisheng; Luo, Jiawei; Yang, Xuedong; Liu, Yuling

来源：Academic Radiology, 2017, 24(4): 401-410.

DOI：10.1016/j.acra.2016.11.022

• LIDC/IDRI Database
• pulmonary nodule
• Interobserver disagreement
• CT

Rationale and Objectives: The purpose of this study was to measure and analyze interobserver disagreement in rating diagnostic characteristics of pulmonary nodules on computed tomography scans using the Lung Imaging Database Consortium and Image Database Resource Initiative (LIDC/IDRI) database, and then to provide investigators with understanding the variability in rating diagnostic characteristics among radiologists. @@@ Materials and Methods: A histogram-based accumulated nodule-level approach is proposed to Measure interobserver disagreement in rating diagnostic characteristics of pulmonary nodules among radiologists. The mean rating differences of radiologists on nodule level are calculated; next, a histogram of the accumulated nodule-level disagreements is constructed; and finally, mean,,variance, skewness, and kurtosis statistics based on the histogram are extracted to analyze and summary interobserver disagreement in terms of the assessment of diagnostic characteristics of radiologists. Using the developed computer scheme, the disagreement of radiologists in rating all of 1880 distinct nodules from 1018 computed tomography scans are analyzed using original ratings as well as combined ratings according to the LIDC/IDRI instruction. @@@ Results: The interobserver disagreement in rating diagnostic characteristics according to the defined categories of the LIDC/IDRI is substantial. The mean values of disagreement range from 0.0052 to 0.2341. The highest disagreement lies in rating subtlety charateristics, whereas internal Structure-receives the lowest disagreement of 0:0052: The-calcification, texture, spiculation, lobulation, malignancy, sphericity, and margin receive disagreements of 0.0393, 0.1351, 0.1616, 0.1943, 0.2144, 0.2174, and 0.2228, respectively. @@@ Conclusions: Disagreements exist across radiologists in rating diagnostic characteristics of pulmonary nodules; and the disagreement levels vary from each-other. Agreement among radiologists is-improved by combining ratings according to the LIDC/IDRI instruction. For investigators, understanding and appreciating the disagreement level of each diagnostic;characteristic is required when using them in related researches.

• 出版日期2017-4
• 单位湖南大学