Bivariate random-effects models represent an established approach for meta-analysis of accuracy measures of a diagnostic test, which are typically given by sensitivity and specificity. A recent formulation of the classical model describes the test accuracy in terms of study-specific Receiver Operating Characteristics curves. In this way, the resulting summary curve can be thought of as an average of the study-specific Receiver Operating Characteristics curves. Within this framework, the paper shows that the standard likelihood approach for inference is prone to several issues. Small sample size can give rise to unreliable conclusions and convergence problems deeply affect the analysis. The proposed alternative is a simulation-extrapolation method, called SIMEX, developed within the measurement error literature. It suits the meta-analysis framework, as the accuracy measures provided by the studies are estimates rather than true values, and thus are prone to error. The methods are compared in a series of simulation studies, covering different scenarios of interest, including deviations from normality assumptions. SIMEX reveals a satisfactory strategy, providing more accurate inferential results if compared to the likelihood approach, while avoiding convergence failure. The approaches are applied to a meta-analysis of the accuracy of the ultrasound exam for diagnosing abdominal tuberculosis in HIV-positive subjects.

A SIMEX approach for meta-analysis of diagnostic accuracy studies with attention to ROC curves

Guolo, Annamaria
;
Pesantez Cabrera, Tania Erika
2023

Abstract

Bivariate random-effects models represent an established approach for meta-analysis of accuracy measures of a diagnostic test, which are typically given by sensitivity and specificity. A recent formulation of the classical model describes the test accuracy in terms of study-specific Receiver Operating Characteristics curves. In this way, the resulting summary curve can be thought of as an average of the study-specific Receiver Operating Characteristics curves. Within this framework, the paper shows that the standard likelihood approach for inference is prone to several issues. Small sample size can give rise to unreliable conclusions and convergence problems deeply affect the analysis. The proposed alternative is a simulation-extrapolation method, called SIMEX, developed within the measurement error literature. It suits the meta-analysis framework, as the accuracy measures provided by the studies are estimates rather than true values, and thus are prone to error. The methods are compared in a series of simulation studies, covering different scenarios of interest, including deviations from normality assumptions. SIMEX reveals a satisfactory strategy, providing more accurate inferential results if compared to the likelihood approach, while avoiding convergence failure. The approaches are applied to a meta-analysis of the accuracy of the ultrasound exam for diagnosing abdominal tuberculosis in HIV-positive subjects.
File in questo prodotto:
File Dimensione Formato  
10.1515_ijb-2022-0012.pdf

accesso aperto

Tipologia: Published (publisher's version)
Licenza: Creative commons
Dimensione 767.08 kB
Formato Adobe PDF
767.08 kB Adobe PDF Visualizza/Apri
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11577/3460724
Citazioni
  • ???jsp.display-item.citation.pmc??? 0
  • Scopus 0
  • ???jsp.display-item.citation.isi??? 0
social impact