Author | Hirschfeld, Gerrit | |
Author | Brasil, Pedro Emmanuel Alvarenga Americano do | |
Access date | 2015-06-11T15:57:02Z | |
Available date | 2015-06-11T15:57:02Z | |
Document date | 2014 | |
Citation | HIRSCHFELD, Gerrit; PEDRO, Emmanuel Alvarenga Americano do Brasil. A simulation study into the performance of ‘‘optimal’’ diagnostic thresholds in the population: ‘‘large’’ effect sizes are not enough. Journal of Clinical Epidemiology, v.67, n.4, p.449–453, 2014. | pt_BR |
ISSN | 0895-4356 | |
URI | https://www.arca.fiocruz.br/handle/icict/10792 | |
Language | eng | pt_BR |
Publisher | Elsevier | pt_BR |
Rights | restricted access | pt_BR |
Title | A simulation study into the performance of ‘‘optimal’’ diagnostic thresholds in the population: ‘‘large’’ effect sizes are not enough | pt_BR |
Type | Article | |
DOI | 10.1016/j.jclinepi.2013.07.018 | |
Abstract | Objectives: Many diagnostic studies are aimed at defining ‘‘optimal’’ thresholds. Here, we evaluate the performance of empirically
defined optimal thresholds (1) in the sample in which they were defined and (2) in the population from which the sample was drawn.
Study Design and Setting: We simulated test results for 120,000 samples varying the number of people without a disease (n between
20 and 500), number of people with a disease (m between 20 and 500), the magnitude of the difference between group means [effect size
(ES) between 0.5 and 4], and distributions (normal and log-normal). The thresholds associated with the maximal Youden index were
defined as optimal. Performance was defined as the percentage of correct classifications in the sample and when applied to the whole
population.
Results: At the population level, the thresholds defined for the four ESs (0.5, 0.8, 2, and 4) yielded a median of 59%, 65%, 83%, and
97% correct classifications, respectively. At the sample level, the samples with similar characteristics yielded widely varying estimates of
the performance that were systematically higher than at the population level.
Conclusion: Researchers need to be careful defining cut points for mean differences that are traditionally considered ‘‘large’’
(ES 5 0.8). The diagnostic utility of optimal thresholds needs to be assessed in prospective studies. 2014 Elsevier Inc. All rights
reserved. | pt_BR |
Affilliation | Children’s Hospital. German Pediatric Pain Center. Datteln, Germany / Witten/Herdecke University. Children’s Pain Therapy and Paediatric Palliative Care. Datteln, Germany | pt_BR |
Affilliation | Fundação Oswaldo Cruz. Instituto Nacional de Infectologia Evandro Chagas. Laboratório de Pesquisa Clínica em Doença de Chagas. Rio de Janeiro, RJ, Brasil | pt_BR |
Subject | Sensitivity and Specificity | pt_BR |
Subject | Diagnostic Techniques and Procedures | pt_BR |
Subject | Epidemiologic Research Design | pt_BR |
Subject | Computer Simulation | pt_BR |
DeCS | Sensibilidade e Especificidade | pt_BR |
DeCS | Técnicas e Procedimentos Diagnósticos | pt_BR |
DeCS | Projetos de Pesquisa Epidemiológica | pt_BR |
DeCS | Simulação por Computador | pt_BR |
e-ISSN | 1878-5921 | |