Dementia risk in the general population: large-scale external validation of prediction models in the AGES-Reykjavik study

Jet M.J. Vonk; Jacoba P. Greving; Vilmundur Gudnason; Lenore J. Launer; Mirjam I. Geerlings

doi:10.1007/s10654-021-00785-x

Dementia risk in the general population: large-scale external validation of prediction models in the AGES-Reykjavik study

Jet M.J. Vonk^*, Jacoba P. Greving, Vilmundur Gudnason, Lenore J. Launer, Mirjam I. Geerlings

^*Corresponding author for this work

Faculty of Medicine

Research output: Contribution to journal › Article › peer-review

1 Downloads (Pure)

Abstract

We aimed to evaluate the external performance of prediction models for all-cause dementia or AD in the general population, which can aid selection of high-risk individuals for clinical trials and prevention. We identified 17 out of 36 eligible published prognostic models for external validation in the population-based AGES-Reykjavik Study. Predictive performance was assessed with c statistics and calibration plots. All five models with a c statistic >.75 (.76–.81) contained cognitive testing as a predictor, while all models with lower c statistics (.67–.75) did not. Calibration ranged from good to poor across all models, including systematic risk overestimation or overestimation for particularly the highest risk group. Models that overestimate risk may be acceptable for exclusion purposes, but lack the ability to accurately identify individuals at higher dementia risk. Both updating existing models or developing new models aimed at identifying high-risk individuals, as well as more external validation studies of dementia prediction models are warranted.

Original language	English
Pages (from-to)	1025-1041
Number of pages	17
Journal	European Journal of Epidemiology
Volume	36
Issue number	10
Early online date	25 Jul 2021
DOIs	https://doi.org/10.1007/s10654-021-00785-x
Publication status	Published - 25 Jul 2021

Bibliographical note

Funding Information:
The Age, Gene/Environment Susceptibility-Reykjavik Study has been funded by National Institute on Aging contract N01-AG-12100 with contributions from the National Eye Institute; National Institute on Deafness and Other Communication Disorders; National Heart, Lung and Blood Institute; National Institute on Aging Intramural Research Program; Hjartavernd (the Icelandic Heart Association, HHSN271201200022C); and the Althingi (Icelandic Parliament). The authors thank all the study participants and the IHA staff. This work was supported by Alzheimer Nederland Fellowship WE.15-2018-05 (PI: J.M.J. Vonk), Alzheimer Nederland grant WE.03-2017-06 (PI: M.I. Geerlings), National Institute on Aging K99/R00 award K99AG066934 (PI: J.M.J. Vonk), and NWO/ZonMw Veni Grant project number 09150161810017 (PI: J.M.J. Vonk). None of the funders had any role in the design and conduct of the study, the collection, management, analysis, and interpretation of the data, the preparation and writing of the manuscript, or the decision to submit the manuscript for publication.

Publisher Copyright:
© 2021, The Author(s).

Other keywords

Alzheimer’s disease
Dementia
Prognosis
Validation
Predictive Value of Tests
Reproducibility of Results
Humans
Risk Factors
Male
Population Surveillance/methods
Dementia/diagnosis
Female
Risk Assessment/methods
Netherlands/epidemiology

Access to Document

10.1007/s10654-021-00785-x

Vonk2021_Article_DementiaRiskInTheGeneralPopulaFinal published version, 1.88 MBLicence: CC BY

Cite this

@article{ae542b8112864598af83738bb035e0a5,

title = "Dementia risk in the general population: large-scale external validation of prediction models in the AGES-Reykjavik study",

abstract = "We aimed to evaluate the external performance of prediction models for all-cause dementia or AD in the general population, which can aid selection of high-risk individuals for clinical trials and prevention. We identified 17 out of 36 eligible published prognostic models for external validation in the population-based AGES-Reykjavik Study. Predictive performance was assessed with c statistics and calibration plots. All five models with a c statistic >.75 (.76–.81) contained cognitive testing as a predictor, while all models with lower c statistics (.67–.75) did not. Calibration ranged from good to poor across all models, including systematic risk overestimation or overestimation for particularly the highest risk group. Models that overestimate risk may be acceptable for exclusion purposes, but lack the ability to accurately identify individuals at higher dementia risk. Both updating existing models or developing new models aimed at identifying high-risk individuals, as well as more external validation studies of dementia prediction models are warranted.",

keywords = "Alzheimer{\textquoteright}s disease, Dementia, Prognosis, Validation, Predictive Value of Tests, Reproducibility of Results, Humans, Risk Factors, Male, Population Surveillance/methods, Dementia/diagnosis, Female, Risk Assessment/methods, Netherlands/epidemiology",

author = "Vonk, {Jet M.J.} and Greving, {Jacoba P.} and Vilmundur Gudnason and Launer, {Lenore J.} and Geerlings, {Mirjam I.}",

note = "Funding Information: The Age, Gene/Environment Susceptibility-Reykjavik Study has been funded by National Institute on Aging contract N01-AG-12100 with contributions from the National Eye Institute; National Institute on Deafness and Other Communication Disorders; National Heart, Lung and Blood Institute; National Institute on Aging Intramural Research Program; Hjartavernd (the Icelandic Heart Association, HHSN271201200022C); and the Althingi (Icelandic Parliament). The authors thank all the study participants and the IHA staff. This work was supported by Alzheimer Nederland Fellowship WE.15-2018-05 (PI: J.M.J. Vonk), Alzheimer Nederland grant WE.03-2017-06 (PI: M.I. Geerlings), National Institute on Aging K99/R00 award K99AG066934 (PI: J.M.J. Vonk), and NWO/ZonMw Veni Grant project number 09150161810017 (PI: J.M.J. Vonk). None of the funders had any role in the design and conduct of the study, the collection, management, analysis, and interpretation of the data, the preparation and writing of the manuscript, or the decision to submit the manuscript for publication. Publisher Copyright: {\textcopyright} 2021, The Author(s).",

year = "2021",

month = jul,

day = "25",

doi = "10.1007/s10654-021-00785-x",

language = "English",

volume = "36",

pages = "1025--1041",

journal = "European Journal of Epidemiology",

issn = "0393-2990",

publisher = "Springer Netherlands",

number = "10",

}

TY - JOUR

T1 - Dementia risk in the general population

T2 - large-scale external validation of prediction models in the AGES-Reykjavik study

AU - Vonk, Jet M.J.

AU - Greving, Jacoba P.

AU - Gudnason, Vilmundur

AU - Launer, Lenore J.

AU - Geerlings, Mirjam I.

N1 - Funding Information: The Age, Gene/Environment Susceptibility-Reykjavik Study has been funded by National Institute on Aging contract N01-AG-12100 with contributions from the National Eye Institute; National Institute on Deafness and Other Communication Disorders; National Heart, Lung and Blood Institute; National Institute on Aging Intramural Research Program; Hjartavernd (the Icelandic Heart Association, HHSN271201200022C); and the Althingi (Icelandic Parliament). The authors thank all the study participants and the IHA staff. This work was supported by Alzheimer Nederland Fellowship WE.15-2018-05 (PI: J.M.J. Vonk), Alzheimer Nederland grant WE.03-2017-06 (PI: M.I. Geerlings), National Institute on Aging K99/R00 award K99AG066934 (PI: J.M.J. Vonk), and NWO/ZonMw Veni Grant project number 09150161810017 (PI: J.M.J. Vonk). None of the funders had any role in the design and conduct of the study, the collection, management, analysis, and interpretation of the data, the preparation and writing of the manuscript, or the decision to submit the manuscript for publication. Publisher Copyright: © 2021, The Author(s).

PY - 2021/7/25

Y1 - 2021/7/25

N2 - We aimed to evaluate the external performance of prediction models for all-cause dementia or AD in the general population, which can aid selection of high-risk individuals for clinical trials and prevention. We identified 17 out of 36 eligible published prognostic models for external validation in the population-based AGES-Reykjavik Study. Predictive performance was assessed with c statistics and calibration plots. All five models with a c statistic >.75 (.76–.81) contained cognitive testing as a predictor, while all models with lower c statistics (.67–.75) did not. Calibration ranged from good to poor across all models, including systematic risk overestimation or overestimation for particularly the highest risk group. Models that overestimate risk may be acceptable for exclusion purposes, but lack the ability to accurately identify individuals at higher dementia risk. Both updating existing models or developing new models aimed at identifying high-risk individuals, as well as more external validation studies of dementia prediction models are warranted.

AB - We aimed to evaluate the external performance of prediction models for all-cause dementia or AD in the general population, which can aid selection of high-risk individuals for clinical trials and prevention. We identified 17 out of 36 eligible published prognostic models for external validation in the population-based AGES-Reykjavik Study. Predictive performance was assessed with c statistics and calibration plots. All five models with a c statistic >.75 (.76–.81) contained cognitive testing as a predictor, while all models with lower c statistics (.67–.75) did not. Calibration ranged from good to poor across all models, including systematic risk overestimation or overestimation for particularly the highest risk group. Models that overestimate risk may be acceptable for exclusion purposes, but lack the ability to accurately identify individuals at higher dementia risk. Both updating existing models or developing new models aimed at identifying high-risk individuals, as well as more external validation studies of dementia prediction models are warranted.

KW - Alzheimer’s disease

KW - Dementia

KW - Prognosis

KW - Validation

KW - Predictive Value of Tests

KW - Reproducibility of Results

KW - Humans

KW - Risk Factors

KW - Male

KW - Population Surveillance/methods

KW - Dementia/diagnosis

KW - Female

KW - Risk Assessment/methods

KW - Netherlands/epidemiology

UR - http://www.scopus.com/inward/record.url?scp=85111097186&partnerID=8YFLogxK

U2 - 10.1007/s10654-021-00785-x

DO - 10.1007/s10654-021-00785-x

M3 - Article

C2 - 34308533

AN - SCOPUS:85111097186

SN - 0393-2990

VL - 36

SP - 1025

EP - 1041

JO - European Journal of Epidemiology

JF - European Journal of Epidemiology

IS - 10

ER -

Dementia risk in the general population: large-scale external validation of prediction models in the AGES-Reykjavik study

Abstract

Bibliographical note

Other keywords

Access to Document

Fingerprint

Cite this