---
title: "Benchmark Tasks"
author: "Jenna Reps, Ross Williams, Peter R. Rijnbeek"
date: '`r Sys.Date()`'
output: rmarkdown::html_vignette
---

```{=html}
<!--
%\VignetteEngine{knitr::rmarkdown}
%\VignetteIndexEntry{Benchmark Tasks}
%\VignetteEncoding{UTF-8}
-->
```
## Benchmark Tasks For Large-Scale Empirical Analyses

Here we provide a set of diverse prediction tasks that can be used when evaluating the impact of the model design choice when developing models using observational data.

+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------+------+
| Target Cohort (index)                                                                                                                                                                                                                                                                                                                                                                                                                                                                         | Outcome                                                                                                                                                 | Time-at-risk                | Link |
+===============================================================================================================================================================================================================================================================================================================================================================================================================================================================================================+=========================================================================================================================================================+=============================+======+
| Patients with an outpatient visit in 2017 with no prior cancer (first visit in 2017)                                                                                                                                                                                                                                                                                                                                                                                                          | Lung cancer                                                                                                                                             | 1 day - 3 years after index |      |
+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------+------+
| Patients newly diagnosed with major depressive disorder (date of first record)                                                                                                                                                                                                                                                                                                                                                                                                                | Bipolar                                                                                                                                                 | 1 day - 365 day after index |      |
+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------+------+
| Patients with an outpatient visit in 2019                                                                                                                                                                                                                                                                                                                                                                                                                                                     | Dementia                                                                                                                                                | 1 day - 3 years after index |      |
+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------+------+
| Patients with an outpatient visit and a positive COVID test                                                                                                                                                                                                                                                                                                                                                                                                                                   | Hospitalization with pneumonia                                                                                                                          | 1 day - 30 days after index |      |
+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------+------+
| Patients with an outpatient visit and a positive COVID test                                                                                                                                                                                                                                                                                                                                                                                                                                   | Hospitalization with pneumonia that required intensive services (ventilation, intubation, tracheotomy, or extracorporeal membrane oxygenation) or death | 1 day - 30 days after index |      |
+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------+------+
| Patients with an outpatient visit and a positive COVID test                                                                                                                                                                                                                                                                                                                                                                                                                                   | Death                                                                                                                                                   | 1 day - 30 days after index |      |
+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------+------+
| Patients with T2DM who were treated with metformin and who became new adult users of one of sulfonylureas, thiazolidinediones, dipeptidyl peptidase-4 inhibitors, glucagon-like peptide-1 receptor agonists, or sodium-glucose co-transporter-2 inhibitors (date of secondary drug). Patients with HF or patients treated with insulin on or prior to the index date were excluded from the analysis. Patients were required to have been enrolled for at least 365 days before cohort entry. | Heart Failure                                                                                                                                           | 1 to 365 days               |      |
+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------+------+
| Patients newly diagnosed with atrial fibrilation (date of initial afib record)                                                                                                                                                                                                                                                                                                                                                                                                                | Ischemic stroke                                                                                                                                         | 1 to 365 days               |      |
+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------+------+
| Patients undergoing elective major non-cardiac surgery (date of surgery). Patients were required to have been enrolled for at least 365 days before cohort entry.                                                                                                                                                                                                                                                                                                                             | Earliest of AMI cardiac arrest or death (MACE)                                                                                                          | O to 30 days                |      |
+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------+------+
| Patients starting intravitreal Anti-VEGF (date of administration)                                                                                                                                                                                                                                                                                                                                                                                                                             | Kidney Failure                                                                                                                                          | 1 to 365 days               |      |
+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------+------+
| Pregnancy women (start of pregnancy)                                                                                                                                                                                                                                                                                                                                                                                                                                                          | Preeclampsia                                                                                                                                            | During pregnancy            |      |
+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------+------+
| Pregnancy women (start of pregnancy)                                                                                                                                                                                                                                                                                                                                                                                                                                                          | Still birth                                                                                                                                             | During pregnancy            |      |
+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------+------+
| Patients with COPD (first record)                                                                                                                                                                                                                                                                                                                                                                                                                                                             | Cardiovascular event and death                                                                                                                          | 1-30 days and 1-90 days     |      |
+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------+------+
| Patients starting menopause (first record)                                                                                                                                                                                                                                                                                                                                                                                                                                                    | Depression                                                                                                                                              | 1 day - 3-years             |      |
+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------+------+
| Patients with anemia (date of first anemia record)                                                                                                                                                                                                                                                                                                                                                                                                                                            | Colorectal cancer                                                                                                                                       | 1 day - 1-year              |      |
+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------+------+
| Patients with quadriplegia (date of first quadriplegia record)                                                                                                                                                                                                                                                                                                                                                                                                                                | Death                                                                                                                                                   | 1 day - 1-year              |      |
+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------+------+
| Patient undergoing                                                                                                                                                                                                                                                                                                                                                                                                                                                                            |                                                                                                                                                         |                             |      |
+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------+------+
|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               |                                                                                                                                                         |                             |      |
+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------+------+

.
