Signa Vitae. 2023; 19(2): 20-27. doi: 10.22514/sv.2022.025
Original Research

A new simple score to predict mortality of COVID-19 in the emergency department

Marcello Candelli1,*,, Giulia Pignataro1, Marta Sacco Fernandez1, Sara Cicchinelli1, Antonio Gullì1, Enrico Torelli1, Maurizio Gabrielli1, Andrea Piccioni1, Marcello Covino1, Veronica Ojetti1, Massimo Antonelli1, Antonio Gasbarrini2, Francesco Franceschi1

1Emergency, Anesthesiological and Reanimation Sciences Department, Fondazione Policlinico Universitario A. Gemelli-IRRCS-Catholic University of the Sacred Heart of Rome, 00168 Rome, Italy

2Medical and Surgical Sciences Department, Fondazione Policlinico Universitario A. Gemelli-IRRCS-Catholic University of the Sacred Heart of Rome, 00168 Rome, Italy

*Corresponding Author(s):marcello.candelli@policlinicogemelli.it (Marcello Candelli)

History Submitted: 11 December 2021 | Accepted: 16 February 2022 | Published: 08 March 2023
Copyright:  ©2023  The Author(s). Published by MRE Press.
This is an open access article under the CC BY 4.0 license (https://creativecommons.org/licenses/by/4.0/).

Collapse table of contents

Abstract

The severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) pandemic is one of the greatest challenges facing global medical research. The availability of a clinical score that can predict mortality risk at the time of diagnosis could be a valuable tool in the hands of emergency physicians to make clinical decisions. Our study is designed to evaluate clinical and laboratory endpoints associated with mortality and to determine a prognostic score based on clinical and laboratory variables. We retrospectively enrolled 367 patients diagnosed with coronavirus disease 19 (COVID-19) in our emergency department (ED). We evaluated their mortality 60 days after diagnosis. Symptoms, demographic data, concomitant diseases, and various laboratory parameters were obtained from all patients. Variables related to death were assessed using multiple logistic regression analysis. From these, we created a score called ANCOC (Age, blood urea Nitrogen, C-reactive protein, Oxygen saturation, Comorbidities). The area under the receiver operating characteristic (ROC) curve was calculated for the ANCOC and for the 4C score. The 4C score has been described and validated in previous works and can predict mortality in COVID-19 patients. We compared the 2 scores and analysed sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) for 60-day mortality for the ANCOC score. The ANCOC and 4C scores accurately predicted death from COVID-19. There were no differences in accuracy between the scores. An ANCOC score <–1 identified patients who will recover with a PPV and sensitivity of 100%, whereas a score >3 identified patients at high risk of death. The ANCOC score has very high diagnostic accuracy in predicting the risk of death in patients with COVID-19 diagnosed at ED. The ANCOC score has similar accuracy to the 4C score but is easier to calculate. If validated by external cohorts, this score could be an additional tool in the hands of ED physicians to identify COVID-19 patients at high risk of death.

Keywords:COVID-19;Prognostic score;Comorbidity;SARS-CoV-2;Mortality
PDF(4.32 MB)|EndNote (RIS)|BibTeX|RefMan|RefWorks

Cite this article

Marcello Candelli, Giulia Pignataro, Marta Sacco Fernandez, Sara Cicchinelli, Antonio Gullì, Enrico Torelli, Maurizio Gabrielli, Andrea Piccioni, Marcello Covino, Veronica Ojetti, Massimo Antonelli, Antonio Gasbarrini, Francesco Franceschi. A new simple score to predict mortality of COVID-19 in the emergency department. Signa Vitae. 2023; 19(2): 20-27. doi: 10.22514/sv.2022.025

1. Background

COVID-19 represents the most important medical, scientific, and political challenge currently facing the entire world. Although highly effective vaccines are available to prevent infection and mitigate the severity of the disease [1, 2, 3, 4], we are still far from conquering it. Patients with SARS-CoV-2 infection exhibit remarkable clinical variability, ranging from completely asymptomatic forms to severe clinical pictures with respiratory failure and high mortality. The availability of a clinical score that can help emergency physicians interpret the prognosis of patients with COVID-19 in daily practice could be a valuable tool to target available resources to the patients who need them most and to choose the type of therapeutic decision to be made at the time of diagnosis. Several scores have been proposed to assess COVID-19 prognosis. One of the most commonly used scores was the 4C mortality score [5]. It evaluates 8 variables (age, sex, concomitant diseases, respiratory rate, peripheral oxygen saturation, state of consciousness, urea level, and c-reactive protein) and has a range of 0 to 21 points. In the original study, it showed an accuracy of 0.79 in predicting mortality with better performance than other classic prognostic scores such as pneumonia severity index (PSI), confusion, uremia, respiratory rate, blood pressure, and age >65 years (CURB-65), sequential organ failure assessment (SOFA) and national early warning score (NEWS) [6]. The aim of this study is to evaluate the clinical and laboratory parameters associated with increased mortality in patients with SARS-CoV-2 infection, identify a score that can predict COVID-19 outcomes, and compare it with the 4C mortality score.

2. Methods

2.1 Study design

This is a monocentric, observational, and retrospective study.

2.2 Population

We enrolled 367 patients over 17 years of age who presented to the emergency department (ED) of Fondazione Policlinico Gemelli hospital in Rome in March 2020 with SARS-CoV-2 infection confirmed by real-time reverse transcription-polymerase chain reaction (RT-PCR) on oropharyngeal and nasopharyngeal swabs and who consented to data processing and study participation. We excluded patients with COVID-19 infection and other acute diseases affecting prognosis (diseases requiring urgent surgery, time-dependent diseases, acute diseases with the possibility of unfavorable outcome) and patients with chronic diseases with poor prognosis (<60 days).

Patients were divided into the following groups according to their outcome 60 days after admission to ED:

—recovered patients;

—deceased patients.

2.3 Data collection

We collected the following data for each patient:

—demographic data: age, gender, smoking habits, history of chronic disease, medication use, blood type, in-hospital treatment;

—symptoms: arthralgia/arthritis, asthenia, adenopathy/lymphadenitis, headache, myalgia, conjunctivitis, nausea, diarrhea, fever, dyspnea, cough, abdominal pain, rash, pharyngodinia/pharyngitis, vomiting, dys/ageusia, dys/anosmia, rhinorrhea, anorexia;

—laboratory data at ED visit: blood urea nitrogen (BUN), creatinine, sodium, potassium, alanine aminotransferase (ALT), bilirubin, lactate dehydrogenase (LDH), creatine phosphokinase (CPK), platelets, hemoglobin, leukocytes, neutrophils, lymphocytes, d-dimer, international normalized ratio (INR), fibrinogen, C-reactive protein (CRP), procalcitonin (PCT) and n-terminal pro brain natriuretic peptide (NTproBNP).

—in all patients, 60-day mortality data were collected from medical records and/or by telephone.

2.4 Aim of the study

The main objective of the study was to evaluate, in the group of COVID-19 patients, the presence of clinical symptoms and laboratory parameters associated with the outcome of the disease (60-days mortality), and to find a new clinical score that can predict death.

The secondary outcome was to compare the accuracy of this new score with the 4C mortality score in the prediction of mortality in COVID-19 patients.

2.5 Statistical analysis

The software used for statistical analysis is IBM SPSS Statistics for Windows, Version 16.0 (IBM Corp., Armonk, NY, USA). Descriptive statistics were used for data analysis. Numerical values were expressed as % of total and continuous values were expressed as mean ± standard deviation (SD). Clinical symptoms and laboratory data were compared between groups using the chi-square test or the student t-test, where appropriate. Multivariate analysis (multiple logistic regression) was performed for those factors that showed a significance of p < 0.01 in the univariate analysis after adjustment for confounding factors such as sex, age, and comorbidities. A p < 0.05 was considered significant. The factors that remained significantly correlated with death at 60 days on multivariate analysis were included in a prognostic score for which sensitivity, specificity, positive predictive value (PPV), negative predictive valute (NPV), and the best cutoff value were calculated by constructing the receiver operating characteristic (ROC) curve. Based on the higher sensitivity or specificity cutoffs obtained for each significant variable in the multivariate analysis, we construct a prognostic score and evaluate a ROC curve and the area under the curve (AUC) for this score and for the 4C mortality score. Comparison of the area under the receiver operating characteristic (AUROC) curves was performed using the DeLong method.

3. Results

3.1 Characteristics of the patients

367 patients with a mean age of 62.9 ± 15.9 years were included in the study. 234 (63.7%) were men and 133 were women. 162 (58.7%) patients were nonsmokers, 91 (33.0%) were ex-smokers, and 23 (8.3%) were smokers and had a mean of 29.09 ± 29.52 lifetime packs/year. Patients differed in the presence or absence of comorbidities and their number. 127 patients (31.9%) had no comorbidities, 98 (26.7%) had 1 comorbidity, 51 (13.9%) had 2 comorbidities, 31 (8.4%) had 3 comorbidities, 23 (6.3%) had 4 comorbidities, and 8 (2.1%) had more than 4 comorbidities. 116 patients (31.6%) were taking angiotensin receptor blockers (ARBs) or angiotensin converting enzyme inhibitors (ACEi), whereas 232 (63.2%) were not. The most common comorbidities were hypertension, diabetes, ischemic heart disease, heart failure, atrial fibrillation, chronic obstructive pulmonary disease (COPD), chronic lung disease, obesity, active neoplasms, Parkinson’s disease, Alzheimer’s disease, and other chronic diseases (Table 1).

Table 1.Prevalence of comorbidities in enrolled patients (number and percentage).
ComorbidityNumber (%)
Hypertension156 (42.5)
Ischemic heart disease46 (12.5)
Diabetes42 (11.4)
Obesity39 (10.6)
COPD31 (8.4)
History of active neoplasia25 (6.8)
Heart failure22 (5.9)
Atrial fibrillation17 (4.6)
Alzheimer’s disease11 (2.9)
Parkinson’s disease3 (0.8)
Other chronic diseases103 (28.1)
COPD: chronic obstructive pulmonary disease.

Other chronic conditions included thyroid disease (thyroiditis, hypothyroidism, hyperthyroidism), hypercholesterolemia, dyslipidemia, chronic renal failure, benign prostatic hyperplasia, depression, epilepsy, dementia, inactive cancers (colon cancer, breast cancer, lung cancer, leukemia), ulcerative colitis, and thrombocytopenia. Of the patients who came to the ED, 54 (14.7%) were discharged, 242 (66%) were admitted as inpatients and did not require intensive care unit (ICU) admission and 68 (19.3%) were admitted as inpatients and required at least one day in ICU. The mean duration of total hospitalization was 16.11 ± 15.48 days, while the duration of ICU admission was 3.03 ± 8.56 days. 56 (15.2%) patients were died at 60 days from ED visit.

We found rhinorrhea in 32 patients (8.7%), arthralgia/arthritis in 78 (21.2%), asthenia in 180 (49%), lymphadenopathy in 2 (0.5%), headache in 59 (16.1%), myalgia in 73 (19.9%), conjunctivitis in 45 (12.3%), nausea in 53 (14.4%), fever in 334 (91%), dyspnea in 241 (65.7%), cough in 246 (67%), abdominal pain in 9 (2.4%), rash in 34 (9.3%), pharyngitis/throat pain in 44 (12%), vomiting in 26 (7.1%), dys/anosmia in 97 (26.4%), dys/old weakness in 106 (28.9%), anorexia in 113 (30.8%). Fever lasted an average of 8.8 ± 5.1 days, dry cough 10.2 ± 7.8 days, dys-/anosmia 16.1 ± 12.8 days, and dys-/ageusia, and anorexia 14.9 ± 12.2 days. A large percentage of patients, 33.2% (122), had other symptoms at baseline, including diarrhea, otorrhea, otalgia and dysuria.

Vital signs and laboratory values were obtained in each patient: systolic blood pressure, diastolic blood pressure, heart rate, respiratory rate, oxygen saturation, ratio of the partial pressure of oxygen in arterial blood to the inspired oxygen fraction (PaO2/FiO2), the partial pressure of CO2 in arterial blood (PaCO2), lactates, bicarbonate, chlorine, pH, blood urea nitrogen, creatinine, sodium, potassium, ALT,, total bilirubin, CPK, LDH, CRP, PCT, hemoglobin (Hb), platelets, leukocytes, neutrophils (absolute numbers and percentages), lymphocytes (absolute numbers and percentages), d-dimer, INR, fibrinogen, troponin, and NTproBNP (Table 2).

Table 2.Clinical and laboratory parameters of all enrolled patients, patients who recovered from COVID-19 and patients who died up to 60 days after diagnosis. Comparison of parameters between the two groups studied. Data are expressed as mean ± standard deviation.
TotalRecoveredDeceasedp
SBP (mmHg)126 ± 27127 ± 26120 ± 34ns
DBP (mmHg)77 ± 1578 ± 1474 ± 22ns
HR (bpm)93 ± 1894 ± 1890 ± 21ns
RR (breaths/min)25 ± 925 ± 631 ± 11ns
OS (%)93 ± 795 ± 485 ± 10<0.00001
PaO2 (mmHg)74 ± 2475 ± 2469 ± 220.09
PaO2/FiO2 (mmHg)308 ± 106313 ± 99228 ± 100<0.00001
PaCO2 (mmHg)34 ± 634 ± 533 ± 11ns
Lactates (mmol/L)1.9 ± 41.2 ± 14.5 ± 80.04
Bicarbonate (mmol/L)23.7 ± 324 ± 322 ± 4ns
Chlorine (mmol/L)102 ± 10101 ± 10103 ± 6ns
pH7.4 ± 0.17.5 ± 0.17.4 ± 0.1ns
BUN (mg/dL)21 ± 1618 ± 1239 ± 23<0.00001
Creatinine (mg/dL)1.8 ± 71.8 ± 81.7 ± 1ns
Sodium mmol/L138 ± 5138 ± 4139 ± 9ns
Potassium mmol/L4.0 ± 0.54.0 ± 0.54.2 ± 0.60.005
ALT (U/L)37 ± 4235 ± 3648 ± 67ns
AST (U/L)91 ± 7153 ± 7857 ± 45ns
Bilirubin (mg/dL)0.7 ± 0.40.7 ± 0.30.7 ± 0.4ns
LDH (U/L)358 ± 391310 ± 132618 ± 9100.02
CPK (U/L)203 ± 324161 ± 206428 ± 6230.002
Hb (g/dL)14 ± 214.1 ± 213.3 ± 30.02
Platelets (cells × 109/L)204 ± 80207 ± 78196 ± 91ns
Leukocytes (cells × 109/L)8.1 ± 228.0 ± 228.7 ± 6ns
Neutrophils (cells × 109/L)5.2 ± 34.9 ± 36.7 ± 40.001
Neutrophils (%)73.5 ± 1372.2 ± 1380.5 ± 24<0.0001
Lymphocytes (cells × 109/L)1.3 ± 21.2 ± 1.31.5 ± 4.0ns
Lymphocytes (%)19.1 ± 1120.1 ± 1013.6 ± 11<0.01
d-dimer (ng/mL)2634 ± 52522026 ± 44965203 ± 7180<0.0001
Fibrinogen (mg/dL)515 ± 172501 ± 162586 ± 2040.004
CRP (mg/dL)85 ± 8470 ± 69166 ± 104<0.001
Procalcitonin (ng/dL)0.8 ± 4.10.2 ± 1.23.2 ± 9.10.015
Troponin (mg/dL)561 ± 518363 ± 298674 ± 611ns
NT-proBNP (pg/mL)1975 ± 5203640 ± 10516267 ± 9414<0.005
SBP: Systolic Blood pressure, DBP: diastolic blood pressure, HR: hearth rate, RR: respiratory rate, OS: oxygen saturation, BUN: blood urea nitrogen, ALT: alanine aminotransferase, AST: aspartate aminotransferase, LDH: lactate dehydrogenase, CPK: creatine phosphokinase, Hb: hemoglobin, CRP: c-reactive protein, NT-pro-BNP: n-terminal pro brain natriuretic peptide, ns: not significant, PaO2: partial pressure of oxygen in arterial blood, FiO2: inspired oxygen fraction, PaCO2: the partial pressure of CO2 in arterial blood.

3.2 Univariate analysis

The prevalence and mean values of the parameters assessed were compared between deceased patients and those who recovered from COVID-19.

The mean age of cured patients was 60 ± 15.3 years, while that of deceased patients was 77.7 ± 9.4 years (p < 0.0001); 56.6% of patients who recovered had one or more comorbidities, while 29.4% of patients who died had one or more comorbidities (p = 0.0013). 71.2% of healed patients were taking ACEIs/ARBs versus 41.5% of deceased patients (p = 0.00001). Differences in signs and symptoms at presentation between groups were evaluated but were not statistically significant. In addition, major comorbidities were also compared: diabetes, hypertension, ischemic heart disease, heart failure, atrial fibrillation, COPD, obesity, history of active neoplasia, Parkinson’s disease, Alzheimer’s disease, and other chronic diseases. The prevalence of each of the comorbidities studied did not differ significantly between groups. Assessment of the patients’ vital signs revealed differences between the two groups consistent compatible with the different clinical course of the disease (Table 2). Table 2 also describes the laboratory parameters. The parameters associated with an unfavorable outcome in the univariate analysis, with a p < 0.01 were: age, length of hospital stay, arthralgias, history of heart failure, atrial fibrillation, chronic lung disease, Alzheimer’s disease, lactate, PaO2, PaO2/FiO2 ratio, oxygen saturation, blood urea nitrogen, creatinine, potassium and CPK, LDH, CRP, PCT, neutrophils (both absolute and percentage) and lymphocytes percentage, d-dimer, fibrinogen, and NTproBNP.

3.3 Multivariate analysis

Multiple logistic regression analysis was performed including variables with a p < 0.01 in the univariate model and adjusting for age, sex, and number of comorbidities.

The following variables were found to be statistically significant:

—oxygen saturation (p = 0.001)

—CRP (p = 0.03)

—blood urea nitrogen (p = 0.03)

—comorbidity (p = 0.01)

—age (p = 0.0001)

The ROC curves were calculated for each of these variables and the area under the curve (AUC) was assessed. All AUCs were >0.7, indicating that these parameters have good accuracy as predictors of death (Fig. 1,2,3,4,5).

The area under the receiver operating characteristic (AUROC) 
curve analysis for Oxygen saturation as predictor of death at 60 days.

Fig. 1.The area under the receiver operating characteristic (AUROC) curve analysis for Oxygen saturation as predictor of death at 60 days.

The area under the receiver operating characteristic (AUROC) 
curve analysis for c-reactive protein (CRP) as predictor of death at 60 days.

Fig. 2.The area under the receiver operating characteristic (AUROC) curve analysis for c-reactive protein (CRP) as predictor of death at 60 days.

AUROC curve analysis for blood urea nitrogen (BUN) as predictor 
of death at 60 days.

Fig. 3.AUROC curve analysis for blood urea nitrogen (BUN) as predictor of death at 60 days.

The area under the receiver operating characteristic (AUROC) 
curve analysis for number of comorbidities as predictor of death at 60 days.

Fig. 4.The area under the receiver operating characteristic (AUROC) curve analysis for number of comorbidities as predictor of death at 60 days.

The area under the receiver operating characteristic (AUROC) 
curve analysis for age as predictor of death at 60 days.

Fig. 5. The area under the receiver operating characteristic (AUROC) curve analysis for age as predictor of death at 60 days.

We then determined the cutoff values with the best sensibility and specificity for each parameter and assigned a score, as shown in Table 3. We used the best cutoff values for sensibility and specificity to create a score we called ANCOC (age, blood urea nitrogen, comorbidities, oxygen saturation, C-reactive protein). The ANCOC score ranged from –6 to 6 (Table 3). Patients with normal values of BUN, oxygen saturation, CRP, a low number of comorbidities, and under 55 years of age have a lower score; in contrast, patients with high values of BUN and CRP, low oxygen saturation, older than 55 years and with multiple comorbidities have higher ANCOC score. The 60-days mortality increases in relation to the ANCOC score. Mortality was zero for an ANCOC score lower than –1, 10% for –1, 25% for 0, 28% for 1, 35% for 2, 76% for 3, 86% for scores of 4 and 5, and 100% for 6 (Fig. 6)

Table 3.Best cutoff values of sensitivity and specificity of age, number of comorbidities, blood urea nitrogen, oxygen saturation, and C-reactive protein for mortality prediction.
CriterionSensitivity95% CISpecificity95% CIScore
BUN >3543.630.3–57.796.3793.6–98.21
BUN <1596.487.5–99.643.2337.6–49.0−1
SO2>9697.989.1–99.929.5724.5–35.1−1
SO2≤8848.934.4–63.794.0290.7–96.41
ncom <291.680.0–97.739.8634.1–45.8−1
ncom >44.170.5–14.399.2997.5–99.91
Age <5598.290.3–100.039.4834.0–45.2−2
Age >8043.630.3–57.790.9487.2–93.92
CRP >2694.584.9–98.936.7531.3–42.5−1
CRP >15552.738.8–66.389.485.4–92.61
CI: confidence interval, BUN: blood urea nitrogen, SO2: oxygen saturation, ncom: number of comorbidities, CRP: C-reactive protein.
60-days mortality for different ANCOC scores. ANCOC: (Age, blood 
urea Nitrogen, C-reactive protein, Oxygen saturation, Comorbidities).

Fig. 6. 60-days mortality for different ANCOC scores. ANCOC: (Age, blood urea Nitrogen, C-reactive protein, Oxygen saturation, Comorbidities).

We calculated the 4C mortality score for each patient and performed AUROC analysis for both the 4C mortality and ANCOC scores as predictors of 60-days mortality in COVID-19 patients (Fig. 7,8). No difference in accuracy in predicting death was found between the scores. At a value less than –1 the ANCOC score has a sensitivity of 100% and a PPV of 100% in identifying patients who will recover; in contrast, ANCOC values greater than 3 have a specificity of 98.5% and a PPV of 89.5% in identifying patients who will die.

The area under the receiver operating characteristic (AUROC) 
curve analysis (solid blue) with 95% confidence interval (dashed curves) for 
ANCOC. (Age, blood urea Nitrogen, C-reactive protein, Oxygen saturation, 
Comorbidities) score as predictor of death at 60 days.

Fig. 7. The area under the receiver operating characteristic (AUROC) curve analysis (solid blue) with 95% confidence interval (dashed curves) for ANCOC. (Age, blood urea Nitrogen, C-reactive protein, Oxygen saturation, Comorbidities) score as predictor of death at 60 days.

The area under the receiver operating characteristic (AUROC) 
curve analysis (solid blue) with 95% confidence interval (dashed curves) for 4C 
mortality score as predictor of death at 60 days.

Fig. 8. The area under the receiver operating characteristic (AUROC) curve analysis (solid blue) with 95% confidence interval (dashed curves) for 4C mortality score as predictor of death at 60 days.

4. Discussion

The occurrence of COVID-19 combined with the high risk of infection and significant morbidity and mortality has prompted the international scientific and medical community to make every effort to better understand and treat affected patients. The clinical presentation of COVID-19 is highly variable and similar to other diseases very common in the general population (colds, flu, pharyngitis, and pneumonia caused by other pathogens) [7]. The clinical course and prognosis also vary widely: it is estimated that about 80% of affected patients recover without requiring therapy and have only mild symptoms, while another 20% present with symptoms requiring hospitalization, and of these, 5–10% require treatment in the intensive care unit. Overall, the letality rate (which also varies strongly according to the geographical areas affected) is about 2% [8]. For this reason, based on the available data, the priority is to find the features of the COVID-19 associated with a more benign clinical course or, conversely, with severe complications such as pneumonia, acute respiratory distress syndrome (ARDS), and death. The introduction of vaccines has reduced the incidence and severity of the disease, but unfortunately, due to a variety of factors (diffusion not yet optimal to achieve herd immunity, the appearance of variants with higher transmissibility, reluctance to vaccinate, reduced ability to protect against infection over time), it has not yet been possible to contain the disease [9, 10]. There are new, more effective therapies, but their high cost may be an obstacle to their spread, particularly in developing countries [11]. A score that can predict the outcome of the disease could be very useful when resources are scarce. Therefore, we have defined a score that could guide the emergency physician and the intensivist in the management of the patient depending on specific clinical characteristics and laboratory parameters: the ANCOC score. A score above 3 means that the patient is likely to experience serious complications, including death, whereas a score below –1 means that the patient will recover. This score has high sensitivity, specificity, and PPV, making it a promising tool in the clinical management of patients with COVID-19. Other scores have been proposed to evaluate the severity and risk of death in COVID-19 patients. However, the validated scores only assessed in-hospital mortality. On the other hand, our score includes all-cause mortality (both inpatient and outpatient). We followed the patients that were discharged from the ED. This has proven to be very useful as 8% of patients discharged from our ED deteriorated and were admitted to another hospital in our city up to 10 days after visiting our ED.

In addition, a recent study reviewed and validated 11 prognostic scores for COVID-19 [11]. The authors found that none of the evaluated scores had very high accuracy (AUC >0.80) in predicting in-hospital mortality and only 7 scores showed acceptable accuracy (AUC = 0.75–0.80) [6]. Interestingly, one of the most commonly used scores, the 4C mortality score, consists of eight variables (age, sex, number of concomitant diseases, respiratory rate, peripheral oxygen saturation, state of consciousness, blood urea nitrogen, and c-reactive protein) and includes the five variables used to calculate the ANCOC score [6]. However, the ANCOC score has similar excellent accuracy to the 4C score in predicting mortality at 60 days and is easier to calculate (because of the smaller number of variables required to generate it). It is important to clarify that we chose a follow-up period of 60 days to determine prognosis because 31 patients were still hospitalized 30 days after diagnosis (26 patients in an ordinary ward and 5 in an ICU).

Our study, however, has several limitations. First, it is a retrospective study with limitations related to its design. It is monocentric and was conducted during the first wave of the COVID-19 pandemic, making the results difficult to generalize. Moreover, data were collected when patients were admitted to the ED. This represents a selection bias, especially during the first wave of the pandemic, when the Italian government advised against going to ED unless particularly critical symptoms were present. In addition, models are also needed to account for other factors that could not be evaluated in this study (e.g., antiviral therapies, emergence of new variants, and vaccination status) that could influence our prognostic score. Finally, the results of the study have not been validated. Because of the relatively small number of participants, internal validation was not possible. The ANCOC score needs to be validated by an independent external study before it can be used in a clinical context.

5. Summary

Our data, if confirmed and validated by external studies, suggest that the ANCOC score has similar accuracy to the 4C score in assessing COVID-19 mortality but evaluates fewer variables and could be an additional tool in the hands of emergency physicians to assess the prognosis of patients with COVID-19.

Availability of data and materials

The data presented in this study are available on reasonable request from the corresponding author.

Author contributions

MCa—designed the study, wrote original draft and edited; SC, MSF, MCo—wrote original draft; VO—reviewed, edited and corrected English; GP, AP, MG—reviewed and edited; ET—collected and analyzed data; AGu—performed statistical analysis and edited; AGa, FF, MA—supervised and reviewed; all authors have read and approved the manuscript.

Ethics approval and consent to participate

The study was approved by the local ethic committee (Catholic University Ethic Committee), protocol number 0023001/20. Informed consent was obtained from all subjects involved in the study.

Acknowledgment

Thanks to Gemelli against Covid Group.

Funding

This research received no external funding.

Conflict of interest

The authors declare no conflict of interest. Marcello Candelli is serving as one of the Editorial Board members of this journal. We declare that Marcello Candelli had no involvement in the peer review of this article and has no access to information regarding its peer review. Full responsibility for the editorial process for this article was delegated to LV.

References

Polack FP, Thomas SJ, Kitchin N, Absalon J, Gurtman A, Lockhart S, et al. Safety and efficacy of the BNT162b2 mRNA Covid-19 vaccine. New England Journal of Medicine. 2020; 383: 2603–2615.

[Google Scholar]

Baden LR, El Sahly HM, Essink B, Kotloff K, Frey S, Novak R, et al. Efficacy and safety of the mRNA-1273 SARS-CoV-2 vaccine. New England Journal of Medicine. 2021; 384: 403–416.

[Google Scholar]

Madhi SA, Baillie V, Cutland CL, Voysey M, Koen AL, Fairlie L, et al. Efficacy of the ChAdOx1 nCoV-19 Covid-19 vaccine against the B.1.351 variant. New England Journal of Medicine. 2021; 384: 1885–1898.

[Google Scholar]

Sadoff J, Gray G, Vandebosch A, Cárdenas V, Shukarev G, Grinsztejn B, et al. Safety and efficacy of single-dose Ad26.COV2.S vaccine against Covid-19. New England Journal of Medicine. 2021; 384: 2187–2201.

[Google Scholar]

Knight SR, Ho A, Pius R, Buchan I, Carson G, Drake TM, et al. Risk stratification of patients admitted to hospital with Covid-19 using the ISARIC WHO clinical characterisation protocol: development and validation of the 4C mortality score. The BMJ. 2020; 371: m3339.

[Google Scholar]

Lazar Neto F, Marino LO, Torres A, Cilloniz C, Meirelles Marchini JF, Garcia de Alencar JC, et al. Community-acquired pneumonia severity assessment tools in patients hospitalized with COVID-19: a validation and clinical applicability study. Clinical Microbiology and Infection. 2021; 27: 1037.e1–1037.e8.

[Google Scholar]

Maurya SK, Bhattacharya A, Shukla P, Mishra R. Insights on epidemiology, pathogenesis, diagnosis and possible treatment of COVID-19 infection. Proceedings of the National Academy of Sciences, India Section B: Biological Sciences. 2022; 1–9.

[Google Scholar]

Tazerji SS, Shahabinejad F, Tokasi M, Rad MA, Khan MS, Safdar M, et al. Global data analysis and risk factors associated with morbidity and mortality of COVID-19. Gene Reports. 2022; 26: 101505.

[Google Scholar]

Barda N, Dagan N, Cohen C, Hernán MA, Lipsitch M, Kohane IS, et al. Effectiveness of a third dose of the BNT162b2 mRNA COVID-19 vaccine for preventing severe outcomes in Israel: an observational study. The Lancet. 2021; 398: 2093–2100.

[Google Scholar]

Robinson E, Jones A, Daly M. International estimates of intended uptake and refusal of COVID-19 vaccines: a rapid systematic review and meta-analysis of large nationally representative samples. Vaccine. 2021; 39: 2024–2034.

[Google Scholar]

Mahase E. Covid-19: molnupiravir reduces risk of hospital admission or death by 50% in patients at risk, MSD reports. The BMJ. 2021; 375: n2422.

[Google Scholar]