Underreporting of SARS-CoV-2 infections during the first wave of the 2020 COVID-19 epidemic in Finland - Bayesian inference based on a series of serological surveys

Introduction

When a novel virus initiates an epidemic, an important question is how fast the virus spreads in the population. If the virus causes clinical disease, the rate of epidemic growth can be monitored by the incidence of diagnosed disease cases. However, mild or asymptomatic infections may be difficult or impossible to observe directly, and therefore the true incidence of infection can not be learned solely based on the diagnosed cases. Infection usually leaves a mark in the form of antibodies, i.e. immunoglobulin proteins developed by the immune system and capable of identifying and neutralising the virus. Consequently, the true incidence of infection can be learned through serological surveys, i.e. studies of the prevalence of individuals with antibodies (seroprevalence). Comparing the seroprevalence to the cumulative incidence of diagnosed cases allows one to learn about the underreporting of infections, which consequently allows monitoring the true spread of the virus.

There are challenges in estimating the underreporting. The rate of infections and diagnostic practises may quickly change, and there may be different delays from infection to disease onset and to developing antibodies. In this case study, we propose a Bayesian approach for estimating the time-dependent underreporting of infections during the beginning of an epidemic and we apply our method to data from the 2020 COVID-19 epidemic in Finland. In our analysis we integrate three data sources: series of serological surveys, registered disease cases, and external data on antibody development.

In Finland, the first wave of the COVID-19 epidemic caused by the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) occurred from March through June 2020. In early March, tens of weekly COVID-19 cases were diagnosed in the extended capital region of Helsinki and Uusimaa (HUS area) with a population of 1.7 million, marking the beginning of the epidemic in the region, while relatively few cases were diagnosed in other parts of the country. Fig 1 shows the numbers of COVID-19 cases by week and municipality in the HUS area. Already by mid March, hundreds of weekly cases were diagnosed. The rate of new cases started to decline in early April, most likely because of a partial lockdown in the country. By mid June, the rate of weekly cases, both in the HUS area and the country as a whole, reduced to the tens of cases, and the first wave of the COVID-19 epidemic ended by the end of June. A total of 7286 COVID-19 cases were diagnosed during the first epidemic wave, of which 5347 cases were diagnosed in individuals residing in the HUS area.

• Download figure
• Open in new tab

Fig 1.

Numbers of COVID-19 cases by week and municipality in the extended capital region of Helsinki and Uusimaa, Finland (HUS area) during the first wave of the 2020 COVID-19 outbreak. In each map, the number of cases in each municipality is shown if it is 5 or more. Detailed data for three weeks in June (2020-06-08 / 2020-06-15, 2020-06-15 / 2020-06-22 and 2020-06-22 / 2020-06-29), with total 147 cases, are not shown in the figure.

The clinical manifestations of SARS-CoV-2 infection range from asymptomatic to severe and potentially fatal disease. To be diagnosed as a COVID-19 case, a SARS-CoV-2 infection needs to be laboratory confirmed or, alternatively, a clinical diagnosis of COVID-19 made by a medical doctor. The likelihood of a SARS-CoV-2 infection being detected thus depends on the clinical manifestation as well as the infection testing policy and capacity at the time of infection.

It is likely that a relatively large proportion of infections went undetected during the first wave of the epidemic in Finland. No widespread testing of asymptomatic individuals was in place, making it probable that at least almost all asymptomatic infections were missed. Many symptomatic infections were likely missed as well due to the care instructions and testing policy in place. In Finland, the underreporting was probably most prominent among the young and healthy in the beginning of the first epidemic wave, when the official care instructions for healthy individuals with symptoms compatible with COVID-19 were to stay at home with no contact to health care [1]. These instructions were affected by the limited infection testing capacity. During the epidemic peak, the daily number of infection tests in the HUS area was still increasing through rapid capacity building. The daily testing capacity increased from approximately 300 during March to 1000 during April to 1500 tests from May onward [2].

Based on a population-based seroepidemiological study in Spain in April-May 2020, Polland et al. found that approximately one third of SARS-CoV-2 infections were asymptomatic and that a substantial proportion of symptomatic infections also went undetected [3]. Stringhini et al. analysed the prevalence of immunoglobulin G (IgG) antibodies in Geneva during spring 2020 and estimated that there were 11 SARS-Cov-2 infections for every COVID-19 case [4]. Erikstrup et al. analysed blood donation data in April-May 2020 in Denmark and estimated that the ratio of the expected number of seropositives to the number of COVID-19 cases was between 7–20 [5]. To obtain information on the incidence of SARS-CoV-2 infection in Finland, a series of serological surveys was initiated in April 2020 (serosurveys).

While there may be significant delays from SARS-CoV-2 infection until developing detectable antibodies, i.e. until seroconversion, the symptoms and diagnosis of COVID-19 usually occur with less delay. This means that the two sources of observations are not directly comparable at any given time. One solution to this problem is to compare the SARS-CoV-2 seroprevalence to the cumulative incidence of COVID-19 from 2-3 weeks ago, thus accounting for the average delay in developing antibodies after COVID-19 symptoms. This approach can provide an estimate of underreporting, but it does not take into account the uncertainty and individual-level variation in the time lag from COVID-19 symptoms to seroconversion.

To better address the delays in antibody responses, we utilise previously published data about the time lag from COVID-19 symptom onset to seroconversion [6]. We estimate the distribution of the time lag and project the SARS-CoV-2 seroprevalence based on the COVID-19 incidence. We then estimate the SARS-CoV-2 seroprevalence based on the observations from the series of serosurveys. Finally, we compare the seroprevalence projections with the estimated seroprevalences over time and learn the time-evolving underreporting of SARS-CoV-2 infections based on the ratio of the two measures of seroprevalence.

We utilise Bayesian inference and data from the extended capital region in Finland (HUS area) to carry out the analysis. The novelty of our methodology is in accounting for the uncertainty in the time lag from disease symptoms to seroconversion when estimating the time-evolving underreporting of infections. Our analysis shows how the underreporting of SARS-CoV-2 infections evolved over time during the first epidemic wave in Finland.

Data sources

COVID-19 cases

The Finnish National Infectious Diseases Register (FNIDR) collects individual-level data on patients infected with SARS-CoV-2 [8]. These data consist of COVID-19 cases notified as either a positive SARS-CoV-2 finding from a microbiological laboratory or a clinical diagnosis by a medical doctor. Approximately 95% of the COVID-19 cases during the first epidemic wave in Finland were based on a positive SARS-CoV-2 finding from a polymerase chain reaction (PCR) test. The data was extracted for analysis on 31st November 2021.

The sample date of each positive PCR test and/or a doctor’s diagnosis is recorded in the FNIDR along with information regarding the patient, including the Finnish personal identity code. Notifications related to the same patient during a 12-month period are combined as a single COVID-19 case. In our analysis, the COVID-19 diagnosis date is taken to be the first positive PCR sample date or the first doctor’s diagnosis date, whichever occurred first. In the capital city (Helsinki), the average number of days from symptom onset to COVID-19 diagnosis was close to 6 days in March 2020, close to 4 days in April and close to 3 days in May (data not shown).

Serological surveys

In April 2020, the Finnish Institute for Health and Welfare (THL) initiated a series of serological surveys (serosurveys) to obtain information on how large a proportion of the population had developed antibodies to SARS-CoV-2 in different regions in Finland over time [9]. Each survey targeted most of the largest municipalities in Finland and individuals aged 18–69. In each survey round, individuals were randomly sampled from PIS and invited to participate. Successive surveys were conducted weekly or biweekly.

Figure 2 shows the recruitment to and participation in the surveys in the HUS area during the spring 2020. Due to practical reasons, only Finnish speaking individuals were recruited during the first two weeks, after which the study expanded to cover individuals with native language Swedish, English or Russian. The questionnaire was translated to each language. Other language groups were included in June 2020. The recruitment targeted only few of the largest municipalities during the first two weeks and then expanded to cover all municipalities in the HUS area. The sample size in the HUS area decreased after the second week and the participation rate declined from 64% to 50% during spring 2020.

• Download figure
• Open in new tab

Fig 2.

Population sampling in the extended capital region of Helsinki and Uusimaa, Finland (HUS area) during the first 10 weeks of the serological surveys. Population sampling was carried out weekly or biweekly and each map corresponds to a single sampling week. The first day of the week and the targeted native languages are listed for each sampling week (fi = Finnish, sv = Swedish, ru = Russian, en = English). The number of invited individuals by municipality are shown on each map.

The age distribution of the study population and the survey participants during the first epidemic wave are shown in Fig S2. The median and the 25% quantile of the age of the survey participants were slightly higher than in the study population, indicating that the participation rate was higher in older age groups. Otherwise the age distribution of the participants was similar to the study population.

Participation in the survey included giving a blood sample. The first and last blood samples during the first epidemic wave were taken on 9th April 2020 and 3rd July 2020, respectively.

Laboratory methods

Blood samples from the serosurvey participants were analysed using a two stage procedure: (1) a screening test, and (2) a microneutralisation test (MNT) following a positive result at stage (1). The screening test was a bead-based fluorescence immunoassay that measures IgG antibodies to the SARS-CoV-2 nucleoprotein [10]. The MNT is a cytopatic effect-based test, which measures the capacity of neutralising antibodies to prevent an infectious virus from causing damage in cell culture. SARS-CoV-2 strains circulating in Finland in early 2020 were used in the MNT assay; CoV-19/Finland/1/2020 (GISAID accession ID EPI ISL 407079) and hCoV-19/Finland/FIN-25/2020 (EPI ISL 412971). MNT was used as the second test as it is highly specific to SARS-CoV-2 [11], [10]. Obtaining positive results from the two tests, the screening test and the MNT combined, was considered a confirmed presence of antibodies due to a past or ongoing SARS-CoV-2 infection (seroconversion). In the following, the combined test is referred to as the confirmation test.

In order to maximise accuracy, the confirmation test was calibrated utilising data unrelated to the surveys [10]. The ground truth for a past or ongoing SARS-CoV-2 infection was based on a positive PCR test close to 30 days prior to the antibody tests. The ground truth of no SARS-Cov-2 was based on blood samples from 2019. Based on calibration, a sample was considered positive for the screening test if the mean fluorescent intensity (MFI) value of the test was above 500. In the MNT, neutralising antibodies were detected from 2-fold serially diluted serum samples starting from dilution 1:4. Based on calibration, a titer of ≥ 4 was considered positive. Fig S3 describes the optimised test performance on the calibration data for both the screening and confirmation tests. The screening test was 100% sensitive, after which the MNT was both 100% specific and 100 %sensitive. Therefore the optimised performance of the confirmation test was 100% sensitive and 100% specific. The sensitivity and specificity of the screening test alone were 100% and 97.59%, respectively.

Development and detection of antibodies

For the screening test, we say that an individual is seropositive if the test gives a positive result. If the seropositivity is due to a SARS-CoV-2 infection, we say that the individual is seroconverted. An individual may be seropositive but not seroconverted, because the screening test may produce a false positive result due to cross-reactive IgG antibodies induced by other human coronaviruses. Neutralising antibodies measured by the MNT are always due to SARS-CoV-2 and therefore and individual with a positive confirmation test is always both seropositive and seroconverted.

The time from infection to seroconversion is subject to individual-level variation. If time from infection is short, the antibody concentration may not have reached the test detection threshold. If time from infection is long, the antibodies may wane below the detection threshold. The sensitivity of antibody detection (e.g. the confirmation test) is therefore likely to be lower than 100% in both of these cases. When modelling the time-dependent seropositivity, we take into account the slow development of antibodies after infection. However, we omit waning immunity due to the relatively short study period.

For symptomatic individuals, the symptoms usually develop sooner than detectable antibodies. Tan et al. present results where symptomatic SARS-CoV-2 infected patients were followed for 6 weeks starting from symptom onset and reported the IgG positive proportions of patients for each week [6]. The antibody test utilised in their analysis was similar to the screening test of the current study. The data are reproduced in Table 1. A total 312 tests were performed on 65 patients, with 3–7 days between consecutive tests. At day 7 since symptom onset, only 3.4% of the patients tested positive for IgG antibodies. At day 14, 50% tested positive and when 28-49 days had passed, between 74% and 87% tested positive. Tan et al. report that of the 67 patients included in their study, 29 were classified with severe pneumonia [6]. The median age of the patients was 49 years and twenty-five patients had underlying diseases.

View this table:

• View inline
• View popup
• Download powerpoint

Table 1.

Percentage of seroconverted COVID-19 patients by time since symptom onset (Tan et al. [6]). A total 312 tests were performed on 65 patients. Day is the number of days passed since COVID-19 symptom onset, Patients are the number of patients tested and IgG positive are the number of patients who tested positive for SARS-CoV-2 IgG antibodies.

Statistical models and methods

Let T = [0, D], D = 86, denote the study period, i.e. the time period starting on 9th April 2020 (the date of the first blood sample taken from the serosurvey participants), until 3rd July 2020 (the date of the last blood sample taken during the first epidemic wave). Let τ_i denote the day of SARS-CoV-2 infection in individual i, i = 1, …, N. Here N = 1000821 is the size of the study population. The infections we consider may have occurred before the study period but not after (i.e. τ_i may be negative and τ_i < D).

After the infection, on day s_i, the individual may develop symptoms of COVID-19. Then, C days after the symptom onset, on day r_i = s_i + C, the individual may be diagnosed with COVID-19. In this case, information about the diagnosis and the individual is recorded in the FNIDR as a COVID-19 case. We assume that the delay C from symptom onset to diagnosis is 3.5 days and is the same for all individuals. The cumulative number of COVID-19 cases by day t is R(t), where .

An individual i has seroconverted by day t if t > a_i > τ_i, where a_i is the day after which the SARS-CoV-2 antibodies in the individual are detectable. We define A_i(t) = 𝟙 (a_i < t) as an indicator function taking value 1 for individual i if seroconversion has occurred by day t and 0 otherwise. For individuals with diagnosed COVID-19 we assume that seroconversion occurs after the symptom onset day (i.e. a_i > s_i). In those cases, we use U_i to denote the number of days from symptom onset to seroconversion. Fig 3 summarises the notation and describes the timeline from SARS-CoV-2 infection to seroconversion.

• Download figure
• Open in new tab

Fig 3.

Timeline from a SARS-CoV-2 infection to seroconversion.

Regardless of the infection status, an individual from the study population may be randomly selected to participate in one of the serosurveys. Let denote the binary test result (i.e. seropositivity) for individual i who was randomly selected into the survey and gave a sample for antibody testing on day t ∈ T, where z ∈ {Screen, Confirmation} denotes the test used to derive the result. We denote the specificity of test z as . If the test z is not fully specific, i.e. δ^(z) < 1, then the result may be positive without a SARS-COV-2 infection.

Figure 4 displays how SARS-CoV-2 infections may have been be observed as COVID-19 cases or positive antibody test results. To compare estimates of seroprevalence based on the two types of observation (serosurveys and COVID-19 cases), we quantify the distribution of the time lag from COVID-19 symptom onset to seroconversion. We then project the time-dependent seroprevalence based on the diagnosed COVID-19 cases, which allows for comparison to the seroprevalence estimated from the serosurveys.

• Download figure
• Open in new tab

Fig 4.

SARS-CoV-2 infections are observed as diagnosed COVID-19 disease cases or by antibody testing in the participants of the serological surveys. Here, I_i(t) indicates SARS-CoV-2 infection in individual i by day t; S_i(t) indicates symptom onset in individual i by day t; r_i is the diagnosis day of a COVID-19 case, with a total R(t) cases by day t; A_i(t) indicates seroconversion in individual i by day t, possibly observed as a positive antibody test y_i,t = 1 among n_t blood samples taken on day t; π(t) indicates the proportion of seroconverted individuals in the population of size N (seroprevalence).

Models

In this section, we specify the Estimation and Projection model of the seroprevalence. We then describe the estimation of seroprevalence and underreporting under both models. We utilise a Bayesian framework for statistical inference and numerical methods to derive the posterior distributions of all unknown quantities.

Estimation model

This model relates to the lower part of Fig 4 (Sampling). The Estimation model is used to estimate the time-dependent seroprevalence based on antibody test results in the serosurvey participants. Due to the small numbers of daily blood samples in the serosurveys, we split the study period T into 13 non-overlapping seven day periods (weeks), W = [0, 7), [7, 14), ….[84, 86]. We assume that the seroprevalence is piecewise constant by week and let denote the seroprevalence during week w ∈ W.

We describe the prior uncertainty in the weekly seroprevalence as follows. For the first week, the logit of the seroprevalence is assumed to be normally distributed with expectation μ₁ and variance . The logit of the prevalence in any later week is assumed to depend on the prevalence during the previous week with a non-decreasing trend. A shared variance parameter σ² controls the strength of the dependency on the previous weeks, with σ given a gamma prior with parameters α and β. The structure of the prior model thus is: where g(π) = log(π/(1 − π)) is the logit function. This defines a prior distribution of the parameter vector . We denote the prior distribution of g(π⁽⁰⁾) as p(g(π⁽⁰⁾); Φ), where the vector Φ = (α, β, μ₁, σ₁) collects the prior parameters. The seroprevalence for week w is , where g⁻¹(x) = 1/(1 + exp(−x)) is the inverse-logit function.

The observations arise when n_w randomly selected individuals from the population give a blood sample during week w and a result is derived via antibody test z. The probability that the test result is positive for individual i is where 1 − δ^(z) is the probability that an individual without SARS-CoV-2 infection gives a (false) positive test result.

Let denote the number of positive samples during week w. We assume that, conditionally on the weekly seroprevalence, the observations are independent and identically distributed. The conditional probability model of the total count , where w ∈ W, then is Based on the vector of observations , the likelihood function of the logit seroprevalence g(π⁽⁰⁾) is The posterior distribution of g(π⁽⁰⁾) is proportional to the product of the prior (2) and the likelihood (5): The estimation model is described graphically in Fig 5.

• Download figure
• Open in new tab

Fig 5.

The model for seroprevalence π⁽⁰⁾(t) (Estimation model). The study period T is split into weeks W. On day t during the study period, where t belongs to week w, the antibody test result for individual , depends on the seroprevalence during week w and the specificity δ^(z) of the antibody test z, where z ∈ {Screen, Confirmation}. In the prior distribution, the seroprevalence during the first week is distributed according to parameters μ₁ and , and the seroprevalence during week w depends on the two previous weeks. The strength of the dependency is controlled by σ, with a prior distribution depending on parameters α and β.

Projection model

This model relates to the upper part of Fig 4 (Selection). The model is learned from previously published data on antibody development after COVID-19 symptoms. We first describe the model and then show how it is utilised to project the time-dependent seroprevalence based on COVID-19 cases in the FNIDR.

For individual j, the number of days from COVID-19 symptom onset to seroconversion is described by the random variable U_j. We assume that each U_j has a lognormal distribution with parameters μ_U and . The probability that patient j has secoconverted by day u since symptom onset is Pr(U_j ≤ u) = F_U (u; θ), where .

To estimate the parameters θ, we utilise data based on patients who had SARS-CoV-2 antibodies tested on multiple days after COVID-19 symptoms [6]. The data are shown in Table 1. We denote the test result by for individuals j = 1, …, n^q, where n^q is the number of individuals tested q days after symptom onset, and q ∈ Q^{T an} = {7, 10, 14, …, 42, 49}. If the test result is positive (i.e. ), the patient is seroconverted and the seroconversion must have occurred before day q. The probability model for the individual observation is We assume that the test results are independent given day q and the parameters θ. Based on the observations , the likelihood function of the parameters θ is We assume an uninformative prior distribution: The posterior distribution is proportional to the product of the prior (9) and the likelihood (8): The posterior predictive distribution of F_U is We utilise the posterior predictive distribution to project seroprevalence based on the FNIDR COVID-19 cases. For each day t ∈ T during the study period, we first predict the probability of seroconversion in each case i, for whom q_i days have passed since symptom onset. We assume that the symptom onset day was C = 3.5 days before the diagnosis day r_i, and so q_i = t − (r_i − C). The probabilities of seroconversion, each given by , are then combined as the expected number of cases seroconverted, and the seroprevalence is obtained by dividing by the population size N. Formally, we project the seroprevalence for day t ∈ T as where R(t + C) is the number of COVID-19 cases with symptom onset before day t. We call π⁽¹⁾(t) the projected seroprevalence. The Projection model is described graphically in Fig 6.

• Download figure
• Open in new tab

Fig 6.

The model for seroprevalence π⁽¹⁾(t) (Projection model). Left plate: The duration from symptoms to seroconversion was modelled based on external data. Individuals j, j = 1, .., N ^{(T an)}, experienced COVID-19 symptoms on day s_j = 0 and were tested for antibodies q days later, where q varied from 7 to 49 days. Individuals were tested on multiple days. Here, A_j(u) denotes whether individual j had seroconverted by day u, and indicates the result of an antibody test taken on the q:th day. The duration from symptoms to seroconversion was modelled as a lognormal distribution with parameters (μ_U, σ_U). Right plate: The posterior distribution of (μ_U, σ_U) is utilised to project the seroconversion status A_i(t) for each individual i = 1, …, R(t + C) with COVID-19 symptom onset before day t ∈ T during the study period. The symptoms are assumed to have occurred on day ŝ_i = r_i − C, where C is the lag from symptom onset to the COVID-19 diagnosis day r_i. The individual projections are used to derive the population level projection for the seroprevalence on day t, π⁽¹⁾(t).

Results

SARS-CoV-2 seroprevalence and the cumulative incidence of COVID-19

Table 2 shows the weekly numbers of blood samples and antibody test results in the serosurveys during the first epidemic wave. Out of 1465 samples taken between 9th April 2020 and 3rd July 2020, a total 35 (2.39 %) were screening test positive and a total 7 (0.48%) were confirmation test positive. Five of the confirmed positive samples were taken before 4th May 2020, when the weekly numbers of samples were high, and they correspond to weekly sample seroprevalences 0.29%, 0.43% and 1.18%. After 4th May 2020, the weekly number of available samples decreased significantly and only two confirmed positive samples were observed.

View this table:

• View inline
• View popup
• Download powerpoint

Table 2.

COVID-19 cases and serology survey results during spring 2020. The column COVID-19 cases (cumulative) shows the cumulative number and cumulative incidence of COVID-19 cases by the end of each week (Period). Data are shown both for the extended capital region of Finland (HUS) and for the target population of the current study (Study). The column Serological surveys (weekly) shows the weekly number of blood samples from the serological survey participants (Samples), the weekly number and proportion of positive samples using the screening test (Sreening pos. (%)) and the weekly number and proportion of positive samples using the confirmation test (Confirmation pos. (%)).

Table 2 also shows the cumulative incidence of COVID-19 cases in the study population and in all HUS area residents. Three weeks prior to the first confirmed positive blood sample, the cumulative incidence of COVID-19 in the study population was 0.07% (736 cases, population 1.0 million), and in three weeks it increased to 0.13% (1330 cases). In all HUS area residents the cumulative incidence of COVID-19 was 0.31% by the end of the first epidemic wave (5348 cases, population 1.7 million).

Figure 7 shows the estimates and projections of the seroprevalence, obtained under the Estimation model and Projection model. Results are shown for both the screening and confirmation tests. Based on the confirmation test, the posterior mean of the seroprevalence remains around 0.5% until the end of the study period where it slightly increases. The increase at the end is affected by the prior trend, combined with a low number of available blood samples. Based on the screening test, the seroprevalence behaves similarly but the posterior mean is lower and the posterior variance is greater. In both cases, the posterior mean of the projected seroprevalence (based on the COVID-19 cases) remains lower than the posterior mean of the estimated seroprevalence. The discrepancy to the estimated seroprevalence is greater during the beginning of the study period compared to the rest of the study period.

• Download figure
• Open in new tab

Fig 7.

Seroprevalence in the extended capital region of Finland during the first wave of the COVID-19 epidemic. Both images show the posterior means and 95% credible intervals of seroprevalence π⁽⁰⁾(t) and projected seroprevalence π⁽¹⁾(t), using the serology survey observations and COVID-19 cases (FNIDR projection), respectively. Solid lines are posterior means and the shaded areas correspond to 95% credible intervals derived from the pointwise 2.5% and 97.5% quantiles. The dashed lines show the projected seroprevalence and the shaded areas correspond to 95% credible intervals, however, the intervals for projected seroprevalence are very narrow and not visible. The image on the left shows results for the screening test and the image on the right shows results for the confirmation test.

Table 3 shows the estimates and projections of the seroprevalence for selected dates during the study period. Based on the confirmation test, the estimated seroprevalence in the HUS area was 0.49 (95% CrI: 0.20–0.91) on 9th April 2020 and 0.58 (95% CrI: 0.23–1.16) on 28th May 2020. The corresponding seroprevalence projections based on COVID-19 cases are 0.06 (95% CrI:0.05–0.06) and 0.23 (95% CrI:0.21–0.24), respectively. Fig 8 shows the posterior distributions of the seroprevalence obtained under the Estimation model on 28th May 2020. Based on the confirmation test, the interquartile range (IQR) for the seroprevalence was 0.4%–0.67%. The seroprevalence based on the screening test has more uncertainty and the posterior median is lower.

View this table:

• View inline
• View popup
• Download powerpoint

Table 3.

Estimated and projected seroprevalence (π⁽⁰⁾(t) and π⁽¹⁾(t)) and the underreporting ratio (Δ(t), see Eq 1) of SARS-CoV-2 infections during the study period. The seroprevalences are shown in percentage scale. Displayed are the posterior means along with 95% credible intervals, derived from the 2.5% and 97.5% quantiles of the distributions.

• Download figure
• Open in new tab

Fig 8.

Posterior distributions of seroprevalence π⁽⁰⁾(t), where t corresponds to 8th May 2020, learned from the screening (left image) and confirmation (right image) test data. The seroprevalence is shown in percentage scale.

Underreporting

Figure 9 shows the posterior mean and quantiles of the underreporting ratio Δ(t) (see Eq 1), based on either the confirmation or the screening tests. For both tests, the posterior mean of Δ(t) first decreases, indicating higher underreporting during the beginning of the epidemic, then settles at around 2-3, and finally increased slightly toward the end of the first wave.

• Download figure
• Open in new tab

Fig 9.

Extent of underreporting in the extended capital region of Finland during the first wave of the COVID-19 epidemic. Both figures show estimates for the underreporting ratio Δ(t). Solid lines are posterior means and the shaded areas correspond to 95% credible intervals derived from the pointwise 2.5% and 97.5% quantiles. The image on the left shows results for the screening test and the image on the right shows results for the confirmation test.

Table 3 shows the posterior mean and credible interval of Δ(t) for selected dates during the study period. Based on the confirmation test, there had been 8.9 (95% CrI: 3.6-16.5) infections for every COVID-19 case up until 9th April 2020. The underreporting then decreased, and up until 28th May 2020 our estimate is that there had been 2.5 (95% CrI: 1.0-5.0) SARS-CoV-2 infections for every COVID-19 case. The estimate of the underreporting ratio then remained at the same level until the end of the first wave.

Figure 10 shows the posterior distribution for the underreporting ratio by 28th May 2020, based on either the screening or confirmation tests. Based on the confirmation test, the IQR for underreporting was 1.8 – 3.0. The estimate derived from the screening test data has more uncertainty and shows lower underreporting.

• Download figure
• Open in new tab

Fig 10.

Posterior distributions of underreporting ratio Δ(t), where t corresponds to 8th May 2020, learned from the screening test (left image) and confirmation test (right image) data.

Time from COVID-19 symptom onset to seroconversion

Figure S5 describes the posterior distributions of μ_U and σ_U, the parameters of the lognormal distribution of the time from COVID-19 symptom onset to seroconversion. The posterior medians of μ_U and σ_U are 2.87 and 0.72, respectively. The figure also shows the posterior predictive distribution for the time from symptom onset to seroconversion. The predicted median delay from symptom onset to seroconversion is close to 18 days and the 75% quantile is over 29 days. By day 60 since symptom onset, the probability of seroconversion is over 95%.

Sensitivity analysis

Figure S6 shows the prior and posterior distributions of σ, the strength of dependency in the Estimation model, learned from the screening and confirmation test data. In both cases, the posterior distribution is similar to the (informative) prior distribution, indicating that the data do not contain much information about σ and the analysis may be sensitive to the prior distribution of σ.

Table S2 shows estimates of the underreporting ratio Δ(t), based on data from the confirmation test, using different prior parameter values for (μ₁), σ₁ and β. Smaller values of β correspond to a higher prior expectation and higher prior variance for σ and in turn higher posterior variance for Δ(t). For example, comparing choices β = 2 to β = 40 when α = 2, logit(μ₁) = 0.05 and σ₁ = 2, the 95% credible intervals for Δ(t) on 28th May 2020 are 0.4 − 7.3 and 1.0 − 5.0, respectively.

Choice of a larger logit(μ₁) corresponds to a higher posterior mean for Δ(t), but only marginally. For example, comparing the choice logit(μ₁) = 0.005 to logit(μ₁) = 0.05 when σ₁ = 2, β = 40, the posterior means for Δ(t) on 28th May 2020 are 2.4 and 2.6, respectively. A choice of smaller σ₁ reduces the posterior variance of Δ(t) and elevates the effect of the chosen μ₁, but the effects are small.

In all cases, the effects of the prior parameter choices are magnified towards the end of the study period, when the number of available samples from the serosurveys is low.

Discussion

We estimated that with 95% probability there were 1 to 5 SARS-CoV-2 infections for every COVID-19 case during the first epidemic wave in Finland. A 50% probability interval for the underreporting was 1.8–3.0. The underreporting was highest before April 2020 when there were 4 to 17 infections for every COVID-19 case (95% probability). It is likely that the seroprevalence in the extended capital region was over 0.5% already by the end of May 2020 (95% CrI: 0.2–1.2), while the cumulative incidence of COVID-19 cases in the region was 0.3% by the end of June. Based on the estimate of underreporting and the cumulative incidence of COVID-19 cases, we estimate that between 0.5%–1% (50% probability) and no more than 1.5% (95% probability) of the population in the capital region were infected with SARS-CoV-2 by the end of June 2020.

There is great uncertainty about the estimated seroprevalence and the corresponding estimate of underreporting at the end of the study period, due to the small number of samples available in the serosurveys. The estimates are therefore sensitive to the model specification (i.e. prior parameters). Accordingly, we consider the most robust estimate of underreporting during the first wave pertaining to the end of May 2020. We do not expect that the magnitude of underreporting changed significantly during the rest of the first wave, as there were no changes in virus testing policy or capacity.

Our analysis leaves a small but reasonable probability that by the end of the first wave there was no underreporting at all. It seems, however, unrealistic that no underreporting occurred, as in the general population the virus testing was targeted to symptomatic individuals only. Findings from a population-based screening in Iceland during March 2020 show that 43% of individuals who tested positive for SARS-CoV-2 were asymptomatic and findings from Spain indicate that one third of infections were asymptomatic in April-May 2020 [16], [3]. A systematic review and meta-analysis of 95 published studies estimates that globally 41% (34% - 48%) of confirmed COVID-19 cases were asymptomatic during the pre COVID-19-vaccine era [17]. Our analysis also leaves a small but reasonable probability that only 20% or less of SARS-CoV-2 infections were detected during the first epidemic wave. We believe that this may still be plausible, as other countries show even higher underreporting [3], [5].

A key assumption in our analysis was that the serosurvey participants represented the population of interest. The participation rate was 50%–64% and there were several factors which may have caused selection bias, as survey participation may correlate with the likelihood of SARS-CoV-2 infection. First, during the first two weeks, the surveys targeted only few of the largest municipalities. These had the highest numbers of COVID-19 cases, which may lead to overestimating the seroprevalence and thus the underreporting. However, an analysis using data only from the largest municipality (Helsinki) showed similar estimates of underreporting (data not shown). Secondly, the participation rate in younger age groups (18-29) was lower than in other age groups. Age is likely associated with the incidence of SARS-CoV-2 infection due to differences in social behaviour. In April 2020, Finns aged 18-29 had a similar frequency of daily social contacts than those aged 30-59, but a higher frequency of contacts than those aged 60-69 [18]. The underrepresentation of young adults in our study can lead to underestimation of the seroprevalence and of underreporting. Third, in several population health examination surveys, participation rates have been found lower among individuals with lower education [19]. Those individuals often work in professions where working remotely and social distancing may be more difficult to arrange, and thus they may be more exposed to infection. If those previous findings hold in this survey, this can lead to underestimation of seroprevalence and thus underreporting. Fourth, historically, the participation rate in Finnish health examination surveys has been lower in language groups other than Finnish and Swedish [20]. The incidence of COVID-19 during the first epidemic wave was several times higher in language groups other than Finnish, Swedish, English or Russian (Figure S1). However, as the target population of our study includes only those four language groups, we do not believe that the possible underrepresentation of language groups other than Finnish and Swedish is likely to bias our results. Finally, our preliminary analyses from the serosurveys beyond the first wave indicate that subjects with a past confirmed SARS-CoV-2 infection tend to have a lower participation rate. It is possible that those with a confirmed infection were less willing to participate. This can lead to underestimation of the seroprevalence and of underreporting.

The median age of COVID-19 cases in the HUS area showed a decreasing trend during spring 2020, most likely due to the increase in testing capacity, allowing detection of milder disease cases (figure S7). It is therefore probable that the underreporting decreased more in younger age groups than in other age groups during the first epidemic wave. Other serological studies have used regression analysis or post stratification to account for differences between the age and sex distributions of survey participants and the underlying population [4], [21], [3]. These methods could help reduce bias and allow for the estimation of age-dependent underreporting. We decided not to use such analytical methods due to the very small number of confirmed positive samples.

Another key assumption in our analysis was that the time-dependent probability of seroconversion after COVID-19 symptoms, as estimated from the external data set from Tan et al., is similar to how the antibody detection in the serological surveys would perform. Otherwise, the underreporting ratio, i.e. the ratio of the estimated seroprevalence (based on serosurveys) and the projected seroprevalence (based on COVID-19 cases) may not accurately describe underreporting. The patients in Tan et al. were all hospitalised and several of them were classified with severe pneumonia. By contrast, the majority of the FNIDR COVID-19 cases during the first epidemic wave did not require hospital care. Severe cases may have higher antibody responses, and this may cause us to overestimate the projected seroprevalence and hence underestimate the underreporting [22]. Additionally, the SARS-COV-2 antibody detection method utilised in Tan et al. differed from the methods utilised in the serosurveys. The serosurvey antibody detection was calibrated to be 100% sensitive by day 30 since infection. By contrast, in Tan et al., only 74% of the patients had seroconverted by day 28 since symptom onset, and accordingly, our seroprevalence projection yielded approximately 75% probability of seroconversion by day 30 since symptom onset. This discrepancy indicates that we may overestimate the time lag to developing detectable antibodies after COVID-19 symptoms. This in turn indicates that we may overestimate the underreporting during the beginning of the epidemic, at worst by a factor of around 0.75. Therefore, instead of 4–17 there were perhaps 3-13 infections for every COVID-19 case before April.

When projecting the seroprevalence, we assumed that the probability of seropositivity following COVID-19 symptoms is strictly increasing over time. In reality, the antibody levels eventually wane and after 8 months since SARS-CoV-2 infection, the N-IgG antibodies are detectable in only 66% of individuals [22]. Our analysis covers a period of four months, and there were not many infections in Finland before March 2020, so at worst we measured antibodies from serosurvey participants who were infected four months ago. The detectability of antibodies would then be at least 66% and possibly over 80%, assuming a linear decrease from the 100% detectability at one month. By contrast, our seroprevalence projection gives an almost 100% probability of seropositivity at four months since COVID-19 symptom onset. This worst-case discrepancy would correspond to overestimating the underreporting by 20% at the end of the study period. To analyse data beyond the first epidemic wave, the seroprevalence projection should be modified to allow for a decrease in the probability of seropositivity after appropriate time.

We included an analysis based on the screening test to demonstrate how our method can be used with tests which are not fully specific. The estimates of seroprevalence based on the screening test were lower than those based on the confirmation test, when adjusting for the expected false positive rate of the screening test. This implies that either the specificity of the screening test was higher than expected, or alternatively, the confirmation test was not fully specific. The confirmation test utilises a microneutralisation test (MNT) as the second test to confirm the presence of SARS-CoV-2 antibodies. Based on an analysis of a large number of pre-pandemic sera from different age cohorts, the MNT can be considered to be fully specific [10]. It is therefore extremely unlikely that any of our 7 confirmed positives samples was a false positive; more likely the true specificity of the screening test was higher than we assumed. In our analysis, we assumed that the specificity of the screening test was a known constant, based on a 81/83 true negative finding. In reality, however, there is uncertainty in the exact specificity, and the results derived from the screening test therefore have more uncertainty than our analysis implies. For analysing data from a test with unknown specificity, we agree with treating the specificity as an unknown parameter, as recommended by Gelman and Carpenter, and as implemented by e.g. Stringhini et al. [23], [4].

We used a constant value 3.5 days as the delay from symptom onset to COVID-19 diagnosis. In reality, the exact delay is unknown and subject to variation. It is likely that 3.5 days is an underestimate of the delay in the extended capital region during the beginning of the epidemic, when the average delay was greater in the capital city (Helsinki, data not shown). However, small variations in this delay do not affect our analysis, as small changes in the COVID-19 symptom onset day would not significantly alter the seroprevalence projection.

In summary, we presented a Bayesian approach to estimate the time-dependent underreporting of SARS-CoV-2 infections during the COVID-19 epidemic. We implemented the proposed approach to data from the extended capital region of Finland during the first epidemic wave in 2020. Our results indicate that most SARS-CoV-2 infections were not detected and the underreporting was most severe during the beginning of the epidemic. However, as the cumulative incidence of COVID-19 was very low, it is likely that less than 1.5% of the population in the extended capital region had been infected with SARS-CoV-2 by the beginning of July 2020. Assuming that the underreporting was similar in other parts of the country, the first wave of the COVID-19 epidemic left a vast majority of the Finnish population unaffected, with almost the entire population still unexposed and susceptible to SARS-CoV-2.

Funding

This study was funded by the Finnish Institute for Health and Welfare. We report no conflict of interests related to the current work. Finnish Institute for Health and Welfare (THL) conducts Public-Private Partnership with vaccine manufacturers and has received research funding from Sanofi Inc., Pfizer Inc., and GlaxoSmithKline Biologicals SA for studies not related to COVID-19. TAN, MM, AAP and JJ have been investigators in these studies, but they have received no personal remuneration.

Open data and code

The STAN code which implements the statistical methods described, data included in this article, and an R code example for learning the parameters of the described statistical models, and are available online: github.com/TuomoNieminen/covid19underreporting. Individual level data are not available due to data privacy. More detailed data related to the COVID-19 cases in Finland are available by formal request to the Finnish Social and Health Data Permit Authority Findata.

Supporting information captions

Table S1. Parameters of the prior distribution in the Estimation model, and the specificities of the screening and confirmation tests..

Table S2. Influence of choices of prior parameters on the estimation of underreporting ratio Δ(t). Shown are posterior means and 95% credible intervals for Δ(t), based on the confirmation test data, for 9th April 2020 (t = 0), 28th May 2020 (t = 49) and 2nd July 2020 (t = 84), using different values for the parameters μ₁, σ₁, and β. The value used for the parameter α was 2.

Fig S1. Incidence of COVID-19 cases in the HUS area by age group and language during the first wave of the epidemic in 2020, for Finnish (fi), Swedish (sv), English (en), Russian (ru) and other language groups.

Fig S2. Age distributions of: population in the extended capital region of Finland at the end of 2021 (HUS); COVID-19 cases for the HUS population during the first wave of the COVID-19 epidemic in 2020; the study population, i.e. the target population of the current study (HUS (incl.)); COVID-19 cases from the study population during the first wave of the COVID-19 epidemic in 2020 (FNIDR (incl.)); serological survey participants from the study population during the first wave (Serosurveys).

Fig S3. The antibody tests and their performances on the calibration data. The screening test is the result of the IgG antibody test, which may give false positive results. The confirmation test is a combination of the IgG and microneutralization tests (MNT), where the IgG positive samples are tested again with the MNT. After optimizing performance on the calibration data, which includes samples from PCR positive and negative individuals, the sensitivity and specificity of the screening test are 33/33 (100%) and 81/83 (97.59%), respectively, while the sensitivity and specificity of the confirmation test are 33/33 (100%) and 83/83 (100%), respectively.

Fig S4. Prior mean, and 2.5% and 97.5% quantiles for each weekly seroprevalence in the Estimation model. The estimates were computed based on 40000 samples generated from the prior distribution of π.

Fig S5. The three images show, starting from the the left: the posterior distribution for μ_U, the posterior distribution for σ_U, and the posterior predictive distribution for U, the time from COVID-19 symptom onset to seroconversion. The distribution for U was obtained by sampling from the lognormal distribution, using samples from the joint posterior distribution for (μ_U, σ_U).

Fig S6. Prior and posterior distributions for the parameter σ. Image on the left shows the prior distribution, the middle image shows the posterior distribution based on confirmation test data, and the image on the right shows the posterior distribution based on the screening test data.

Fig S7. Age distribution of COVID-19 cases in the extended capital region of Finland during the first wave of the COVID-19 epidemic in 2020.