Abstract
In response to the critical shortage of medical masks resulting from the COVID-19 pandemic, large portions of the population are mobilizing to produce cloth masks using locally-sourced fabrics, however the efficacy of these masks as a means of protecting the wearer from airborne particles carrying virus is not well known. Further, existing protocols are designed for testing the fit and performance N95 respirators and tight-fitting facemasks rather than the relatively more loose-fitting surgical mask style most cloth masks follow. In this study tools and methods typically used to assess tight-fitting facemasks were modified to assess the efficacy of community-produced fabric and commercially-produced surgical masks in terms of protecting the wearer from airborne particles that may be carrying virus. Two TSI PortaCount (model 8028) instruments were operated concurrently to collect particle counts (particles/cm3) in size range 0.02 to >1 µm from ambient air and air just inside the breathing zone of the mask (1 measurement per second, evaluation period of 1 minute per test). Percent particle removal was determined for ten home-made, fabric masks of different designs, with and without filter layers, as well as three commercially-produced surgical-type masks. N95 masks were used to validate the method, and a 3M model 1826 surgical mask was used as a baseline for comparison of other masks of this style. Home-made masks worn as designed always had lower particle removal rates than the 3M masks, achieving between 38% and 96% of this baseline. As has been previously observed by Cooper et al. (1983), adding a layer of nylon stocking over the masks minimized the flow of air around the edges of the masks and improved particle filtration efficiency for all masks, including all commercial products tested. Use of a nylon stocking overlayer brought the particle filtration efficiency for five of the ten fabric masks above the 3M surgical mask baseline. This rapid testing method (<2 hours per mask design) provides a holistic evaluation of mask particle removal efficacy (material, design, and fit), and use of this method for testing a wider range of mask materials and designs will provide the public and health care providers with information needed to optimize health protection given resources at hand.
1. Introduction
In response to the critical shortage of medical masks resulting from the COVID-19 pandemic, large portions of the population are mobilizing to produce cloth masks using locally-sourced fabrics. While the general population is being advised to wear masks to protect others from virus that may be spread from the wearer, the efficacy of these masks as a means of protecting the wearer from airborne particles carrying virus is also a concern, particularly as medical masks grow scarce. This issue may become more critical if it becomes necessary for medical care workers to use similar alternative personal protective equipment.
The effectiveness of cloth masks to protect wearers from airborne particles, when studied previously, has been shown to be a function of both materials and fit. Anticipating the need to produce face coverings from readily-available materials, several studies used standard methods for materials testing to compare the filtration efficiency of materials such as cotton t-shirts, sweatshirts, handkerchiefs, and towels with the filtration efficiency of facepiece respirators (N95 masks) and surgical masks (Cooper et al. 1983a; OSHA 1998; van der Sande et al. 2008; Rengasamy et al. 2010; ASTM 2017b; a; 2019a; b). While none of these materials produced filtration efficiency close to respirators such as N95s, cotton cloth facemasks were found to provide about half the protection of standard surgical masks against airborne particles (van der Sande et al. 2008), while an elastic layer (e.g., nylon stocking) placed over the mask material was found to improve filtration efficiency of loose-fitting masks by minimizing air flow around the cloth layers (Cooper et al. 1983b).
Standard methods to test the fit and performance of respirators and masks designed to form a seal against the face, such as N95 masks and respirators used by firefighters, employ instruments that can concurrently count particles in air inside and outside of the masks while the subject moves his/her head through a series of positions (OSHA 1998). Several instruments have been specifically designed to perform fit tests of respirators and tight-sealing facemasks (e.g., TSI PortaCount). These tools and methods have been modified in the past to collect particle filtration data for loose-fitting, surgical type masks (van der Sande et al. 2008), revealing that head motions and positions do not significantly affect the performance of loose-fitting masks in terms of filtering out nano-sized particles. This suggests that a simplified mask testing protocol for loose-fitting masks can provide a representative measure of particle filtration efficacy, something critically needed given the highly varied results and protocol shortcomings noted in prior studies (Brosseau and Sietsema, 2020).
The purpose of this work was to develop a standardized method to compare the efficacy of sewn fabric facemasks (produced using a variety of patterns and materials) to standard surgical masks in terms of protecting the wearer from airborne particulates of the size range expected to carry viruses. By collecting data on the counts of particles (0.02 to >1 µm) from both sides of the mask while it is being worn, both the material and the fit of the masks are tested simultaneously, and a simplified protocol enables testing of a novel mask design within <2 hours. These tests provide a rapid screening tool to test a variety of mask designs produced from readily-available materials. By conducting separate tests for masks worn loosely (as designed) and for the masks held close to the face using a layer of nylon stocking (as recommended by (Cooper et al. 1983b)), this work also allows for separate evaluation of the combined effect of mask fit and materials on overall filtration efficiency versus the efficiency of the materials alone.
This manuscript reports data collected from an initial set of commercial and homemade masks, however results will be updated regularly as data from additional prototype masks are collected.
2. Materials and Methods
Masks
To date, tests have been run on three commercially-produced, medical-type facemasks (masks with elastic ear loops and in-sewn wires to adjust fit to the bridge of the nose), and ten sewn, multi-ply cotton fabric facemasks of various designs (Table 1). Masks were sourced from community volunteers currently producing masks for essential personnel working in human services; when possible multiple masks of each type were tested. Several of the fabric masks included filter layers such as cotton batting, Halyard H600 (sterilization wrap), and sections of HEPA vacuum bags. In addition, several sewn masks included hydrophobic interfacing layers (Pellon). Some masks included wires to fit the masks across the bridge of the nose (Table 1: 3M, Staple, Charcoal, and Sewn Fabric Masks B and C); some did not (Table 1: Sewn Fabric Masks A and D – J). Three N95 masks (3M model 1860) were also tested to confirm that >95% particle removal could be measured using the modified protocol.
Particles
All tests were run in a 65 m3 rectangular room after at least 15 minutes of operating a TSI Particle Generator Model 8026 (TSI Incorporated, Shoreview, MN, USA). This tool is typically used in conjunction with TSI PortaCount instruments to ensure high enough particle counts and size distributions to meet OSHA standards. Particles were generated from a dilute (2%) solution of sodium chloride (NaCl) and were expected to have a nominal size of 0.04 µm with a geometric standard deviation of 2.2 based on instrument specifications.
Particle counters
Particles in ambient air and air inside of the masks were simultaneously counted using two PortaCount Plus Model 8028 instruments running in count mode. The PortaCount Plus instruments use condensation particle counters (CPCs), which nucleate alcohol droplets from the smaller sampled particles. The larger alcohol droplets can then be counted using a light scatter detector (consisting of pumps to control flow rate, a laser, focusing elements, and a photodetector). Each PortaCount samples at a flow rate of 1.67 cm3/s and reports the number of particles per cubic centimeter, P, of air sampled each second as
where N is the number of particles counted by the CPC. Data on the particle size distribution for particulates measured by the PortaCounts are not available, however, ~90% of the particles detected were produced by the TSI Particle Generator as described above.
Mask fit testing is usually conducted using a single instrument in fit test mode, which sequentially tests air inside and outside the mask. Here in order to collect and display continuous data for ambient air and inside mask air at high frequency during minute-long tests, two PortaCount instruments were used. Two tubes of equal length sample air just inside and outside of each mask. Air inside the mask was sampled through a tight-fitting grommet inserted into each mask and positioned at the philtrum of the upper lip. Ambient air was sampled from a position ~3 cm from the grommet on the outside of the mask. All tests were conducted while masks were being worn by the same subject, breathing normally, through the nose, with the mouth closed, while holding the head at a steady position. Tests using multiple subjects, motions, and positions were not feasible given the limited time and social distancing precautions, however prior research results (van der Sande et al. 2008) provide confidence that limitation of motions and positions does not significantly limit the conclusions that can be drawn from the resulting data.
Calibration
Two PortaCount Plus instruments were used to report particle counts in air sampled from inside the mask (Mask PortaCount) and ambient air just outside the mask (Reference PortaCount) (Figure 1). Because these instruments were not recently calibrated, nor last calibrated at the same time, an inter-calibration was conducted to allow calibration adjustments on collected data. Each sampling day, calibration data (a minimum of three one-minute time series, n=180) were collected by recording readings simultaneously on both instruments while sample tubes were side-by-side (within 3 cm), open to the air (no mask), and a minimum of 1m from any person and 2m from the particle generator (as recommended by the manufacturer). The Mask PortaCount consistently reported higher particle counts; however, correlation coefficient between the readings from the two instruments was consistently above 0.9. Therefore day-specific linear regressions were used to normalize particle counts from the Reference PortaCount to equivalent particle counts from the Mask PortaCount.
Data collection and processing
Each mask test consisted of three one-minute runs while wearing the mask as designed (Figure 2(a)). To simulate a face-hugging fit like that used for N95 masks, each mask was also tested for one minute while pressing the material to the face around the breathing zone (across the bridge of nose, cheeks, and around the chin) using two hands. In addition, a more practical method of holding the mask material against the face was tested by adding section of nylon stocking over the entire mask area following recommendations from Copper et al. (1983a) (Figure 2(b)). The N95 was not tested using either of these additional methods as this is already a tight-fitting mask. Tests were run on at least three replicate sample masks whenever possible, however for many masks only one sample was available.
Particle concentration data from inside and outside the mask was logged each second for the one minute tests using video capture and subsequently transcribed to a database. Particle removal at each time step was then calculated as follows:
where Poutside is the corrected reading from the Reference PortaCount (as described above). The average and standard deviation for particle removal over each one-minute test were then computed. Changes in particle removal due to alternative test configurations (i.e., pressing around the breathing zone, addition of nylon stocking layer) were also computed to compare “as designed” fit performance with “optimized” fit. Finally performance metrics for all masks were calculated in reference to the 3M brand 1826 Standard Ear Loop Masks.
3. Results and Discussion
The percent removal of particles ranging from 0.02 µm to >1 µm for each mask was computed from data collected each second over one minute runs (example for one run for one mask provided in Figure 3). Particles generated through breathing can be observed as oscillations in the “inside mask” data both for tested surgical-style masks (Figure 3) and in tests of the N95 masks (Figure 4).
Average particle removal efficiency (as % removal) and standard deviation over the one-minute tests were computed for each mask with and without a nylon stocking layer (Figure 5). As expected, the removal efficiency for the tight-fitting N95 mask is greater than 99%. The standard medical-type masks (3M brand), when worn over the chin and with an adjusted nose wire, had a mean removal efficiency of 75%. With the exception of the Charcoal Air Pollution facemask and Sewn Mask J, which came close to this removal efficiency, all other masks achieved removal efficiencies of less than 60% when worn as loose-fitting masks.
The addition of a nylon stocking overlayer improved the removal efficiency for all loose-fitting masks, including commercial medical-type masks, providing similar or better results to the “N95-like” fit imitated using the wearer’s hands. The stocking layer also reduced the variability with time as indicated by a decrease in the time-based standard deviation. Both of these metrics indicate improved protection for the wearer from particle inhalation.
Using the 3M masks worn as designed as a baseline, the addition of the stocking layer improves the particle removal efficiency of several of the masks to match or exceed this baseline (Figure 6). The masks that achieved this level of filtration using the stocking layer each included a filter layer in addition to two layers of cotton fabric. These filters included organic cotton batting, both lightweight and heavier interfacing (Pellon), a section of vacuum cleaner bag, and loosely-woven cotton muslin. However, on closer inspection, the vacuum cleaner bag included a health warning indicating that it contained carcinogens and teratogens, so these types of filters would not be suitable for facemasks. Interestingly, a single layer of Halyard H600 surgical wrapping as a filter insert in Mask G did not result in particle removal efficiency matching a standard medical facemask even when fit was controlled using a stocking layer.
4. Conclusions and Future Work
A rapid testing protocol is presented for evaluation of loose-fitting type masks to provide information to individuals on particle removal efficacy of masks made with different types of fabrics and with different designs/fits. The protocol collects high-resolution particle count data inside and immediately outside of masks to report both mean and time-based standard deviation of particle removal efficiency. The protocol is validated on N95 masks, and a commercial (3M brand) medical-type mask is used as a baseline for evaluation of alternative mask particle removal efficiencies. The 3M brand mask worn as designed had a mean removal efficiency of 75%; with the exception of the Charcoal Air Pollution facemask and Sewn Mask J, which came close to this removal efficiency, all other masks achieved removal efficiencies of less than 60% (range of 30-60%) when worn as loose-fitting masks. The addition of a nylon stocking overlayer improved the removal efficiency for all loose-fitting masks, including commercial medical-type masks, by 15 to 50 percentage points and also decreased the time-based standard deviation (indicating more consistent particle removal); this provides a recommendation for mask efficacy improvement that can easily be implemented by individual mask wearers. When compared to commercial baseline masks, the addition of the stocking layer improved particle removal efficiency of many masks to match or exceed the baseline; the masks that achieved this level of filtration using the stocking layer each included a filter layer (organic cotton batting, Pellon, or loosely-woven cotton muslin) in addition to two layers of cotton fabric. This rapid testing method (<2 hours per mask design) provides a holistic evaluation of mask particle removal efficacy (material, design, and fit).
The forward-looking intent is to use this method for testing a wider range of mask materials and designs to provide the public and health care providers with information needed to optimize health protection given resources at hand. We are currently integrating an additional instrument into the testing protocol that will enable us to explicitly characterize particle size during tests as well as developing a website through which to provide the public with access to (anonymized) results for all masks evaluated. We strongly welcome feedback on additional ways to improve the value of collected data.
Data Availability
Data referred to in this manuscript is available upon request from the authors.
Acknowledgements
Advice, materials, tools, instruments, and time were donated or shared with us in order to carry out this project. A critical TSI PortaCount model 8028 was donated by Pfizer Inc. through the coordination of Luanne Kirwin, Sonya Ross, Rob Silk, John Price, and Michael Glover. Tools, advice, and expertise in conducting fit testing were generously provided by Gregory Lawless, TSI Incorporated; Albert Thomas, the Massachusetts Department of Fire Services; George Mulholland, Department of Chemical and Biomolecular Engineering, University of Maryland; Marco Fernandez, National Institute of Standards and Technology; and John Price and Dan Meinsen, Environmental Health and Safety, Northeastern University. Jessica Benedetto, Steve Gransbury, Denise Hajjar, Michelle Kane, Waas Porter, John Price, Alan Raymond, and Renée Scott kindly donated masks. Data extraction was provided by dedicated undergraduate students Matthew Biega, Alina Dees, Ariana Patterson, and Kelsey Walak. Thanks also go to Christine Trowbridge for assistance in editing.
