OR WAIT null SECS
A comparative study of three air samplers used for bioaerosol collection was performed to evaluate the average recovery of colony-forming units and to assess the precision of each device.
The evaluation of airborne microorganisms is critical in the biopharmaceutical industry. For manufacturers that produce drugs in an aseptic environment, cleanrooms must meet strict standards. Regulatory requirements such as the US Food and Drug Administration's Guidance for Industry, Sterile Drug Products Produced by Aseptic Processing:Current Good Manufacturing Practice and internal corporate policies require monitoring to verify that these standards are maintained. Cleanroom monitoring is dependent upon reliable instruments that are suitable for sampling airborne contaminants in an aseptic environment. These instruments must also be calibratable, portable, and easy to use
In this study, three active air samplers were evaluated for the collection of culturable airborne microorganisms. Bioaerosol collection includes whole microorganisms as well as fragments, toxins, and particulate waste products from all varieties of living things (1).
The following air samplers were studied:
Table I: Estimates from the mixed-effects model of average recovery and standard deviation of the replicate measurements (within day) of the airborne culturable bacteria concentration by air sampler in log10(cfu/ft3) units.
Methods. When comparing various air samplers, the device properties of each piece of equipment must be taken into account (2). The three air samplers that were evaluated have various flow rates. Therefore, all instruments were run for the same period of time, not the same aspiration volumes. The same period of time was used to obtain each sample because of the varying population of airborne organisms from minute to minute. All sampling was conducted indoors in a nonclassified laboratory area of nonmicrobiological practices. The room's windows remained closed at least 24 h before measurements were taken. The opening of doors was minimal. Sampling times were chosen at random throughout the day and over a period of several days.
Before the study, the three air samplers were checked for flow rates using traceable air flow meters. The samples were checked by the vendor or by in-house metrologists. All instrument surfaces and accessories were wiped clean with filter-sterilized 70% isopropyl alcohol. Each sampling instrument was programmed to sample for 10 min. The RCS Plus and Air Ideal samplers were aseptically loaded with sterile or irradiated trypticase soy agar (TSA) media. The Air Ideal sampler was evaluated with a 90-mm Petri dish media. The SAS 180 sampler was aseptically loaded with irradiated 55-mm contact plates containing TSA and lecithin and polysorbate 80 neutralizers
Table II: Estimates from the mixed-effects model of average recovery of the concentration of airborne culturable bacteria by air sampler in units of cfu/ft3.
The three air samplers were placed at three designated sites, one meter apart, with the sample ports facing the same direction, at approximately the same level. At most times, activity in the room sampled was kept to a minimum. One minute after placing the units at their respective sampling locations, the air-sampling units were simultaneously started. The SAS 180 and Air Ideal samplers have delay-time programming features that allow for this time lag. This feature was programmed manually for the RCS Plus device. The delay in sampling minimized the variability in results because it minimizes the number of times an operator must enter the sampling environment. When the sampling time was complete, the TSA was removed from each sampler and transferred into a 32 °C (±2.5 °C) incubator. Each sampler surface was wiped with 70% isopropyl alcohol to prepare for the next sampling. This procedure was repeated two more times on the same day, rotating air samplers among the room sites between replicates. A total of nine samples were taken each evaluation day. The evaluation continued for 15 days, with a total of 135 samples taken at the end of the evaluation.
All TSA plates and strips were incubated at least 72 h at 32 °C (±2.5 °C). Unexposed media were also included in the incubation as part of standard laboratory controls. (A positive recovery from any of the unexposed media would have invalidated that day's worth of test results.) After incubation, colonies were enumerated and recorded.
Data analysis.The results were converted to colony-forming units (cfu) per volume (m3) of air sampled; a statistical correction was made to counts from the SAS 180 and Air Ideal using the positive hole conversion table by Feller (3). When the recovered count increases in sieve-type samplers, the probability increases that more than one contaminant is propelled through the same aperture onto the plate and is counted as a single colony-forming unit. Feller's correction factor adjusts the result for this possibility. The counts were adjusted, recalculated as cfu per cubic foot (cfu/ft3), and transformed to log10 for data analysis purposes. The logarithm transform was used in past studies (4, 5).
The objectives of the data analysis were to compare the air samplers on their average recovery of colony-forming units and to evaluate their precision. An air sampler with a high recovery may be considered more sensitive than an air sampler with low recovery. Precision measures the variability in replicated measurements. When replicated measurements have low variability, the precision of the air sampler is said to be high and vice-versa. The three daily measurements were made in less than an hour while the laboratory was sealed and were considered as replicate measurements in the analysis for the purpose of estimating the precision
Figure 1: Log10(cfu/ft3) by day. Replications are indicated by 1, 2, and 3. The dotted line is the estimated average recovery from the mixed model.
Mixed-effects models, a generalization of an analysis of variance model, were used to analyze the data (6). A mixed-effects model was used to model two sources of variation: the day-to-day variation in the number of colonies in the room and the variation in the within-day measurements. Mixed-effects models were used to estimate the average cfu recovery, the variation in the replicate measurements, and to predict the true cfu in the laboratory. The assumptions of the mixed-effects model, normality and constant variance, were verified with QQ-plots and residual plots not shown in this article (7). Data analysis was performed using "S-PLUS V.6.2" software (Insightful Corp., Seattle, WA).
A mixed-effects model was made for each air sampler. Estimates from these models, average recovery, and standard deviation of the replicate measurements are listed in Table I in units log
) by air sampler with 95% confidence intervals. The recovery data expressed in log
) and the average recoveries are plotted in Figure 1 according to air sampler. Estimates of the recovery on the original scale (cfu/ft
) are given in Table II. The standard deviations were interpretable only within the context of the model in which the logarithm of the data was taken and were not expressed on the original scale.
The average recovery of the SAS 180 and the Air Ideal samplers were very similar: 0.32 and 0.34 cfu/ft3, respectively. The recovery of the RCS Plus air sampler was 0.49 cfu/ft3. The difference between the RCS Plus and the SAS 180 was 0.17 cfu/ft3 and the difference between the RCS Plus and the Air Ideal was 0.15 cfu/ft3. These differences were statistically significant (p = 0.0003 and p = 0.0021) in a mixed-effects model that incorporated the data from all the air samplers.
The standard deviations of the within-day measurements of the three air samplers were very similar, thus indicating that the air samplers had a very similar level of precision. The daily predictions of the true cfu/ft3 ranged from 0.06 to 1.18 cfu/ft3. Assertions made here concerning recovery and precision are valid over this range of colony-forming units.
Distinct patterns are apparent from the evaluation of this study's results:
Two of the air samplers (Air Ideal and SAS 180) had similar recoveries of colony-forming units per standard volume. On average, the SAS 180 and the Air Ideal produced recoveries of 0.32 and 0.34 cfu/ft3, respectively. Given this similarity, the Air Ideal and SAS 180 instruments may give companies leeway and flexibility in determining the purchase and implementation of air samplers. Businesses can choose between two samplers that, from this study, produce relatively interchangeable cfu/ft3 results.
The RCS Plus sampler produced slightly higher amounts of colony-forming units than the Air Ideal and SAS 180 instruments, with a recovery of 0.49 cfu/ft3 (0.17 and 0.15 cfu/ft3 greater than the recovery of the SAS 180 and Air Ideal, respectively). Although these variations make little difference when choosing an air sampler for monitoring in less environmentally stringent areas that do not directly influence product quality (e.g., nonclassified laboratories, manufacturing hallways, or breezeways), these variations were statistically significant, are worth noting, and must be taken into account when monitoring in a classified or regulated manufacturing areas. Moreover, areas that directly influence product manufacturing (e.g., Class 100A parenteral drug filling areas, open processing systems) may need special consideration when choosing an air sampler.
Air temperature, pressure, moisture content, wind speed, and turbulence are a few of the environmental factors that can affect the overall performance of an air sampler (1, 8). An air sampler's ease of use, reliability, functionality with a widely available collection media, overall cost, durability, portability, battery life, ability to be cleaned and sanitized, diagnostics, and ability to maintain consistent flow rates while avoiding leaks also should be evaluated when determining which air sampler to use.
Although the three air samplers in this study monitored various levels of cfu/ft3 on the average when compared with each other, all three samplers produced similar variance within daily test sessions. The variance among each set of three replicates from the RCS Plus, Air Ideal, and SAS 180 units are similar. This result is significant because it shows that all three samplers were equally affected by each day's environment. Even though the nonclassified laboratory room contained unknown amounts of cfu/ft3 that prevented the determination of the accuracy of each air sampler, the results from the replicates of each air sampler had little deviation, indicating that each sampler demonstrated a high level of precision.
The true cfu/ft3 results have been validated for an environment with a 0.06– 1.18-cfu/ft3 range. Depending on the true cfu/ft3 level of an environment, results may vary and may not be extrapolated from this study. Environmental monitoring provides the most accurate results when they are performed over long periods of time with large volumes of air being sampled (2). Consistent use of an air sampler provides more accurate results than a single snapshot from multiple air samplers. Accurate environmental monitoring is dependent upon trending and not individual data points. A business or company looking to implement a new environmental-monitoring program should not sacrifice consistency for technology.
The authors would like to thank Carole Genovesi, senior quality control manager of environmental quality control at Genentech Inc., for her efforts during this study.
1. J.M. Macher, "Evaluation of Bioaerosol Sampler Performance,"
Appl. J. Occup. Environ. Hyg.
(11), 730–736 (1997).
2. R. Meier and H. Zingre, "Qualification of Air Sampler Systems: The MAS-100," Swiss Pharma 22 (1–2), (2000).
3. W. Feller, An Introduction to Probability Theory and Its Applications (John Wiley and Sons Inc., New York, NY, 1950).
4. S. Mehta et al., "Evaluation of Portable Air Samplers for Monitoring Airborne Culturable Bacteria," AIHAJ 61 (6), 850–854 (2000).
5. G. Temprano, D. Garrido, and M. D'Aquino, "Comparative Study of Airborne Viable Particles Assessment Methods in Microbiological Environmental Monitoring," J. Pharm. Sci. Technol. 58 (4), 215–221 (2004).
6. J. Pinheiro and D. Bates, Mixed Effects Models in S and S-PLUS (Springer-Verlag, New York, NY, 2000).
7. S. Weisberg, Applied Linear Regression (John Wiley and Sons, New York, NY, 2d ed., 1985).
8. B. Crook, "Inertial Samplers: Biological Perspectives," in Bioaerosol Handbook, C.S. Cox and C.M. Wathes, Eds. (Lewis Publishers, Boca Raton, FL, 1995), pp. 247–267.
Evelyn F. Der* is a pharmaceutical specialist in environmental quality control, Joe P. Stablein is a senior analyst in environmental quality control, and Daniel A. Coleman, PhD, is a senior biostatistician in nonclinical statistics, all at Genentech, Inc., One DNA Way, South San Francisco, CA, 94080, tel. 650.225.1000, firstname.lastname@example.org
*To whom all correspondence should be addressed.