Review of European Union requirements: quality standards for food analysis laboratories

 The European Union has prescribed strict quality standards for official food laboratories and the methods of analysis to be used in laboratories when carrying out official food control work. These requirements, which are based on accreditation, participation in proficiency testing schemes and using validated methods of analysis, are described in detail. The similar approach being taken within the Codex Alimentarius Commission is also outlined. The procedures prescribed will ensure that official food control laboratories have in place the measures to ensure that consistently reliable data can be produced. Received: 29 November 1995 Accepted: 8 January 1996     

French laboratory proficiency testing program for food microbiology

The proficiency testing program in food microbiology (Réseau d'Analyses et d'Echanges en Microbiologie des Aliments; RAEMA), created in 1988, currently includes 440 participating laboratories. The program establishes proficiency in detection of Salmonella and Listeria monocytogenes, as well as quantitation of aerobic microorganisms, Enterobacteriaceae, coliforms, Escherichia coli, Clostridium perfringens, coagulase-positive Staphylococcus, and Listeria monocytogenes. Twice a year, 5 test samples are sent to participants to assess their precision and trueness for enumeration and detection of microorganisms. Results show an increasing involvement of food microbiology laboratories in quality assurance programs and use of standard and validated analytical methods. However, the percentage of laboratories obtaining questionable and unsatisfactory microbiological results remains relatively constant.     

Proficiency testing in food microbiology “Aqua”: enumeration of Staphylococcus aureus

In 1999 the Food Microbiology laboratory of the Istituto Zooprofilattico Sperimentale delle Venezie (IZSVe) started an interlaboratory comparison program for food microbiological tests, known as “Aqua, interlaboratory comparisons for quality assurance”. Aqua produces the test samples, applies statistical methods to estimate homogeneity and stability, processes and evaluates the results. The proficiency testing results allow to evaluate the performance of the laboratories, to identify possible differences and non-conformity, to demonstrate the competence and the quality of results, in order to take suitable corrective and/or preventive action after the individuation of the causes. Moreover, elaborating the results of several proficiency testing by using the control chart method, it is possible to evaluate the trend of the laboratory and to verify that the results are in statistical quality control.     

In-house validation for analytical methods and quality control for risk evaluation of chlordecone in food

Chlordecone was used until 1993 as a pesticide in the banana plantation of Martinique and Guadeloupe (French Antilles) against the root borer. This organochlorine pesticide was lipophilic, remnant, and toxic for human beings with both acute and chronic effects. Chlordecone was strongly absorbed and stored in soil and weakly decomposed in environment. Surveys conducted in 2001 revealed its presence in soil, rivers, and domestic food products. Local food (fruits and vegetables, cattle, poultry, and fish) was growing on soils, widely contaminated by chlordecone, used in the past as banana plantations. In 2003, French Administration asked for a risk evaluation for the Antilles population. The French Agency for Food Safety, proposed a Provisional Tolerable Daily Intake of 0.0005?mg?kg^?1?b.w.?day^?1, and an Acute Reference Dose of 0.01?mg?kg^?1?b.w.?day^?1, based on a toxicological risk assessment. The French National Reference Laboratory for pesticides has carried out two analytical methods, one for food of animal origin and another for food of fruit and vegetable origin. These methods were validated in the reference laboratory and dispatched to 13 laboratories for a proficiency test before the launch of two studies on Martinique and Guadeloupe food. About 900 samples from Martinique were sent to the network of laboratories for analysis of chlordecone. Performance parameters obtained through the proficiency test were briefly reported. The quality control test proposed in this study was discussed to shed light on the true variability achievable by intra-laboratory and inter-laboratory analysis. The limits of conventional quality-control procedures were discussed, and a process was proposed in order to get better confidence in analytical results.     

Homogeneity check of agricultural and food industries samples using near infrared spectroscopy

Samples distributed in proficiency testing schemes (PTS) need to be homogeneous in order to be sure that if a laboratory has a result different from the other laboratories, its error can be attributed to its analysis method and not to its sample. This control must be done according to the ISO 13528 draft standard before sending the samples to the laboratories. It can be done by determining homogeneity targets by sub-contracting to accredited laboratories using reference methods, but this engenders logistic and financial problems. That is why a homogeneity check using Near Infrared Spectroscopy (NIR) has been developed for agricultural and food industries samples prepared for PTS at Bipea (Bureau Interprofessionnel d'Etudes Analytiques). To evaluate the homogeneity among samples, this procedure involves a comparison of NIR spectra, the determination of global homogeneity criteria and the use of control charts. The method of control developed and carried out at Bipea allows the rapid and easy monitoring of the performance of the sample preparation.     

Quality issues in proficiency testing

 Proficiency testing is a means of assessing the ability of laboratories to competently perform specific tests and/or measurements. It supplements a laboratory's own internal quality control procedure by providing an additional external audit of their testing capability and provides laboratories with a sound basis for continuous improvement. It is also a means towards achieving comparability of measurement between laboratories. Participation is one of the few ways in which a laboratory can compare its performance with that of other laboratories. Good performance in proficiency testing schemes provides independent evidence and hence reassurance to the laboratory and its clients that its procedures, test methods and other laboratory operations are under control. For test results to have any credibility, they must be traceable to a standard of measurement, preferably in terms of SI units, and must be accompanied by a statement of uncertainty. Analytical chemists are coming to realise that this is just as true in their field as it is for physical measurements, and applies equally to proficiency testing results and laboratory test reports. Recent approaches toward ensuring the quality and comparability of proficiency testing schemes and the means of evaluating proficiency test results are described. These have led to the drafting of guidelines and subsequently to the development of international requirements for the competence of scheme providers. Received: 2 January 1999 · Accepted: 7 April 1999     

Is it possible to agree on a value for inorganic arsenic in food? The outcome of IMEP-112

Two of the core tasks of the European Union Reference Laboratory for Heavy Metals in Feed and Food (EU-RL-HM) are to provide advice to the Directorate General for Health and Consumers (DG SANCO) on scientific matters and to organise proficiency tests among appointed National Reference Laboratories. This article presents the results of the 12th proficiency test organised by the EU-RL-HM (IMEP-112) that focused on the determination of total and inorganic arsenic in wheat, vegetable food and algae. The test items used in this exercise were: wheat sampled in a field with a high concentration of arsenic in the soil, spinach (SRM 1570a from NIST) and an algae candidate reference material. Participation in this exercise was open to laboratories from all around the world to be able to judge the state of the art of the determination of total and, more in particular, inorganic arsenic in several food commodities. Seventy-four laboratories from 31 countries registered to the exercise; 30 of them were European National Reference Laboratories. The assigned values for IMEP-112 were provided by a group of seven laboratories expert in the field of arsenic speciation analysis in food. Laboratory results were rated with z and ζ scores (zeta scores) in accordance with ISO 13528. Around 85?% of the participants performed satisfactorily for inorganic arsenic in vegetable food and 60?% did for inorganic arsenic in wheat, but only 20?% of the laboratories taking part in the exercise were able to report satisfactory results in the algae test material.     

Evaluation of results of an interlaboratory comparison test on determination of acrylamide in crispbread samples

The European Commission's Directorate General Joint Research Centre has organized several proficiency tests on the determination of acrylamide (AA) in food. This paper presents the results and outcome of a proficiency test that focused on the determination of AA in crispbread samples. One of the goals was the identification of the influence of different parameters such as analyte extraction or instrument calibration on the analytical results. A set of samples, containing 3 different crispbread samples as well as extracts of one crispbread sample and AA standard solutions, was shipped to each participant. A total of 42 European laboratories reported analytical results that were evaluated by applying internationally accepted protocols and procedures. The study found that, for each sample, the results of 4-8 laboratories were outside the range formed by the target value plus or minus the 2-fold of the target standard deviation; thus, they did not perform satisfactorily. In transferring this knowledge to the data of monitoring databases of AA in food, care must be taken that data are quality controlled, as it is likely that some of them may be biased.     

Proficiency tests using four batches of green alga with controlled levels of cadmium

A set of test materials of the green alga Chlorella vulgaris with different levels of naturally bound Cd and about the same levels of other 13 essential or trace elements (BIOMA 1–4) was produced for proficiency testing of laboratories involved in elemental analysis of food. Criteria of the laboratories’ performance, such as the z-score and combination scores RSZ and SSZ were evaluated and discussed in terms of their suitability for proficiency testing using a set of test materials with the same matrix. The use of the test materials as a set of internal reference materials has also been suggested. Received: 23 May 1997 / Revised: 1 August 1997 / Accepted: 11 August 1997     

The challenges and benefits of implementing the requirements of ISO/IEC 17043 by PT/EQA providers

ISO/IEC 17043 Conformity assessment??general requirements for proficiency testing is intended to replace previous international guides used to assess the competence of proficiency testing (PT) providers. It expands on the requirements of previous guides and is intended to accommodate PT providers of calibration laboratories and testing laboratories handling both qualitative and quantitative data. QMP-LS is an office-based external quality assessment provider for medical laboratories in Ontario, Canada and operates 46 different PT schemes for approximately 250 diagnostic tests. In 2010, these schemes were accredited to ISO/IEC 17043. Schemes included tests from the following disciplines: chemistry, hematology, microbiology, transfusion medicine, cytology, histology and genetics. Thirty of the schemes were qualitative. The challenges and benefits of implementing ISO/IEC 17043 are discussed, with particular emphasis on clauses addressing the following requirements: statistical design, determination of assigned value, homogeneity and stability testing, packaging, labeling and distribution, performance evaluation and subcontracting services.     

Bias analysis of proficiency testing programme results

A proficiency testing programme might involve a great number of participating laboratories coming from different countries or regions, and normally they analysed the same test materials using their own routine analytical methods. Hence, the results of a proficiency testing programme may contain valuable information which could serve purposes other than just performance evaluation. This study attempted to extract information from the results of a proficiency testing programme for the purposes of educating the participating laboratories as suggested by ISO/IEC 17043. The “bias analysis” approach introduced in this study was based on the statistical model of measurement and the nature of bias in chemical analysis. With this approach, the participating laboratories could estimate the bias associated with different settings of experimental conditions according to the statistics of subset distribution of the reported results from the participating laboratories. This would be useful for them to review the analytical procedures they used and modify their methods if needed. The approach was applied to the analysis of data obtained from a number of past proficiency testing programmes, and the findings were discussed in this paper.     

Evaluation of food emergency response laboratories’ capability for <Superscript>210</Superscript>Po analysis using proficiency test material with verifiable traceability

Measurement capability and data comparability are essential for emergency response when analytical data from cooperative laboratories are used for risk assessment and post incident decision making. In this study, the current capability of food emergency response laboratories for the analysis of ²¹⁰Po in water was evaluated using a proficiency test scheme in compliance with ISO-43 and ILAC G13 guidelines, which comprises a test sample preparation and verification protocol and an insightful statistical data evaluation. The results of performance evaluations on relative bias, value trueness, precision, false positive detection, minimum detection limit, and limit of quantification, are presented.     

Lessons from the first international proficiency test for the detection of spores from the honey bee pathogen Paenibacillus larvae

We report on the first proficiency test in the context of honey bee disease testing on a broad international scale. Honey samples were distributed to 12 participating laboratories for isolation and identification of spores of the etiological agent of American foulbrood, Paenibacillus larvae. Of the 11 laboratories responding to this proficiency testing event, only 6 (54%) provided data that were in full agreement with the previously determined status of the honey samples; eight (72%) laboratories fell within the threshold for qualification as defined a priori in this proficiency test (=level of agreement of at least 90%). Some lessons can now be drawn from the organizational point of view and will certainly improve new initiatives to be taken.     

The correlation of laboratory performance in proficiency testing with other QA characteristics

Although it seems self-evident that proficiency testing (PT) and accreditation can be expected to improve quality, their relative benefits remain uncertain as does their efficacy. The study reported here examines the following issues: (a) Why do laboratories take part in PT schemes? (b) How does participation in PT fit in with a laboratory's overall quality assurance (QA) system? (c) Is there a link between a laboratory's performance in specific PT and it's QA system? (d) How does PT performance change with time and how do laboratories respond to poor performance? The overall conclusion is that there is no evidence from the present study that laboratories with third-party assessment (accreditation and certification) perform any better in PT than laboratories without. The validity of this conclusion and its significance for the future design and operation of such schemes requires further investigation. In particular, study is required of the degree to which good performance in open PT correlates with blind PT performance, where laboratories are not aware that the samples being analysed are part of a quality assessment exercise.     

An error model for evaluation and interpretation of proficiency testing

Data from proficiency testing can be used to increase our knowledge of the performance of populations of laboratories, individual laboratories and different measurement methods. To support the evaluation and interpretation of results from proficiency testing an error model containing different random and systematic components is presented. From a single round of a proficiency testing scheme the total variation in a population of laboratories can be estimated. With results from several rounds the random variation can be separated into a laboratory and time component and for individual laboratories it is then also possible to evaluate stability and bias in relation to the population mean. By comparing results from laboratories using different methods systematic differences between methods may be indicated. By using results from several rounds a systematic difference can be partitioned into two components: a common systematic difference, possibly depending on the level, and a sample-specific component. It is essential to distinguish between these two components as the former may be eliminated by a correction while the latter must be treated as a random component in the evaluation of uncertainty. Received: 20 November 2000 Accepted: 3 January 2001     

水中易释放氰化物能力验证样品的研制及应用

根据国家地表水环境质量监测网监测任务要求和环境监测的实际需要,制备了水中易释放氰化物能力验证样品。通过均匀性、稳定性检验以及量值一致性评价,研制的样品均匀性良好,在3℃~6℃冷藏避光保存条件下1年内稳定,样品配制值与多家实验室协作测定结果一致。探讨了样品在能力验证活动中的应用,共有来自全国11个省的32家实验室参加了水中易释放氰化物的能力验证计划,实验室满意率在80%以上,实验室结果出现有问题或不满意主要是由于样品前处理以及检测过程质量控制不当导致的。经检测及实验室反馈的数据验证,该能力验证样品能够应用于能力验证活动。     

Are certified reference materials a victim of quality systems? The need for working matrix-certified reference materials

The use of natural matrix-certified reference materials by commercial environmental laboratories is increasing rapidly. These materials are now an essential component of the quality systems of most commercial environmental laboratories. The use is increasing faster than existing producers, principally government agencies, can meet. The use of data from well established laboratory proficiency schemes is shown to be one alternative way of producing natural matrix-certified reference materials designed for use as day-to-day within-batch control materials.     

Improvements in performance in medical diagnostics tests documented by interlaboratory comparison programs

There is evidence to support the notion that interlaboratory comparisons (ILCs) are an effective tool for laboratory improvement. However, despite widespread experience and anecdotal evidence of improvements there are few published studies demonstrating any benefits from ILCs– in any field of testing. Published demonstrations of benefits can help justify the growing use of ILCs. ILCs and proficiency testing have been common for many years in medical laboratories; there has been open information on the results of ILCs, and there has been standardization of results from thousands of laboratories. These studies show general improvement over time in several areas of testing in different countries. Many articles cite specific reasons for the improvements, either proven or supposed. An early version of this paper was presented at the International Laboratory Accreditation Cooperation Conference ”ILAC 2000” in Washington D.C., on 31October, 2000. Received: 10 February 2001 Accepted: 21 January 2002     

Uncertainty evaluation in proficiency testing: state-of-the-art, challenges, and perspectives

The evaluation of measurement uncertainty, and that of uncertainty statements of participating laboratories will be a challenge to be met in the coming years. The publication of ISO 17025 has led to the situation that testing laboratories should, to a certain extent, meet the same requirements regarding measurement uncertainty and traceability. As a consequence, proficiency test organizers should deal with the issues measurement uncertainty and traceability as well. Two common statistical models used in proficiency testing are revisited to explore the options to include the evaluation of the measurement uncertainty of the PTRV (proficiency test reference value). Furthermore, the use of this PTRV and its uncertainty estimate for assessing the uncertainty statements of the participants for the two models will be discussed. It is concluded that in analogy to Key Comparisons it is feasible to implement proficiency tests in such a way, that the new requirements can be met. Received: 29 September 2000 Accepted: 3 December 2000     

Standardization and improvement program for creatinine measurement in human serum

Accreditation and Quality Assurance - Current practices, quality control systems and proficiency testing schemes in clinical laboratories are likely unable to detect intrinsic bias in the in vitro...