Is it possible to agree on a value for inorganic arsenic in food? The outcome of IMEP-112

Two of the core tasks of the European Union Reference Laboratory for Heavy Metals in Feed and Food (EU-RL-HM) are to provide advice to the Directorate General for Health and Consumers (DG SANCO) on scientific matters and to organise proficiency tests among appointed National Reference Laboratories. This article presents the results of the 12th proficiency test organised by the EU-RL-HM (IMEP-112) that focused on the determination of total and inorganic arsenic in wheat, vegetable food and algae. The test items used in this exercise were: wheat sampled in a field with a high concentration of arsenic in the soil, spinach (SRM 1570a from NIST) and an algae candidate reference material. Participation in this exercise was open to laboratories from all around the world to be able to judge the state of the art of the determination of total and, more in particular, inorganic arsenic in several food commodities. Seventy-four laboratories from 31 countries registered to the exercise; 30 of them were European National Reference Laboratories. The assigned values for IMEP-112 were provided by a group of seven laboratories expert in the field of arsenic speciation analysis in food. Laboratory results were rated with z and ζ scores (zeta scores) in accordance with ISO 13528. Around 85?% of the participants performed satisfactorily for inorganic arsenic in vegetable food and 60?% did for inorganic arsenic in wheat, but only 20?% of the laboratories taking part in the exercise were able to report satisfactory results in the algae test material.     

QUASIMEME results of laboratories involved in the German Marine Monitoring Programme for the North and Baltic Seas

This case study is written for laboratories in the German Marine Monitoring Program (GMMP) for the North and Baltic Seas in order to give support to the assessment of proficiency testing results for their external quality assurance. A second issue is to provide a practical, understandable and common way for the calculation of laboratory performance parameters, so-called combination scores. In this paper, the GMMP laboratory proficiency testing results of QUASIMEME (Quality Assurance of Information for Marine Environmental Monitoring in Europe) Laboratory Performance Studies for the last 5 years were reviewed. Combination scores for organochlorine pesticides and chlorinated biphenyls in marine sediment are presented and explained. However, the assessment approach is very general and should be applicable to most testing laboratories in the chemical field.Presented at the Eurachem PT Workshop September 2005, Portorož, Slovenia     

Regular participation in proficiency testing provides long term improvements in laboratory performance: an assessment of data over time

Data from various proficiency testing schemes, operated by LGC Standards, was collated and reviewed to determine whether regular involvement within third party, proficiency testing, either over a prolonged period of time or via multiple participation, had improved the performance of those laboratories taking part. Three statistical evaluations were applied to historical PT results, a review of improvements over time, demonstrated by the evaluation of satisfactory performance scores achieved, a review of the relative robust standard deviations obtained from multiple methods and a focused review of one analyst participating in proficiency testing over a prolonged period of time. In each case the data indicated that long term participation and evaluation via proficiency testing had resulted in consistent and sustained improvements in laboratory performance.     

Proficiency assessment of laboratories undertaking hard coal analysis

The Institute for Chemical Processing of Coal in Zabrze, Poland, organized a proficiency testing round to determine the mass fraction of ash, total sulfur and total carbon and the value of gross calorific value. Forty-four participants from Polish heat and power plants, research entities and independent laboratories reported results. The performance of the participants was evaluated using z and E _n scores. Over 85 % of the participants reported satisfactory results indicating the high level of proficiency of the Polish laboratories in the field.     

Proficiency testing for measurement of radon (222Rn) in drinking water

The Finnish Environment Institute in collaboration with the Radiation and nuclear safety authority (STUK) carried out the proficiency test for measurement of radon (²²²Rn) in water. Samples were taken from two drilled wells in November 2007. STUK has supplied the regional laboratories with RADEK MKGB-01 equipment based on gamma spectrometry. Two samples for this PT were taken from two drilled wells. Ground water moves irregularly in the process and cracks of the bedrock which is why each participant received an individual sample. Each participant’s sample was measured also by STUK using liquid scintillation counter (LSC) as the reference method in this proficiency test. In estimating laboratory performance the results that deviated less than ±10% from the value measured by STUK using LSC were regarded satisfactory. In total, 73% of the results in the analysis of the sample R1 and 82% in the analysis of the sample R2 deviated less than 10% from the values measured by STUK. The results reported by the participants were generally smaller than the results measured by STUK. The deviation between each participant’s result and the result measured by STUK with the LSC was ?7.4% (Sample R1) and ?6.2% (Sample R2). Due to the lack of certified reference materials and a reliable proficiency testing data, it is impossible to check the traceability of radon measurements by using the reference method (LSC) at this moment.     

Proficiency tests to evaluate commercially available IVD kits for glucose and cholesterol measurements

The first proficiency testing round 630-IL-1002, was carried out with a Reference Material DMR-180a with reference values obtained by using gas chromatography isotope dilution mass spectrometry methods, in which glucose, cholesterol and creatinine were measured. The serum pool was obtained from blood donors and all the analytes were at the normal concentration in Mexican population. The laboratories participants used different field methods to measure the analytes. The Mexican compulsory standard NOM-064-SSA1-1993 “specifications for equipments in vitro diagnostic (IVD)” requests 5% precision and 5% maximum bias of the IVD equipments in the measurements of analytes like glucose and cholesterol. The results obtained by field laboratories in the proficiency testing round are compared to the reference value and uncertainty provided by the National Metrology Institute (CENAM). The quality of measurements is dependent not only on the laboratory competence but also on the methods used by those commercially available IVD kits. It is concluded that quality assessment of measurements in clinical laboratories should be critically evaluated by using stable and certified reference materials. Presented at MEFNM 2008, September 2008, Budapest, Hungary.     

Proficiency testing as a tool for assessing the medical and economic impact of laboratory results: The blood coagulation case

An international commercial proficiency testing scheme was used to evaluate the impact of laboratory results on clinical decisions. The affect on atrial fibrillation was chosen as a model with 16 Israeli laboratories participating in an international study. A Markov model was constructed to evaluate the impact of any inaccurate results on the clinical outcomes. From the proficiency test study and the Markov model, 13–21% of the results were inaccurate and would have yielded erroneous medical decisions.     

The challenges and benefits of implementing the requirements of ISO/IEC 17043 by PT/EQA providers

ISO/IEC 17043 Conformity assessment??general requirements for proficiency testing is intended to replace previous international guides used to assess the competence of proficiency testing (PT) providers. It expands on the requirements of previous guides and is intended to accommodate PT providers of calibration laboratories and testing laboratories handling both qualitative and quantitative data. QMP-LS is an office-based external quality assessment provider for medical laboratories in Ontario, Canada and operates 46 different PT schemes for approximately 250 diagnostic tests. In 2010, these schemes were accredited to ISO/IEC 17043. Schemes included tests from the following disciplines: chemistry, hematology, microbiology, transfusion medicine, cytology, histology and genetics. Thirty of the schemes were qualitative. The challenges and benefits of implementing ISO/IEC 17043 are discussed, with particular emphasis on clauses addressing the following requirements: statistical design, determination of assigned value, homogeneity and stability testing, packaging, labeling and distribution, performance evaluation and subcontracting services.     

Proficiency testing in the light of a new rationale in metrology

The novel proposed definition of measurement result in the international metrology vocabulary requires a revision of standards and guidelines for proficiency testing (PT), and a new approach to processing proficiency data is needed to test the ability of laboratories to present not only unbiased quantity values, but reliable estimates of their uncertainty. Hence, an accepted reference value with the smallest possible uncertainty is needed to ascertain the proficiency of laboratories reporting results with lower than average uncertainty. A strategy based on the T-statistic is proposed leading to an accepted reference value that fully reflects the uncertainties reported by participants in a PT scheme and permits calculation of E _n numbers to distinguish whether or not measurement results are consistent with the accepted definition of the measurand. The strategy is applied to PT data from a recent international laboratory intercomparison of uranium isotopic ratios.     

水中易释放氰化物能力验证样品的研制及应用

根据国家地表水环境质量监测网监测任务要求和环境监测的实际需要,制备了水中易释放氰化物能力验证样品。通过均匀性、稳定性检验以及量值一致性评价,研制的样品均匀性良好,在3℃~6℃冷藏避光保存条件下1年内稳定,样品配制值与多家实验室协作测定结果一致。探讨了样品在能力验证活动中的应用,共有来自全国11个省的32家实验室参加了水中易释放氰化物的能力验证计划,实验室满意率在80%以上,实验室结果出现有问题或不满意主要是由于样品前处理以及检测过程质量控制不当导致的。经检测及实验室反馈的数据验证,该能力验证样品能够应用于能力验证活动。     

Assessment of performance of laboratories in determining acrylamide in crispbread

A proficiency testing round was undertaken to assess the performance of laboratories to measure acrylamide in a sample of crispbread. Retail samples of crispbread were ground to a fine powder and after thorough mixing were packed in 40 g units for distribution. Ten samples were selected at random and analyzed in duplicate for acrylamide by liquid chromatography/mass spectrometry (LC/MS). Standard statistical tests showed that the material was homogeneous for the purposes of proficiency testing. Test samples were distributed to 55 laboratories in 16 countries in Europe, North America, Australia, and the Middle East. The results were analyzed by standard proficiency testing statistical procedures, and laboratories were awarded z-scores on the basis of their reported results. Based on a target standard deviation (sigmap value) taken from the Horwitz equation, for a robust mean value of 1.2 mg/kg acrylamide, satisfactory results (z-score within +/- 2 for those between 0.8 and 1.6 mg/kg) were obtained by 86% of the 37 laboratories that returned results. Only 1 laboratory was unsatisfactory and 4 had questionable results. About equal numbers of laboratories used gas chromatography (GC)/MS and LC/MS procedures with about 25% using MS/MS and one using GC with electron capture detection. There was no evident trend in performance or bias in results. GC/MS and LC/MS data were evenly distributed across the population of laboratories reporting results.     

Laboratory proficiency testing of aflatoxins in corn and peanuts--a cooperative project between Thailand and the United States

The objective of this project was to conduct an aflatoxin proficiency test program in government, academia, and industry laboratories in Thailand. Aflatoxin-free corn and peanuts and corn and peanuts naturally contaminated with aflatoxins diluted to approximately 25 micrograms/kg were analyzed. Homogeneity of prepared, naturally contaminated test samples was checked on multiple replicates. The test was conducted according to the ISO/IUPAC/AOAC INTERNATIONAL Harmonized Protocol with z scores indicating laboratory performance. The participants used 3 methods: enzyme-linked immunosorbent assay, thin-layer chromatography, and the minicolumn. Of 19 laboratories that reported results for aflatoxins in naturally contaminated corn, 13 (68%) performed satisfactorily, on the basis of the mean obtained by an expert laboratory, a calculated target value for standard deviation, and the z score. Of 21 laboratories that reported results for aflatoxins in naturally contaminated peanuts, 10 (48%) performed satisfactorily. For aflatoxin-free corn, 6 laboratories reported finding aflatoxins at > or = 10 ng/g, chiefly by the minicolumn method; for aflatoxin-free peanuts, 1 laboratory reported finding aflatoxins at > 10 ng/g. Subsequently, a workshop of lectures and laboratory sessions was conducted to improve performance. A new and simple successive outlier removal procedure applied to the same data removed the same laboratories as did the use of z scores.     

Quality issues in proficiency testing

 Proficiency testing is a means of assessing the ability of laboratories to competently perform specific tests and/or measurements. It supplements a laboratory's own internal quality control procedure by providing an additional external audit of their testing capability and provides laboratories with a sound basis for continuous improvement. It is also a means towards achieving comparability of measurement between laboratories. Participation is one of the few ways in which a laboratory can compare its performance with that of other laboratories. Good performance in proficiency testing schemes provides independent evidence and hence reassurance to the laboratory and its clients that its procedures, test methods and other laboratory operations are under control. For test results to have any credibility, they must be traceable to a standard of measurement, preferably in terms of SI units, and must be accompanied by a statement of uncertainty. Analytical chemists are coming to realise that this is just as true in their field as it is for physical measurements, and applies equally to proficiency testing results and laboratory test reports. Recent approaches toward ensuring the quality and comparability of proficiency testing schemes and the means of evaluating proficiency test results are described. These have led to the drafting of guidelines and subsequently to the development of international requirements for the competence of scheme providers. Received: 2 January 1999 · Accepted: 7 April 1999     

Achieving traceability in chemical measurement—a metrological approach to proficiency testing

ISO/IEC 17025 requires that testing laboratories establish the traceability of their measurements, preferably to the SI units of measurement. The responsibility for establishing traceability lies with each individual laboratory and must be achieved by following a metrological approach.The results of measurements made in such a way are traceable to the standards used in method validation and to the calibration standards used during the measurement process. If these standards are traceable to SI then the measurements will also be traceable to SI.Participation in appropriate proficiency studies (an ISO/IEC 17025 requirement) enables laboratories to demonstrate the comparability of their measurements. If the materials used for the studies have traceable assigned values, then proficiency testing also provides information about measurement accuracy and confirms, or otherwise, that appropriate traceability has been established. This paper will report on a new approach for the establishment of traceable assigned values for chemical testing proficiency studies. The work is conducted at a "fit for purpose" level of measurement uncertainty, with costs contained at a level similar to previous "consensus" based proficiency studies. By establishing traceable assigned values in a cost effective way, NARL aims to demonstrate the added value of the metrological approach to participant laboratories.     

External proficiency testing exercises on human leukocyte antigen typing in Italy between 1998 and 2002

External proficiency testing exercises are essential tools for measuring the quality of different kinds of performances related to health care and to ensure that they are uniform throughout a region. For many years, the Italian National Transplant Centre and the Italian National Institute of Health have been organizing external proficiency testing exercises for serological and genomic human leukocyte antigen (HLA) typing, following the rules of the European Federation of Immunogenetics. This society provides accreditation for immunogenetical tests to those European countries which want to collaborate on programmes on solid organ and bone marrow transplantation. The results of the Italian external proficiency testing exercises are very satisfactory because of the progressive improvement of the quality of HLA typing seen in Italian laboratories between 1998 and 2002. The attained outcome will certainly guarantee a more reliable service in clinical practice, and will contribute to the process of approaching the highest quality in health care.     

Comparison of multianalyte proficiency test results by sum of ranking differences, principal component analysis, and hierarchical cluster analysis

Sum of ranking differences (SRD) was applied for comparing multianalyte results obtained by several analytical methods used in one or in different laboratories, i.e., for ranking the overall performances of the methods (or laboratories) in simultaneous determination of the same set of analytes. The data sets for testing of the SRD applicability contained the results reported during one of the proficiency tests (PTs) organized by EU Reference Laboratory for Polycyclic Aromatic Hydrocarbons (EU-RL-PAH). In this way, the SRD was also tested as a discriminant method alternative to existing average performance scores used to compare mutlianalyte PT results. SRD should be used along with the z scores—the most commonly used PT performance statistics. SRD was further developed to handle the same rankings (ties) among laboratories. Two benchmark concentration series were selected as reference: (a) the assigned PAH concentrations (determined precisely beforehand by the EU-RL-PAH) and (b) the averages of all individual PAH concentrations determined by each laboratory. Ranking relative to the assigned values and also to the average (or median) values pointed to the laboratories with the most extreme results, as well as revealed groups of laboratories with similar overall performances. SRD reveals differences between methods or laboratories even if classical test(s) cannot. The ranking was validated using comparison of ranks by random numbers (a randomization test) and using seven folds cross-validation, which highlighted the similarities among the (methods used in) laboratories. Principal component analysis and hierarchical cluster analysis justified the findings based on SRD ranking/grouping. If the PAH-concentrations are row-scaled, (i.e., z scores are analyzed as input for ranking) SRD can still be used for checking the normality of errors. Moreover, cross-validation of SRD on z scores groups the laboratories similarly. The SRD technique is general in nature, i.e., it can be applied to any experimental problem in which multianalyte results obtained either by several analytical procedures, analysts, instruments, or laboratories need to be compared.

Laboratory assessment by combined z score values in proficiency tests: experience gained through the European Union proficiency tests for pesticide residues in fruits and vegetables

The obligation for accredited laboratories to participate in proficiency tests under ISO 17025, performing multiresidue methods (MRMs) for pesticide residues, involves the reporting of a large number of individual z scores making the evaluation of the overall performance of the laboratories difficult. It entails, time and again, the need for ways to summarise the laboratory’s overall assessment into a unique combined index. In addition, the need for ways to continually evaluate the performance of the laboratory over the years is equally acknowledged. For these reasons, following 14 years of the European Union Reference Laboratory for Pesticide Residues in Fruits and Vegetables (EUPT-FV), useful formulas have been designed to globally evaluate the assessment of the participating laboratories. The aim is to achieve a formula which is easy to understand, which can be applied and which fits the purposes of long-term evaluation detecting positive and negative trends. Moreover, consideration is needed for a fair compensation of bad results in MRM, taking into account the large number of compounds that are covered. It is therefore important to be aware of the difficulties in getting satisfactory values from a wide range of compounds. This work presents an evaluation of the main well-established combined z score formulas together with those new ones developed here which have been applied to the European proficiency test results (EUPTs) over the years. Previous formulas such as the rescaled sum of z score (RSZ), the sum squared of z score (SSZ) and the relative laboratory performance (RLP) are compared with the newer ones: the sum of weighted z scores (SWZ) and the sum of squared z scores (SZ2). By means of formula comparisons, conclusions on the advantages, drawbacks and the most fit-for-purpose approach are achieved.     

Quality control in extended measurement campaigns: selection of contract laboratories by proficiency testing exemplified for the trace analysis of anilines in groundwater

An interlaboratory comparison for the determination of aniline, nine methylated anilines and chlorinated anilines in contaminated groundwater (each compound between 1 µg L^?1 and 750 µg L^?1) was conducted as proficiency test for the selection of contract laboratories for a groundwater monitoring campaign. For the 13 participants, two different test sample series were prepared from a stabilized real case groundwater. Series A was the groundwater as sampled in the field and series B was prepared from series A by spiking with selected anilines. Homogeneity and stability investigations revealed that contaminated groundwater provides a viable basis for the preparation of ring test samples for the determination of anilines. Analytical procedures were limited to the standardized liquid–liquid extraction or solid-phase extraction in combination with gas chromatography/mass spectrometry (DIN 38407-16:1999). The robust consensus values were evaluated according to the standardized protocol of DIN 38402-45:2013. Robust reproducibility standard deviations ranged largely between 20?% and 60?% depending on the analyte. The proficiency assessment of individual participants combined the qualitative aspect of correct peak identification with the quantitative determination of individual concentrations within set limits in a unified approach. It could be shown that the accreditation status of laboratory and the existence of a standardized analytical procedure do not substitute a problem-related proficiency assessment of potential contractors.     

Analytical performance is improved by regular participation in proficiency testing: an analysis of data from the Aquacheck proficiency testing scheme

Analysis of historical data from the Aquacheck proficiency testing scheme demonstrates improvement in the performance of participants correlated to the frequency of participation. Analysis of the spread of results returned by all participants, defined by the percentage relative standard deviation (RSD) and the performance (Z) scores awarded to the individual participants, indicates that the overall performance for the group of participants is consistent. However, when the frequency of participation is analysed, it can be clearly seen that those laboratories who participated in the majority of the distributions available reported 10–15% more acceptable (Z-scores between +2 and ?2) results than those labs who took part with a greatly reduced frequency. When ‘more difficult’ analytes are considered, those laboratories who participated in greater than 75% of available rounds reported up to 30% more acceptable results than those laboratories who participated in 25% or fewer, of the available rounds.