Is it possible to agree on a value for inorganic arsenic in food? The outcome of IMEP-112

Two of the core tasks of the European Union Reference Laboratory for Heavy Metals in Feed and Food (EU-RL-HM) are to provide advice to the Directorate General for Health and Consumers (DG SANCO) on scientific matters and to organise proficiency tests among appointed National Reference Laboratories. This article presents the results of the 12th proficiency test organised by the EU-RL-HM (IMEP-112) that focused on the determination of total and inorganic arsenic in wheat, vegetable food and algae. The test items used in this exercise were: wheat sampled in a field with a high concentration of arsenic in the soil, spinach (SRM 1570a from NIST) and an algae candidate reference material. Participation in this exercise was open to laboratories from all around the world to be able to judge the state of the art of the determination of total and, more in particular, inorganic arsenic in several food commodities. Seventy-four laboratories from 31 countries registered to the exercise; 30 of them were European National Reference Laboratories. The assigned values for IMEP-112 were provided by a group of seven laboratories expert in the field of arsenic speciation analysis in food. Laboratory results were rated with z and ζ scores (zeta scores) in accordance with ISO 13528. Around 85?% of the participants performed satisfactorily for inorganic arsenic in vegetable food and 60?% did for inorganic arsenic in wheat, but only 20?% of the laboratories taking part in the exercise were able to report satisfactory results in the algae test material.     

Proficiency test on incurred and spiked pesticide residues in cereals

A proficiency test on incurred and spiked pesticide residues in wheat was organised in 2008. The test material was grown in 2007 and treated in the field with 14 pesticides formulations containing the active substances, alpha-cypermethrin, bifentrin, carbendazim, chlormequat, chlorpyrifos-methyl, difenconazole, epoxiconazole, glyphosate, iprodione, malathion, pirimicarb, prochloraz, spiroxamin and trifloxystrobin. After harvest, the test material was additionally spiked in the laboratory with three pesticides, that where the residues were too low, and axozystrobin. In total, 72 laboratories submitted results and z-scores were calculated for all laboratories and pesticides, except for glyphosate where only five laboratories submitted results and summed weighted z-scores were calculated for the laboratories with a sufficient scope. For several pesticides, the submitted results were strongly depending on the extraction procedure and consequently the assigned values were calculated based on part of the results. Acceptable z-scores were obtained by 56–97% of the participants.     

The current status and future of medical laboratory quality regulation and accreditation in Ghana

High-quality and reliable laboratory services are important components of effective and well-functioning health systems. Accurate, reliable and timely medical laboratory testing is crucial to patient care and disease surveillance. Unfortunately, in many sub-Saharan African countries, medical laboratory systems are adversely affected by the unavailability of medical laboratories, poor laboratory infrastructure and lack of well-trained personnel [1]. Quality in the laboratory is only achieved in a systematic way through the implementation of a quality management system. The results of the study showed that approximately 60?% of the 78 respondents were unaware of the requirements of ISO 15189:2007. A trial of proficiency testing, termed ??blind proficiency testing??, was carried out in which 19 laboratories determined the concentrations of urea and cholesterol in a proficiency testing material. Of the 19 laboratories that determined the concentration of urea, 63?% produced satisfactory results with scores between ?2 and +2. Similarly, 63?% of the participating laboratories obtained satisfactory z scores for cholesterol determination. Some of the laboratories that obtained satisfactory scores for urea determination had unsatisfactory scores for cholesterol determination and vice versa. It is recommended that the Ghanaian government pass a law and establish a standard to regulate medical laboratories in Ghana in order to improve quality in a significant way.     

Proficiency assessment of laboratories undertaking hard coal analysis

The Institute for Chemical Processing of Coal in Zabrze, Poland, organized a proficiency testing round to determine the mass fraction of ash, total sulfur and total carbon and the value of gross calorific value. Forty-four participants from Polish heat and power plants, research entities and independent laboratories reported results. The performance of the participants was evaluated using z and E _n scores. Over 85 % of the participants reported satisfactory results indicating the high level of proficiency of the Polish laboratories in the field.     

Comparison of multianalyte proficiency test results by sum of ranking differences, principal component analysis, and hierarchical cluster analysis

Sum of ranking differences (SRD) was applied for comparing multianalyte results obtained by several analytical methods used in one or in different laboratories, i.e., for ranking the overall performances of the methods (or laboratories) in simultaneous determination of the same set of analytes. The data sets for testing of the SRD applicability contained the results reported during one of the proficiency tests (PTs) organized by EU Reference Laboratory for Polycyclic Aromatic Hydrocarbons (EU-RL-PAH). In this way, the SRD was also tested as a discriminant method alternative to existing average performance scores used to compare mutlianalyte PT results. SRD should be used along with the z scores—the most commonly used PT performance statistics. SRD was further developed to handle the same rankings (ties) among laboratories. Two benchmark concentration series were selected as reference: (a) the assigned PAH concentrations (determined precisely beforehand by the EU-RL-PAH) and (b) the averages of all individual PAH concentrations determined by each laboratory. Ranking relative to the assigned values and also to the average (or median) values pointed to the laboratories with the most extreme results, as well as revealed groups of laboratories with similar overall performances. SRD reveals differences between methods or laboratories even if classical test(s) cannot. The ranking was validated using comparison of ranks by random numbers (a randomization test) and using seven folds cross-validation, which highlighted the similarities among the (methods used in) laboratories. Principal component analysis and hierarchical cluster analysis justified the findings based on SRD ranking/grouping. If the PAH-concentrations are row-scaled, (i.e., z scores are analyzed as input for ranking) SRD can still be used for checking the normality of errors. Moreover, cross-validation of SRD on z scores groups the laboratories similarly. The SRD technique is general in nature, i.e., it can be applied to any experimental problem in which multianalyte results obtained either by several analytical procedures, analysts, instruments, or laboratories need to be compared.

Evaluation of the performance of 57 Japanese participating laboratories by two types of z-scores in proficiency test for the quantification of pesticide residues in brown rice

A proficiency test for the analysis of pesticide residues in brown rice was carried out to support upgrading in analytical skills of participant laboratories. Brown rice containing three target pesticides (etofenprox, fenitrothion, and isoprothiolane) was used as the test samples. The test samples were distributed to the 57 participants and analyzed by appropriate analytical methods chosen by each participant. It was shown that there was no significant difference among the reported values obtained by different types of analytical method. The analytical results obtained by National Metrology Institute of Japan (NMIJ) were 3 % to 10 % greater than those obtained by participants. The results reported by the participant were evaluated by using two types of z-scores, that is, one was the score based on the consensus values calculated from the analytical results of participants, and the other one was the score based on the reference values obtained by NMIJ with high reliability. Acceptable z-scores based on the consensus values and NMIJ reference values were achieved by 87 % to 89 % and 79 % to 94 % of the participants, respectively. Graphical Abstract

Distribution of z and z_NMIJ-scores for isoprothiolane     

A proficiency test scheme for the quality control of black tea and development of quality control material for internal quality control

A proficiency test (PT) was organized for quality control analysis of black tea. Test materials for the analyses of total content of powder tea, moisture, total ash, acid-insoluble ash, water-soluble ash, alkalinity of water-soluble ash, water extract, crude fiber and caffeine were sent to the participant laboratories (n:43) in 2009. The assigned value, standard deviation of the parameters and z-scores of the participant laboratories were calculated using the data reported by the participants. The percentage of the reported results for analytes was found to be ranged from 67.5 to 100%. Acceptable z-scores were achieved by 80.5–97.5% of the participant laboratories. More than 15% of unacceptable results were obtained for acid-insoluble ash and caffeine analyses. The quality control material for quality control analysis of black tea was developed from the remaining material.     

Preparation of in-house reference material of benzylpenicillin in milk and results of a Brazilian proficiency testing scheme

Two milk test materials containing benzylpenicillin and a benzylpenicillin-free material were prepared and used for the operation of a Brazilian proficiency testing (PT) scheme according to the requirements of ISO/IEC 17043. The PT scheme was designed to include laboratories in charge of confirmatory analysis as well as screening analysis. Sets of sample vials, benzylpenicillin-free and spiked items containing 0.2 g of lyophilized milk, were distributed to each participant. Of 20 participants who reported screening data, 18 accomplished satisfying results, providing evidence of the capability of Brazilian laboratories to produce reliable qualitative information. The assigned value (robust average calculated from 6 results) and its uncertainty were (8.28 ± 0.52) μg/L. Participants’ performance was evaluated using z-scores. A small number of participants were able to report quantitative benzylpenicillin results, and consequently care should be taken in the interpretation of the laboratory’s performance, considering the statistical nature of z-scores. Long-term stability testing on remaining PT items showed that a stable benzylpenicillin quality control material was produced and can be used for internal quality control or validation purposes.     

Laboratory assessment by combined z score values in proficiency tests: experience gained through the European Union proficiency tests for pesticide residues in fruits and vegetables

The obligation for accredited laboratories to participate in proficiency tests under ISO 17025, performing multiresidue methods (MRMs) for pesticide residues, involves the reporting of a large number of individual z scores making the evaluation of the overall performance of the laboratories difficult. It entails, time and again, the need for ways to summarise the laboratory’s overall assessment into a unique combined index. In addition, the need for ways to continually evaluate the performance of the laboratory over the years is equally acknowledged. For these reasons, following 14 years of the European Union Reference Laboratory for Pesticide Residues in Fruits and Vegetables (EUPT-FV), useful formulas have been designed to globally evaluate the assessment of the participating laboratories. The aim is to achieve a formula which is easy to understand, which can be applied and which fits the purposes of long-term evaluation detecting positive and negative trends. Moreover, consideration is needed for a fair compensation of bad results in MRM, taking into account the large number of compounds that are covered. It is therefore important to be aware of the difficulties in getting satisfactory values from a wide range of compounds. This work presents an evaluation of the main well-established combined z score formulas together with those new ones developed here which have been applied to the European proficiency test results (EUPTs) over the years. Previous formulas such as the rescaled sum of z score (RSZ), the sum squared of z score (SSZ) and the relative laboratory performance (RLP) are compared with the newer ones: the sum of weighted z scores (SWZ) and the sum of squared z scores (SZ2). By means of formula comparisons, conclusions on the advantages, drawbacks and the most fit-for-purpose approach are achieved.     

Participation in IAEA proficiency test exercise on major,minor and trace elements in ancient Chinese ceramic (IAEA-CU-2006-06) using low power research reactor

A proficiency test (PT) exercise was offered by the International Atomic Energy Agency (IAEA) for major, minor and trace elements in Chinese ceramic reference material (IAEA-CU-2006-06). Neutron activation analysis (NAA) laboratory at PINSTECH, Pakistan participated in the exercise and submitted the results for 28 elements. The aim of participation was to develop a suitable methodology for accurate measurement of as many elements as possible in ceramic material using a low power reactor (PARR-2) as this would help future investigation in a project on the authenticity of art objects, for provenance, conservation and management of ancient cultural heritage of the country. After receiving the final report of the PT exercise, a critical review of our data and final scoring of each element is made to check the suitability of our methodology and reliability of the acquired data. Most of the reported results passed different statistical evaluation criterion such as relative bias, z-score and u-scores and ratio of our results and IAEA target values. One element (Yb) falls in the unacceptable range of relative bias and z-scores. Hf and Tb showed slightly high z-scores within the questionable range. Ho, Mo and Sn were determined during this study but their results were not submitted to the IAEA. The confidence of accuracy observed for most of the elements in ceramic material has made it mandatory to report their results as information values.     

Aspects of proficiency testing studies of trace elements in environmental samples with a focus on laboratory performance

Four proficiency tests of environmentally significant elements in soil and water are described. The effects of sample matrix, analyte, sample preparation procedure, extraction method efficiency and instrumental technique on laboratory performance were assessed. Participants’ performance was evaluated using z scores and E _n scores. One study included dried sediment and sediment digest as test samples. By testing both dried sediment and sediment digest in the same study, differences in laboratories’ results due to the extraction method or instrumental technique were evaluated. Cadmium and nickel were the elements with the most unsatisfactory z scores for dried sediment compared to sediment digest. The second study had as test samples river water and river water fortified with biosolid. For an evaluation of the efficiency of participants’ extraction method, the results reported for the analysis of river water were compared to the results for analysis of the same river water fortified with biosolid. No consensus could be found between participants’ results for Cr and Ni in this study as the extraction method employed by them produced results that were too variable. The last two studies included saline and fresh water samples. The analysis of fresh and saline water samples with similar analyte concentrations assisted laboratories in developing their methods for trace elements in saline water. For Cr, Pb and Se, the assigned values were reference values traceable to SI, measured using isotope dilution inductively coupled plasma mass spectrometry. Saline water containing low concentrations of analytes presented difficulties to some laboratories. Arsenic and selenium were the analytes most difficult to analyse in all types of environmental samples.     

Capabilities of laboratories to determine melamine in food—results of an international proficiency test

A proficiency test to assess the capabilities of laboratories to determine melamine in a milk powder and a baking mix, representing starch-containing foods like bread and biscuits, was carried out in January 2009. The need for such an interlaboratory comparison arose from a health scare in China about melamine-tainted powdered milk in the second half of 2008. Laboratories in 31 countries, including Australia, China, India, Japan, New Zealand and the USA, and 21 of the 27 Member States of the European Union participated and reported back 114 results for the milk powder and 112 for the baking mix test materials. The reported results were compared to reference values determined by exact-matching double isotope dilution mass spectrometry. The so-determined assigned values were 10.0 ± 0.6 mg/kg melamine in the milk powder and 3.18 ± 0.17 mg/kg melamine in the baking mix. A coverage factor k of 2 was applied to calculate the expanded uncertainties. Three quarters of all reported results for both materials had associated z scores which were satisfactory (z ≤ |2|). Of the reported results, 90% was accompanied by a measurement uncertainty statement, and the majority of the measurement uncertainty ranges were reasonable. A number of laboratories were found to underestimate their measurement uncertainties. Methods that involved the use of stable-isotope-labelled melamine were shown to be clearly advantageous with regard to the accuracy of the results. However, no significant influence by other method parameters could be identified.     

Analytical performance is improved by regular participation in proficiency testing: an analysis of data from the Aquacheck proficiency testing scheme

Analysis of historical data from the Aquacheck proficiency testing scheme demonstrates improvement in the performance of participants correlated to the frequency of participation. Analysis of the spread of results returned by all participants, defined by the percentage relative standard deviation (RSD) and the performance (Z) scores awarded to the individual participants, indicates that the overall performance for the group of participants is consistent. However, when the frequency of participation is analysed, it can be clearly seen that those laboratories who participated in the majority of the distributions available reported 10–15% more acceptable (Z-scores between +2 and ?2) results than those labs who took part with a greatly reduced frequency. When ‘more difficult’ analytes are considered, those laboratories who participated in greater than 75% of available rounds reported up to 30% more acceptable results than those laboratories who participated in 25% or fewer, of the available rounds.     

Identification of possible technical problems in determination of the major inorganic constituents of brown-rice flour by evaluating proficiency test results

To support skill upgrading in analysis of inorganic constituents of environmental and food samples, the National Metrology Institute of Japan (NMIJ) and the National Food Research Institute (NFRI) have organized a proficiency test (PT) of determination of Mn, Fe, Cu, Zn, As, and Cd in brown-rice flour based on the international standard (ISO/IEC 17043:2010). One hundred and thirty-three sets of reports were assessed by use of the E _n -number and z-score approaches in accordance with ISO/IEC 17043 and the international harmonized protocol for PT. The PT results and analytical procedures, reported in detail, were reviewed, and possible technical reasons for questionable or unsatisfactory results are discussed.

The application of data from proficiency testing to laboratory accreditation according to ISO 17025

Current methods of testing laboratories for their proficiency in reporting correct measurement results are liable to substantial errors of the second kind. This means that laboratories with deflated uncertainties are accepted as proficient, even though their reported measurement results pave the way for erroneous conclusions. Only by using E _n numbers based on an accepted reference value with the lowest possible uncertainty can the risk of recognising incorrect measurement results be kept at an acceptable level. Based on an actual set of proficiency test (PT)-data for the concentration of Pb in water, this paper compares PT results obtained by methods using E _n numbers with methods based on z-scores. Kaj Heydorn is a technical assessor at The Danish Accreditation and Metrology Fund (DANAK).     

The influence of a quality system according to ISO/IEC 17025 on the performance of Brazilian laboratories in proficiency testing in the environmental area

This paper presents a performance analysis of laboratories in proficiency testing (PT) with the main objective of evaluating whether having accreditation to ISO/IEC 17025 or not having an implemented quality system has an influence on the performance of these laboratories. This research was conducted with data from an accredited PT scheme of physical–chemical water analyses. Nine metals were considered in the analysis, with a total of 896 results. The performance indicator was z-score. The proposed analysis was conducted through statistical methods of analysis of variance, Dunnett’s test, Chi-square and cross-tabulation. It was verified that there is a significant difference between the performance of accredited laboratories, recognised laboratories, and laboratories that do not have an implemented quality system. It was established that an accredited or recognised quality system has a positive influence on the laboratory performance, resulting in a lower z-score (in module) and in a larger percentage of satisfactory results.     

An interlaboratory study as useful tool for proficiency testing of chemical oxygen demand measurements using solid substrates and liquid samples with high suspended solid content

In 2008, the first Proficiency Testing Scheme of Chemical Oxygen Demand (1^stCOD-PT^ADG) was conducted to assess the results obtained for different research groups whose field work is mainly anaerobic digestion. This study was performed using four samples, two solid samples as raw materials and two solid samples to prepare high concentration suspended solid solutions. Invitations were sent to a large number of laboratories, mainly to anaerobic digestion research groups. Finally, thirty labs from sixteen countries agreed to participate, but for different reasons four participants could not send any data. In total, twenty-six results were reported to the COD-PT coordinator.This study showed the importance of continuous participation in proficiency testing (PT) schemes in order to compare the results obtained. Taking into account the lack of a general standard method and high quality certified reference materials (CRMs), the traceability of COD determination is not currently easy to check. In addition, the spread of participants’ results obtained was high and pointed to the advisability of using consensus values due to their unreliability. Therefore, the theoretical oxygen demand (ThOD) values were considered as assigned values for all the samples analysed. On the other hand, in this PT the established standard deviation (ESD) has been determined by the Horwitz modified function.Participants of this 1^stCOD-PT^ADG were asked to give a short report on the analytical method used. Although all the participants used potassium dichromate as their oxidant reagent, their experimental procedures were very different. With the purpose of comparing the results obtained, the different experimental conditions used were classified into five methods, corresponding to two main categories, open and closed reflux. The performance of laboratories was expressed by the z-score, whose value is considered satisfactory when z-score ≤±2. The overall analytical data evaluation showed that 64% of z-scores obtained were outside the accepted limits.     

Evaluation of the use of consensus values in proficiency testing programmes

Proficiency testing (PT) is an essential tool used by laboratory accreditation bodies to assess the competency of laboratories. Because of limited resources of PT providers or for other reasons, the assigned reference value used in the calculation of z-score values has usually been derived from some sort of consensus value obtained by central tendency estimators such as the arithmetic mean or robust mean. However, if the assigned reference value deviates significantly from the ‘true value’ of the analyte in the test material, laboratories’ performance will be evaluated incorrectly. This paper evaluates the use of consensus values in proficiency testing programmes using the Monte Carlo simulation technique. The results indicated that the deviation of the assigned value from the true value could be as large as 40%, depending on the parameters of the proficiency testing programmes under investigation such as sample homogeneity, number of participant laboratories, concentration level, method precision and laboratory bias. To study how these parameters affect the degree of discrepancy between the consensus value and the true value, a fractional factorial design was also applied. The findings indicate that the number of participating laboratories and the distribution of laboratory bias were the prime two factors affecting the deviation of the consensus value from the true value.     

Visualisation of proficiency test exercise results in Kiri plots

A novel graphical method (‘Kiri plots’) for the presentation of proficiency test exercise results is presented. The Kiri plot visualises the evaluation of the proficiency test results based on three statistical tests (the z score, the zeta score and the relative uncertainty outlier test) by defining six zones including a central “in agreement” zone.     

Performance evaluation of polycyclic aromatic hydrocarbons analysis in sediment from proficiency testing with metrological reference values

This paper describes a metrological approach to evaluate the measurement capability of laboratories participating in two proficiency testing (PT) programmes involving the analysis of five polycyclic aromatic hydrocarbons (PAHs) in sediment samples. Reference values of PAHs in the programmes for performance assessment were obtained from an accurate isotope dilution gas chromatography mass spectrometry (ID-GCMS) method which was thoroughly validated and verified. Isotope dilution mass spectrometry (IDMS) technique usually has a well-defined measurement uncertainty budget and a traceability link to an International System of Units. Provision of the metrological reference values in PT enables the establishment of a technical platform to assess the actual competence of the participating laboratories in sediment PAHs analysis. Results of the PT programmes showed that about 80 % of the laboratories employed gas chromatography in their analyses and the remaining used liquid chromatography. Irrespective of the techniques being used, however, the majority of the participating laboratories were observed to underestimate values in which the mean values of the five reported PAHs were less than those of the ID-GCMS-derived reference values by 13–20 %. Only 41–44 % of the participating laboratories were able to achieve satisfactory z-scores. The present study revealed that the reinforcement of the capability for accurate measurement of PAHs in sediment samples in laboratories worldwide should be addressed.