Proficiency testing in food microbiology: experience from implementation of ISO/IEC 17043 and ISO/TS 22117

The proficiency testing (PT) scheme ??AQUA?? for food microbiology was organised by the Istituto Zooprofilattico Sperimentale delle Venezie (IZSVe) according to ISO/IEC 17043 and ISO/TS 22117. This paper describes the IZSVe experience on the application of the above-mentioned standards for the PTs, with focus on the Enterobacteriaceae enumeration one. Freeze-dried food matrices contaminated with American Type Culture Collection bacterial strains were used as test samples for each microbiological PT organised by IZSVe. The sample homogeneity and stability were verified prior to distribution to participants and throughout the PT, respectively. The participating laboratories analysed samples using their routine methods, and results were transmitted to IZSVe. Data and methods used by each participating laboratory were analysed in order to evaluate the laboratory performance. With reference to the Enterobacteriaceae PT, the test samples were homogeneous and stable. In addition, most laboratory results were obtained using equivalent test methods. Statistical approaches applied to analyse data generated from all participating laboratories revealed similar outcomes as no significant outlying count and only 5?% of unacceptable results were observed. Finally, the z-score, with the standard deviation that does not vary from round toround, was applied to compare and to evaluate the performance of each laboratory over time highlighting possible persistent trends over several rounds.     

Evaluation of the use of consensus values in proficiency testing programmes

Proficiency testing (PT) is an essential tool used by laboratory accreditation bodies to assess the competency of laboratories. Because of limited resources of PT providers or for other reasons, the assigned reference value used in the calculation of z-score values has usually been derived from some sort of consensus value obtained by central tendency estimators such as the arithmetic mean or robust mean. However, if the assigned reference value deviates significantly from the ‘true value’ of the analyte in the test material, laboratories’ performance will be evaluated incorrectly. This paper evaluates the use of consensus values in proficiency testing programmes using the Monte Carlo simulation technique. The results indicated that the deviation of the assigned value from the true value could be as large as 40%, depending on the parameters of the proficiency testing programmes under investigation such as sample homogeneity, number of participant laboratories, concentration level, method precision and laboratory bias. To study how these parameters affect the degree of discrepancy between the consensus value and the true value, a fractional factorial design was also applied. The findings indicate that the number of participating laboratories and the distribution of laboratory bias were the prime two factors affecting the deviation of the consensus value from the true value.     

The application of data from proficiency testing to laboratory accreditation according to ISO 17025

Current methods of testing laboratories for their proficiency in reporting correct measurement results are liable to substantial errors of the second kind. This means that laboratories with deflated uncertainties are accepted as proficient, even though their reported measurement results pave the way for erroneous conclusions. Only by using E _n numbers based on an accepted reference value with the lowest possible uncertainty can the risk of recognising incorrect measurement results be kept at an acceptable level. Based on an actual set of proficiency test (PT)-data for the concentration of Pb in water, this paper compares PT results obtained by methods using E _n numbers with methods based on z-scores. Kaj Heydorn is a technical assessor at The Danish Accreditation and Metrology Fund (DANAK).     

Proficiency testing in the light of a new rationale in metrology

The novel proposed definition of measurement result in the international metrology vocabulary requires a revision of standards and guidelines for proficiency testing (PT), and a new approach to processing proficiency data is needed to test the ability of laboratories to present not only unbiased quantity values, but reliable estimates of their uncertainty. Hence, an accepted reference value with the smallest possible uncertainty is needed to ascertain the proficiency of laboratories reporting results with lower than average uncertainty. A strategy based on the T-statistic is proposed leading to an accepted reference value that fully reflects the uncertainties reported by participants in a PT scheme and permits calculation of E _n numbers to distinguish whether or not measurement results are consistent with the accepted definition of the measurand. The strategy is applied to PT data from a recent international laboratory intercomparison of uranium isotopic ratios.     

Use of uncertainty estimates as reported by participants in proficiency testing for the evaluation of their results: pros and cons

The aim of this paper is to study the measurement uncertainties reported in proficiency tests (PTs) using examples from PTs in the environmental sector and to compare the obtained measurement uncertainty estimates using different approaches. In addition, the paper focusses on the differences between the z-score and the zeta score. Since the year 2000, the Finnish Environment Institute has asked participants to report analytical methods as well as measurement uncertainties in connection with PT results. The measurement uncertainties of the assigned value have also been evaluated. On the basis of the results, the measurement uncertainties reported by the participants varied greatly. Participants often reported underestimated measurement uncertainties, but overestimated uncertainties were also reported. At the moment, it seems as if performance assessment should be based on the z-score because of a number of significant over- and underestimated measurement uncertainties. The zeta score should be used for information and educational purposes mainly.     

A new approach in assessing microbiological results in water analysis proficiency testing

Due to the relatively large spread in the results of microbiological proficiency tests, the z-scores are often not able to detect zero or low results as being ‘bad’ results. This paper describes an adapted z-score based on the average or the standard deviation of the 50% ‘highest’ results. The combination of the adapted z-scores of four samples enables a better judgement of the performance of each laboratory. Papers published in this section do not necessarily reflect the opinion of the Editors, the Editorial Board or the Publisher.     

Slater Sum in Cylindrically Symmetric Inhomogeneous Electron Liquids: Towards A Differential Equation for the Stark Effect in Hydrogen Atom

Abstract

Attention is focussed here on a variety of cylindrically symmetric inhomogeneous electron liquids. These include separable potentials in which a general variation along the (z) axis of cylindrical symmetry is combined with isotropic harmonic confinement in the (x, y) plane. in this case, an explicit differential equation is derived for the Slater sum along the z axis by projecting out of the (off-diagonal) canonical density matrix the states with zero angular momentum about the axis of symmetry. Some attention is then given to the calculation of the Slater sum for a hydrogen-like atom in a uniform electric field of arbitrary strength. the model of a separable potential with harmonic confinement, though no longer exact, is shown to lead directly to a (now approximate) equation for the Slater sum along the z axis for the Stark effect in hydrogen. Finally some further progress is shown to be possible in the extreme high field limit.     

Participation in IAEA proficiency test exercise on major,minor and trace elements in ancient Chinese ceramic (IAEA-CU-2006-06) using low power research reactor

A proficiency test (PT) exercise was offered by the International Atomic Energy Agency (IAEA) for major, minor and trace elements in Chinese ceramic reference material (IAEA-CU-2006-06). Neutron activation analysis (NAA) laboratory at PINSTECH, Pakistan participated in the exercise and submitted the results for 28 elements. The aim of participation was to develop a suitable methodology for accurate measurement of as many elements as possible in ceramic material using a low power reactor (PARR-2) as this would help future investigation in a project on the authenticity of art objects, for provenance, conservation and management of ancient cultural heritage of the country. After receiving the final report of the PT exercise, a critical review of our data and final scoring of each element is made to check the suitability of our methodology and reliability of the acquired data. Most of the reported results passed different statistical evaluation criterion such as relative bias, z-score and u-scores and ratio of our results and IAEA target values. One element (Yb) falls in the unacceptable range of relative bias and z-scores. Hf and Tb showed slightly high z-scores within the questionable range. Ho, Mo and Sn were determined during this study but their results were not submitted to the IAEA. The confidence of accuracy observed for most of the elements in ceramic material has made it mandatory to report their results as information values.     

Laboratory assessment by combined z score values in proficiency tests: experience gained through the European Union proficiency tests for pesticide residues in fruits and vegetables

The obligation for accredited laboratories to participate in proficiency tests under ISO 17025, performing multiresidue methods (MRMs) for pesticide residues, involves the reporting of a large number of individual z scores making the evaluation of the overall performance of the laboratories difficult. It entails, time and again, the need for ways to summarise the laboratory’s overall assessment into a unique combined index. In addition, the need for ways to continually evaluate the performance of the laboratory over the years is equally acknowledged. For these reasons, following 14 years of the European Union Reference Laboratory for Pesticide Residues in Fruits and Vegetables (EUPT-FV), useful formulas have been designed to globally evaluate the assessment of the participating laboratories. The aim is to achieve a formula which is easy to understand, which can be applied and which fits the purposes of long-term evaluation detecting positive and negative trends. Moreover, consideration is needed for a fair compensation of bad results in MRM, taking into account the large number of compounds that are covered. It is therefore important to be aware of the difficulties in getting satisfactory values from a wide range of compounds. This work presents an evaluation of the main well-established combined z score formulas together with those new ones developed here which have been applied to the European proficiency test results (EUPTs) over the years. Previous formulas such as the rescaled sum of z score (RSZ), the sum squared of z score (SSZ) and the relative laboratory performance (RLP) are compared with the newer ones: the sum of weighted z scores (SWZ) and the sum of squared z scores (SZ2). By means of formula comparisons, conclusions on the advantages, drawbacks and the most fit-for-purpose approach are achieved.     

Performance of commercial soil laboratories in a proficiency test program in Brazil

A soil proficiency test (PT) was administered to 50 participant laboratories in which two sets of samples, consisting of 20 yearly PT samples and 5 ‘blind’ samples in clients’ names were analyzed for pH, organic matter, total acidity, extractable calcium, magnesium, potassium and phosphorus by the laboratories. Our objective was to determine whether laboratories take extra care to analyze clients’ samples as they do with regular PT samples. The analytical data were evaluated essentially by the procedure described in the international harmonized protocol for proficiency testing of analytical chemistry laboratories. Performance of participant laboratories was assessed by z-scores and summary z-scores statistics involving sum of squared z-scores interpreted as chi-square ( c_n² ) \left( {\chi_{n}^{2} } \right) distribution for zero-centered z-scores with unit variance. From 8 750 determinations, outliers and stragglers accounted for less than 2% of the entire data. Over 93% of the data were satisfactory, whereas between 2 and 4% were either unsatisfactory or questionable in both the PT and ‘blind’ tests. On the basis of sum of squared z-scores interpreted from c_n² \chi_{n}^{2} distribution table, between 30 and 40% of the laboratories had more than 90% probability of having their measurement data within the robust mean and standard deviation for each soil parameter, while another 30–42% of the laboratories had less than 50% probability of having measurement data within the robust mean and standard deviation. Overall, 21 laboratories (42%) were ranked in Class A either in the PT or ‘blind’ tests out of which 12 of them (57%) retained this ranking in both tests. Fourteen laboratories (28%) were ranked in Class C in either the PT or ‘blind’ tests with only 5 of them (36%) consistently ranking in this class in both tests.     

The influence of a quality system according to ISO/IEC 17025 on the performance of Brazilian laboratories in proficiency testing in the environmental area

This paper presents a performance analysis of laboratories in proficiency testing (PT) with the main objective of evaluating whether having accreditation to ISO/IEC 17025 or not having an implemented quality system has an influence on the performance of these laboratories. This research was conducted with data from an accredited PT scheme of physical–chemical water analyses. Nine metals were considered in the analysis, with a total of 896 results. The performance indicator was z-score. The proposed analysis was conducted through statistical methods of analysis of variance, Dunnett’s test, Chi-square and cross-tabulation. It was verified that there is a significant difference between the performance of accredited laboratories, recognised laboratories, and laboratories that do not have an implemented quality system. It was established that an accredited or recognised quality system has a positive influence on the laboratory performance, resulting in a lower z-score (in module) and in a larger percentage of satisfactory results.     

Possible key intermediates in arsenic biochemistry: Synthesis and identification by liquid chromatography electrospray ionization mass spectrometry and high resolution mass spectrometry

Arsenic is a type 1 carcinogen and its toxicity is critically dependent on chemical speciation. However, after decades of research, the biogenesis of at least fifty naturally occurring arsenic species is still not well understood.Here, based on experimental work, it is proposed a set of pathways for the formation of multiple arsenic species that might help to clarify the present situation.These are focused on the thiol protein arsenic bond and on its interaction with reactive metabolites. In fact, arsenic bound to glutathione interacting with sulfur adenosyl methionine (SAM), MethylCB₁₂ and AdoCB₁₂, forms a number of complexes that might be key intermediates in arsenic biochemistry. These include dimethylarsino glutathione (DMAG) m/z 412 [M + H]⁺, synthesized non-enzymatically from glutathione and cacodylate. Trimethylarsonio glutathione (TMAG) m/z 426 [M]⁺ synthesized from DMA, GSH and SAM, apparently by a classical Challenger methylcarbonium attack. Tetramethyl arsonium ion m/z 135 [M]⁺ is formed in a third step, apparently by carbanion methylation. The presence of trimethylarsine oxide (TMAO) m/z 137 [M + H]⁺ is attributed to the hydrolysis of TMAG or TMA, or to carbanion methylation of dimethylarsinoyl glutathione (m/z 428 [M]⁺) formed from cacodylate and GSH. Cantoni type attacks of DMAG on SAM were unsuccessful, eventually due to competition of the trivalent S⁺ atom of SAM for the As^III atom attack. The presence of dimethylarsonio diglutathione (DMADG m/z 717 [M]⁺), is suggested to result from a GS^- attack on dimethylarsenoyl glutathione (m/z 428 [M + H]⁺). The presence of dimethylarsenoyladenosine (m/z 372 [M + H]⁺), trimethylarsenosugar adenine (m/z 370 [M]⁺), and dimethylthioarsenosugar adenine (m/z 388 [M + H]⁺), is explained by the synthesis of the pecursor dimethylarsonio-adenosine glutathione DMAAG (m/z 661 [M]⁺), a likely source of oxo-and trimethylated arsenosugars, as well as of thio-arsenosugars by the cleavage of its S-C bond. The results gathered suggest that cell vacuoles might play a major role in arsenic metabolism, and that the dominance of oxo-As sugars, in algae extracts, may be supported by a mechanism of synthesis independent of DMAAG (m/z 661).They also offer an explanation for the reason why arsenobetaine, and tetramethylarsonium are loosely bound to biotic tissues. Four arsenic species new to science, to the best of our knowledge, and a number of known arsenic compounds were synthesized in this work, identified by HPLC–ESI-MSⁿ and FTICR–ESI-MS, and suggestions regarding their mechanisms of synthesis were advanced. These results provide a framework for arsenic biochemistry which may explain the origin of a significant part of arsenic known metabolites.     

Note on the bimodal distribution of PT results

The practitioner’s report "Treatment of bimodality in proficiency test of pH in bioethanol matrix" by Sarmanho et al. deals with a proficiency test (PT) for the measurement of pH in bioethanol. One group of 19 participating laboratories used an electrode that contained saturated LiCl and the other one KCl. The results of the LiCl group are biased, and those of the KCl group are unbiased as compared with the assigned reference value \(y_\mathrm{{RM}}\), and hence, the distribution of the laboratory means is bimodal. In order to deal with this situation, Sarmanho et al. present and carry out two different methods of fitting the bimodal distribution of the laboratory means: a fit by a mixture of two normal distributions and a Gaussian kernel estimation. Since this rather advanced statistical analysis does not help to solve the practical problem, some recomendations of ISO 17043 are discussed that might be useful for the coordinator of the PT and as well for the participating laboratories.     

Implementation of proficiency testing schemes for a limited number of participants

A metrological background for the selection and use of proficiency testing (PT) schemes for a limited number N of laboratories-participants (less than 20–30) is discussed. The following basic scenarios are taken into account: (1) adequate matrix certified reference materials (CRM) or in-house reference materials (IHRM) with traceable property values are available for PT use as test items; (2) no appropriate matrix CRM is available, but a CRM or IHRM with traceable property values can be applied as a spike or similar; (3) only an IHRM with limited traceability is available. The discussion also considers the effect of a limited population of PT participants N _p on statistical assessment of the PT results for a given sample of N responses from this population. When N _p is finite and the sample fraction N/N _p is not negligible, a correction to the statistical parameters may be necessary. Scores suitable for laboratory performance assessment in such PT schemes are compared. Presented at the 3rd International Conference on Metrology, November 2006, Tel Aviv, Israel.     

Preparation of in-house reference material of benzylpenicillin in milk and results of a Brazilian proficiency testing scheme

Two milk test materials containing benzylpenicillin and a benzylpenicillin-free material were prepared and used for the operation of a Brazilian proficiency testing (PT) scheme according to the requirements of ISO/IEC 17043. The PT scheme was designed to include laboratories in charge of confirmatory analysis as well as screening analysis. Sets of sample vials, benzylpenicillin-free and spiked items containing 0.2 g of lyophilized milk, were distributed to each participant. Of 20 participants who reported screening data, 18 accomplished satisfying results, providing evidence of the capability of Brazilian laboratories to produce reliable qualitative information. The assigned value (robust average calculated from 6 results) and its uncertainty were (8.28 ± 0.52) μg/L. Participants’ performance was evaluated using z-scores. A small number of participants were able to report quantitative benzylpenicillin results, and consequently care should be taken in the interpretation of the laboratory’s performance, considering the statistical nature of z-scores. Long-term stability testing on remaining PT items showed that a stable benzylpenicillin quality control material was produced and can be used for internal quality control or validation purposes.     

Computer simulation of diffuse X-ray scattering by an aligned smectic C-like nematic phase

We report a new method for the quantitative analysis of diffuse X-ray scattering by some disordered smectic phases. Computer simulations of diffuse X-ray scattering are compared with actual diffraction patterns of a series of oriented liquid crystalline polymers TDI-C _m C _n . The simulation shows that both Bragg peaks (spots) and equidistant streaks (diffuse scatterings) are diffracted by one smectic C-like structure in which each of the molecular chains is displaced from its mean position by a random distance Δ _z , along the chain axis (z). This is a first type of disorder. By assuming a Gaussian distribution of the disordered displacements, the mean value of Δ _z has been determined from the position and intensity of the streaks and Bragg peaks for the polymers.     

The College of American Pathologists laboratory accreditation program

The College of American Pathologists (CAP) operates voluntary programs in proficiency testing (PT) and quality monitors, which are briefly described. Additionally, a peer-based laboratory accreditation program covers over 6,100 clinical laboratories. Participation requires successful PT and on-site inspections using a series of 18 checklists structured along traditional subdisciplines of laboratory medicine and anatomic pathology. The laboratory general checklist contains over 250 questions covering broad issues affecting all disciplines. Among these are three items within the computer services section that specifically probe the laboratory’s use of autoverification. Data autoverification is defined as the process by which the computer performs the initial verification of test results; any data that fall outside of set parameters should be reviewed by the human operator. Central to these questions is the role of the laboratory director in approving the rules and validation. CAP does not define the specific technical details, recognizing the uniqueness of each laboratory setting and the patients it serves. Received: 8 August 2002 Accepted: 10 August 2002 Presented at the European Conference on Quality in the Spotlight in Medical Laboratories, 7–9 October 2001, Antwerp, Belgium Correspondence to A. Rabinovitch     

Performance evaluation of polycyclic aromatic hydrocarbons analysis in sediment from proficiency testing with metrological reference values

This paper describes a metrological approach to evaluate the measurement capability of laboratories participating in two proficiency testing (PT) programmes involving the analysis of five polycyclic aromatic hydrocarbons (PAHs) in sediment samples. Reference values of PAHs in the programmes for performance assessment were obtained from an accurate isotope dilution gas chromatography mass spectrometry (ID-GCMS) method which was thoroughly validated and verified. Isotope dilution mass spectrometry (IDMS) technique usually has a well-defined measurement uncertainty budget and a traceability link to an International System of Units. Provision of the metrological reference values in PT enables the establishment of a technical platform to assess the actual competence of the participating laboratories in sediment PAHs analysis. Results of the PT programmes showed that about 80 % of the laboratories employed gas chromatography in their analyses and the remaining used liquid chromatography. Irrespective of the techniques being used, however, the majority of the participating laboratories were observed to underestimate values in which the mean values of the five reported PAHs were less than those of the ID-GCMS-derived reference values by 13–20 %. Only 41–44 % of the participating laboratories were able to achieve satisfactory z-scores. The present study revealed that the reinforcement of the capability for accurate measurement of PAHs in sediment samples in laboratories worldwide should be addressed.     

Do proficiency tests always verify laboratories’ performance? The case of FAPAS PT 0270

In this paper, the case of FAPAS PT 0270 “Doramectin and Oxfendazole in Sheep Liver” is discussed. During evaluation of the data received from participants (determination of total, oxidised oxfendazole residue and calculation of the sum of oxfendazole and oxfendazole sulfone residues), significant differences were observed between the results obtained by use of two analytical approaches. This phenomenon can be explained by the route of oxfendazole metabolism, which results in the presence of fenbendazole in the sample. This was not predicted by the provider; consequently, not all the necessary tests on the material were conducted. Due to the high uncertainty of the z-scores in this test, the results of the PT cannot be used for purposes of evaluation, and the benefits of participation in PT 0270 are questionable.     

Comparison of different statistical methods for evaluation of proficiency test data

In analytical chemistry, proficiency testing usually consists in tests that laboratories conduct under routine conditions and report the result to the PT provider who then converts the result to a score which helps the participant to assess the accuracy of the result. The aim of this work is to show PT providers, accreditations bodies, and participating laboratories that different scoring results can be achieved depending on the evaluation system selected. The influence of different evaluation techniques on the results of an interlaboratory comparison for determination of gold in precious metals alloys was investigated. Results from 19 participating laboratories were evaluated by means of the three procedures: (1) classical statistical approach—outliers detection; (2) robust methods—(2A) robust procedure and (2B) ISO 13528; and (3) fitness for purpose. Evaluation of the same PT data revealed very interesting issues depending on the different scoring systems that were used and the robustness of the statistical methods used for detecting outliers. As a general rule, laboratories with scoring Z > 2 offered clearly poorer performance in robust approaches than classical ones. In order to support this first evidence, we evaluated a second data set with results from 24 laboratories (mercury from soil samples) by means of the four mentioned approaches. Selection and comparison of different scoring systems must be done very carefully, because sometimes they are not the best approach for studying the data population or the more appropriate one for evaluating the distribution of the data. Finally it should be taken into account that sometimes the robust scoring systems are not always suitable for evaluating the results of some PT schemes.