Direct detection of alkylphosphonic acids in environmental matrices by proton coupled phosphorus NMR

A simple, convenient, and direct one‐dimensional (1D) ³¹P NMR technique is demonstrated for the detection of alkylphosphonic acids (marker of nerve agents). The results of detection were validated after conducting various in‐house exercises. The confidence generated by this study was found very useful in detection of different alkylphosphonic acids spiked in various official interlaboratory proficiency tests conducted by Organisation for the Prohibition of Chemical Weapons (OPCW). Copyright © 2009 John Wiley & Sons, Ltd.     

The role of proficiency testing in method validation

The general principle of using data collected during proficiency testing (PT) for the additional purpose of assessing method performance is discussed. Particular attention is paid to the similarities and differences in conduct of traditional interlaboratory method performance studies and proficiency testing. Recommendations are made for implementing PT-based method performance studies, including statistical assessment of the data. It is concluded that, properly implemented, PT-based method performance study provides essentially equivalent information to that obtained from traditional collaborative study and may be used in appraising candidate methods with a view to their adoption as standard methods.     

Relationship of (known) control values to (unknown) test values in proficiency studies of pesticide residues

Proficiency studies have been suggested as an alternative source of information for evaluating method performance characteristics when results from interlaboratory method performance studies conforming to internationally recognized protocols are not available. To explore this possibility, results were examined from ongoing proficiency studies of pesticide residue analyses in celery, carrot, and grape purees, and in wine. Statistical performance parameters were calculated from 18 data sets analyzed as unknowns by about 60 analysts for 12 analytes in the 25-1,000 microg/kg range, and from presumably parallel control (spike) analyses conducted by about half of the participants. A surprising finding was that recovery of known, independent control additions by the participant did not correlate with the recoveries determined as unknowns in the exercise. The data suggest that censoring or truncating of control data has occurred. The question of substitution of proficiency data for method performance data cannot be answered until the problem of unbiased reporting of control data is resolved.     

Multielement trace determination in SiC powders: assessment of interlaboratory comparisons aimed at the validation and standardization of analytical procedures with direct solid sampling based on ETV ICP OES and DC arc OES

The members of the committee NMP 264 “Chemical analysis of non-oxidic raw and basic materials” of the German Standards Institute (DIN) have organized two interlaboratory comparisons for multielement determination of trace elements in silicon carbide (SiC) powders via direct solid sampling methods. One of the interlaboratory comparisons was based on the application of inductively coupled plasma optical emission spectrometry with electrothermal vaporization (ETV ICP OES), and the other on the application of optical emission spectrometry with direct current arc (DC arc OES). The interlaboratory comparisons were organized and performed in the framework of the development of two standards related to “the determination of mass fractions of metallic impurities in powders and grain sizes of ceramic raw and basic materials” by both methods. SiC powders were used as typical examples of this category of material. The aim of the interlaboratory comparisons was to determine the repeatability and reproducibility of both analytical methods to be standardized. This was an important contribution to the practical applicability of both draft standards. Eight laboratories participated in the interlaboratory comparison with ETV ICP OES and nine in the interlaboratory comparison with DC arc OES. Ten analytes were investigated by ETV ICP OES and eleven by DC arc OES. Six different SiC powders were used for the calibration. The mass fractions of their relevant trace elements were determined after wet chemical digestion. All participants followed the analytical requirements described in the draft standards. In the calculation process, three of the calibration materials were used successively as analytical samples. This was managed in the following manner: the material that had just been used as the analytical sample was excluded from the calibration, so the five other materials were used to establish the calibration plot. The results from the interlaboratory comparisons were summarized and used to determine the repeatability and the reproducibility (expressed as standard deviations) of both methods. The calculation was carried out according to the related standard. The results are specified and discussed in this paper, as are the optimized analytical conditions determined and used by the authors of this paper. For both methods, the repeatability relative standard deviations were <25%, usually ~10%, and the reproducibility relative standard deviations were <35%, usually ~15%. These results were regarded as satifactory for both methods intended for rapid analysis of materials for which decomposition is difficult and time-consuming. Also described are some results from an interlaboratory comparison used to certify one of the materials that had been previously used for validation in both interlaboratory comparisons. Thirty laboratories (from eight countries) participated in this interlaboratory comparison for certification. As examples, accepted results are shown from laboratories that used ETV ICP OES or DC arc OES and had performed calibrations by using solutions or oxides, respectively. The certified mass fractions of the certified reference materials were also compared with the mass fractions determined in the interlaboratory comparisons performed within the framework of method standardization. Good agreement was found for most of the analytes.     

The evaluation of the scoring systems: the fixed effects model under known variances

A number of scoring systems for proficiency testing and interlaboratory comparison are in use by the metrology community. The choice of scoring system for a given study is often based on the study coordinator’s experience and anecdotal knowledge, perhaps attributable to a historic lack of detailed and formal explanation about the foundation of these systems. This has influenced the development of new scoring systems, some of them departing from the well-established hypothesis testing theory. Often, different scoring systems give different results not because one may be better than the others but because, as they are documented, the user cannot control the confidence level of the test. We present a formal evaluation of seven of these systems under the fixed effects model assuming known variances. Under these sound assumptions, the systems analyzed all have the same statistical properties. Furthermore, these systems are all members of a family of systems based on strictly increasing functions in which the statistical decision problem is invariant. Under the fixed effects model with known variances, no unbiased scoring system can provide greater statistical power than the members of this family of systems. We apply these results to the lead content of water example provided in International Standard ISO 13528:2015 “Statistical methods for use in proficiency testing by interlaboratory comparisons.”     

Detection of genetic modification in cured tobacco leaf: proficiency testing using polymerase chain reaction-based methods

The Cooperation Centre for Scientific Research Relative to Tobacco (CORESTA; Paris, France) "Task Force Genetically Modified Tobacco-Detection Methods" investigated the performance of qualitative and quantitative methods based on the polymerase chain reaction (PCR) for the detection and quantitation of genetically modified (GM) tobacco. In the 4 successful rounds of proficiency testing, the cauliflower mosaic virus 35S RNA promoter (CaMV 35S) and the Agrobacterium tumefaciens nopaline synthase terminator (NOS) were selected as target sequences. Blind-coded reference materials containing from 0.1 to 5.0% and from 0.15 to 4% GM tobacco were used in 2 rounds of qualitative and quantitative PCR, respectively. Eighteen laboratories from 10 countries participated in this study. Considering all methods and 2 rounds, the different laboratories were able to detect GM tobacco at the 0.1% level in 46 out of 58 tests in qualitative assays. The results of the proficiency test indicate that both end point screening and real-time quantitative methods are suitable for the detection of genetically modified organisms in tobacco leaf samples having a GM content of 0.1% or higher. The CORESTA proficiency study represents a first step towards the interlaboratory evaluation of accuracy and precision of PCR-based GM tobacco detection, which may lead to the harmonization of analytical procedures and to the enhancement of comparability of testing results produced by different laboratories.     

Interlaboratory comparison of test results of an ordinal or nominal binary property: analysis of variation

Applications of a new statistical method Ordinal Analysis of Variance (ORDANOVA) for interlaboratory comparisons of measurement or test results of semi-quantitative (ordinal) and qualitative (binary) properties are discussed. ORDANOVA can be helpful for validation of measurement or test methods, proficiency testing of laboratories, development of reference materials with certified semi-quantitative and qualitative properties, that is, probably in every field where ANOVA is applied for quantitative properties. A statistics and criteria are proposed for performance assessment of laboratories active in semi-quantitative and qualitative testing and for other purposes of statistical analysis of such test results.     

Proficiency testing in food microbiology “Aqua”: enumeration of Staphylococcus aureus

In 1999 the Food Microbiology laboratory of the Istituto Zooprofilattico Sperimentale delle Venezie (IZSVe) started an interlaboratory comparison program for food microbiological tests, known as “Aqua, interlaboratory comparisons for quality assurance”. Aqua produces the test samples, applies statistical methods to estimate homogeneity and stability, processes and evaluates the results. The proficiency testing results allow to evaluate the performance of the laboratories, to identify possible differences and non-conformity, to demonstrate the competence and the quality of results, in order to take suitable corrective and/or preventive action after the individuation of the causes. Moreover, elaborating the results of several proficiency testing by using the control chart method, it is possible to evaluate the trend of the laboratory and to verify that the results are in statistical quality control.     

From GUM to alternative methods for measurement uncertainty evaluation

Since the advent of the Guide to the expression of Uncertainty in Measurement (GUM) in 1995 laying the principles of uncertainty evaluation numerous projects have been carried out to develop alternative practical methods that are easier to implement namely when it is impossible to model the measurement process for technical or economical aspects. In this paper, the author presents the recent evolution of measurement uncertainty evaluation methods. The evaluation of measurement uncertainty can be presented according to two axes based on intralaboratory and interlaboratory approaches. The intralaboratory approach includes “the modelling approach” (application of the procedure described in section 8 of the GUM, known as GUM uncertainty framework) and “the single laboratory validation approach”. The interlaboratory approaches are based on collaborative studies and they are respectively named “interlaboratory validation approach” and “proficiency testing approach”.     

Capabilities of laboratories to determine melamine in food—results of an international proficiency test

A proficiency test to assess the capabilities of laboratories to determine melamine in a milk powder and a baking mix, representing starch-containing foods like bread and biscuits, was carried out in January 2009. The need for such an interlaboratory comparison arose from a health scare in China about melamine-tainted powdered milk in the second half of 2008. Laboratories in 31 countries, including Australia, China, India, Japan, New Zealand and the USA, and 21 of the 27 Member States of the European Union participated and reported back 114 results for the milk powder and 112 for the baking mix test materials. The reported results were compared to reference values determined by exact-matching double isotope dilution mass spectrometry. The so-determined assigned values were 10.0 ± 0.6 mg/kg melamine in the milk powder and 3.18 ± 0.17 mg/kg melamine in the baking mix. A coverage factor k of 2 was applied to calculate the expanded uncertainties. Three quarters of all reported results for both materials had associated z scores which were satisfactory (z ≤ |2|). Of the reported results, 90% was accompanied by a measurement uncertainty statement, and the majority of the measurement uncertainty ranges were reasonable. A number of laboratories were found to underestimate their measurement uncertainties. Methods that involved the use of stable-isotope-labelled melamine were shown to be clearly advantageous with regard to the accuracy of the results. However, no significant influence by other method parameters could be identified.     

Interlaboratory study to improve the quality of trace element determinations in rainwater

This is the first publication which describes the development of a reference material (RM) for the determination of 11 trace elements (Cu, Pb, Mn, Ni, Zn, Fe, Cd, Co, V, As and Al) in rainwater at microgram per liter concentrations. An interlaboratory comparison study for the determination of trace elements in rainwater was carried out for material performance studies to establish analyte concentrations with a stated uncertainty. Fifteen reputed laboratories from Asia, Europe and North America participated in the study. These laboratories used their regular in-house methods to analyze the rainwater samples. The aim of this study is to establish concentration levels of trace elements in rainwater based on interlaboratory study results. Details of the production, homogeneity and stability of the reference sample are given in this article. The organization of the study and the quality assurance measures undertaken at the organizer's laboratory are described. The analytical results obtained from individual laboratories and the analytical methods used for the determination of trace elements in rainwater are discussed. Based on the results obtained from the intercomparison study, certified values as well as informative values are assigned to the 11 trace elements in rainwater.     

The external quality assurance of phylloquinone (vitamin K1) analysis in human serum

The vitamin K external quality assurance scheme (KEQAS) aims to assist in the harmonization of phylloquinone (vitamin K₁) analysis in order to improve the comparability of clinical and nutritional studies. Serum samples were despatched to 17 groups from eight countries during 2000–2006. Using pilot data (1996–1999), an analytical performance target of 20% absolute difference from the all‐laboratory trimmed mean (ALTM) was assigned and formed the basis for interlaboratory comparison. Assay specificity, analytical bias and assay performance were evaluated. From 21 batches of samples distributed, 414 results were reported of which 2.7% were outliers. The mean interlaboratory absolute difference from the ALTM was 21.7% with 47% of groups consistently meeting the performance target. The mean interlaboratory coefficient of variation was 29.6%. The false positive rate for phylloquinone depleted samples was high at 35%. Bias was found to be independent of HPLC‐detector type (fluorescence vs electrochemical). Assay characteristics for the measurement of phylloquinone in human serum compare favourably with methods for analytes at equivalent concentrations. The high proportion of false positive results suggest that poor assay specificity at low phylloquinone concentrations is a common problem, which in the clinical setting could lead to underreporting of vitamin K deficiency. Copyright © 2009 John Wiley & Sons, Ltd.     

能力验证及其评价

The definitions, purposes and uses of proficiency testing and interlaboratory comparison were expounded in detail. Main types of proficiency testing were illustrated. Special emphases were made on the organization, practice and evaluation of the planning of proficiency testing. Related policies about proficiency testing given by the China National Accreditation Board for Laboratories （CNAL） were also briefly introduced.     

Determination of inorganic arsenic(III) and arsenic(V) in water samples by ion chromatography/inductively coupled plasma-mass spectrometry

A method was validated for the direct determination of As(III) and As(V) in water samples by ion chromatography/inductively coupled plasma-mass spectrometry. Sample preservation required only dilution with a mobile phase containing a sufficient amount of ethylenediaminetetraacetic acid and acetic acid. Analyses of 6 certified reference materials (CRMs) of various water matrixes, including seawater, demonstrated good method accuracy. The matrixes included 2 natural water samples [National Institute of Standards and Technology Standard Reference Material (NIST SRM) 1643e and NIST SRM 1640], 1 fortified standard solution (TMDA-64), 1 fortified water sample (TM-DWS), and 2 seawater samples (CASS-4 and NASS-5). The sum of As(III) and As(V) in each CRM agreed with the respective certified value for the total amount of As within its stated uncertainty. Quantitative recoveries (96.7-102.1%) were obtained. Satisfactory results were achieved for intraday repeatability [relative standard deviation (RSD = 0.3-5.1%] and interday precision (RSD = 0.7-4.1%). In the study of fortified blanks and fortified CRMs, quantitative recoveries of As(III) and As(V) (92.5-102.6%) were obtained. Interconversion of As(III) and As(V) was not observed under the conditions of sample preservation. International comparability of analytical results was demonstrated by the analysis of 2 interlaboratory proficiency test samples, NY7011 and NY8511, from the New York State Department of Health.     

Capability of laboratories to determine core nutrients in foods: results of an international proficiency test

A proficiency test (PT) to assess the capabilities of laboratories to determine nutrients in a biscuit sample was carried out in September 2009. The need for such interlaboratory comparison arose from an increasing nutrition labeling requirements of different countries around the world. Forty-eight laboratories worldwide participated in this PT program for the determination of total lipids, saturated fat, trans-fat, protein, sugars, total dietary fiber (TDF), ash and sodium in food. This program was organized under the auspices of the Asia-Pacific Laboratory Accreditation Cooperation (APLAC). APLAC considers PT programs as one of the objective means of assessing the performance of the accredited laboratories. The program is one of the APLAC PT series whose primary purposes are to establish mutual agreement on the equivalence of the operation of APLAC member laboratories and to provide an opportunity to identify testing deficiency so that corrective actions can be taken, if necessary. The results of this program indicated that the consensus mean values estimated by robust statistics were in good agreement with the corresponding values obtained in the homogeneity tests except for trans-fat and TDF. The relative standard deviations of participant results for trans-fat and TDF were also found to be higher (19 and 24%, respectively) than the other test parameters. The relative standard deviations for other test parameters were less than 10%. One-half of the laboratories obtained satisfactory z-scores (| z | < 3) (\left| z \right| < 3) for all their reported results. Although participants were instructed to provide the measurement uncertainties of their reported results, only 27.5% of them had done so. Albeit many of the measurement uncertainties appear to be reasonable, some of them were found to vary widely, indicating that some laboratories still have difficulties in estimating measurement uncertainties. Although the overall measurement capability can be considered to be satisfactory, there is still room for improvement of analytical procedures.     

EQRAIN: uranium and plutonium interlaboratory exercises from 1997 to 2016—comparison to ITVs-2010

Since 1987, the CEA’s Committee for the establishment of analysis methods (CETAMA) has regularly implemented interlaboratory comparisons, entitled “evaluation of the quality results of analysis in the nuclear industry” (EQRAIN). Notably, the EQRAIN U and EQRAIN Pu interlaboratory comparisons assess proficiency in measuring a mass content of uranium or plutonium in reference solutions. This paper presents the results of measurement uncertainty assessments from EQRAIN U and EQRAIN Pu comparisons over 20 years of exercises (1997–2016). The mathematical approach developed in this work allowed to estimate the impact of short-term systematic and random errors to the overall uncertainty of each analytical method used in the interlaboratory comparison program. This statistical analysis shows a good consistency between measurement uncertainty values from EQRAINs and the measurement uncertainty target values established by the International Atomic Energy Agency for nuclear material balances (ITVs-2010).

     

Quality control in extended measurement campaigns: selection of contract laboratories by proficiency testing exemplified for the trace analysis of anilines in groundwater

An interlaboratory comparison for the determination of aniline, nine methylated anilines and chlorinated anilines in contaminated groundwater (each compound between 1 µg L^?1 and 750 µg L^?1) was conducted as proficiency test for the selection of contract laboratories for a groundwater monitoring campaign. For the 13 participants, two different test sample series were prepared from a stabilized real case groundwater. Series A was the groundwater as sampled in the field and series B was prepared from series A by spiking with selected anilines. Homogeneity and stability investigations revealed that contaminated groundwater provides a viable basis for the preparation of ring test samples for the determination of anilines. Analytical procedures were limited to the standardized liquid–liquid extraction or solid-phase extraction in combination with gas chromatography/mass spectrometry (DIN 38407-16:1999). The robust consensus values were evaluated according to the standardized protocol of DIN 38402-45:2013. Robust reproducibility standard deviations ranged largely between 20?% and 60?% depending on the analyte. The proficiency assessment of individual participants combined the qualitative aspect of correct peak identification with the quantitative determination of individual concentrations within set limits in a unified approach. It could be shown that the accreditation status of laboratory and the existence of a standardized analytical procedure do not substitute a problem-related proficiency assessment of potential contractors.     

Relationship between performance characteristics obtained from an interlaboratory study programme and combined measurement uncertainty: a case study

 In the interlaboratory study programme "ILS Coal Characterisation", eight interlaboratory studies were organised based on the ISO standards for coal analysis. The use of blind samples in each round allows comparability of measurement results between rounds to be assessed. Based on the results, it could be demonstrated that the vast majority of the measurement results of the laboratories were traceable to results obtained in previous rounds of this programme. The hypothesis has been formulated that the combined standard uncertainty obtained from an interlaboratory study is equal to the reproducibility standard deviation. Whether the reproducibility can be used as the basis for the certification depends on whether the interlaboratory study includes all effects to be taken into account for establishing an uncertainty statement. Received: 12 April 1998 · Accepted: 2 July 1998     

Is the assessment of interlaboratory comparison results for a small number of tests and limited number of participants reliable and rational?

Tests and/or test items can sometimes be expensive, unique, or only performed in a few laboratories. There can be cases where assigned values are unknown, there is no information, or only poor information on the probability density function attributed to the test result. Sometimes there are neither reference materials nor the ability to establish consensus values due to a lack of experts. It can be impossible to repeat a test on the same item because it is destroyed during the test itself, or the homogeneity of tested items is unknown and no criteria can be established. Specified technical requirements concerning proficiency testing and interlaboratory comparison schemes are generally not applicable in this situation. However, interlaboratory comparison could allow laboratories to have more confidence in their results. The present paper discusses three statistical methods of assessing interlaboratory comparison results obtained in such conditions. Two methods are based on an assigned value determined from participant results through robust analysis. The third is based on the compatibility of results assessed using the ζ parameter. This paper focuses on an interlaboratory comparison for two laboratories, each testing three samples. The use of statistical methods turns out to be high risk, particularly in terms of falsely accepting results. Additionally, is shown that methods dedicated to small samples are also not efficient in detecting discrepancies of test results.