234U and 238U in mineral water: reference value and uncertainty evaluation in the frame of an interlaboratory comparison

In 2007/2008 the Institute for Reference Materials and Measurements (IRMM) organised an interlaboratory comparison (ILC) on the determination of ²²⁶Ra, ²²⁸Ra, ²³⁴U and ²³⁸U activity concentrations in mineral water. This paper describes the determination of the reference values for the activity concentrations of ²³⁴U and ²³⁸U by radiochemical separation and α-particle spectrometry performed at two independent laboratories. The experimental uncertainty of the reference values is discussed in detail.     

Visualisation of interlaboratory comparison results in PomPlots

In this work a novel graphical method is applied to the presentation of intercomparison results. This is demonstrated with the results of a recent intercomparison in measuring the ¹³⁷Cs, ⁴⁰K, and ⁹⁰Sr activity concentration in milk powder. The “PomPlot”, an intuitive graphical method, is used for producing a summary overview of the participants’ results of a common measurand. The “PomPlot” displays (relative) deviations of individual results from the reference value on the horizontal axis and (relative) uncertainties on the vertical axis.     

A comparison of location estimators for interlaboratory data contaminated with value and uncertainty outliers

While estimation of measurement uncertainty (MU) is increasingly acknowledged as an essential component of the chemical measurement process, there is little agreement on how best to use even nominally well-estimated MU. There are philosophical and practical issues involved in defining what is “best” for a given data set; however, there is remarkably little guidance on how well different MU-using estimators perform with imperfect data. This report characterizes the bias, efficiency, and robustness properties for several commonly used or recently proposed estimators of true location, μ, using “Monte Carlo” (MC) evaluation of “measurement” data sets drawn from well-defined distributions. These synthetic models address a number of issues pertinent to interlaboratory comparisons studies. While the MC results do not provide specific guidance on “which estimator is best” for any given set of real data, they do provide broad insight into the expected relative performance within broadly defined scenarios. Perhaps the broadest and most emphatic guidance from the present study is that (1) well-estimated measurement uncertainties can be used to improve the reliability of location determination and (2) some approaches to using measurement uncertainties are better than others. The traditional inverse squared uncertainty-weighted estimators perform well only in the absence of unrepresentative values (value outliers) or underestimated uncertainties (uncertainty outliers); even modest contamination by such outliers may result in relatively inaccurate estimates. In contrast, some inverse total variance-weighted-estimators and probability density function area-based estimators perform well for all scenarios evaluated, including underestimated uncertainties, extreme value outliers, and asymmetric contamination.     

Relationship between performance characteristics obtained from an interlaboratory study programme and combined measurement uncertainty: a case study

 In the interlaboratory study programme "ILS Coal Characterisation", eight interlaboratory studies were organised based on the ISO standards for coal analysis. The use of blind samples in each round allows comparability of measurement results between rounds to be assessed. Based on the results, it could be demonstrated that the vast majority of the measurement results of the laboratories were traceable to results obtained in previous rounds of this programme. The hypothesis has been formulated that the combined standard uncertainty obtained from an interlaboratory study is equal to the reproducibility standard deviation. Whether the reproducibility can be used as the basis for the certification depends on whether the interlaboratory study includes all effects to be taken into account for establishing an uncertainty statement. Received: 12 April 1998 · Accepted: 2 July 1998     

Considerations with regard to the calculation of key comparison reference values and uncertainties

Much has been published over the last years on finding the best (consensus) reference value for a given set of key comparison data, and a suite of approaches proposed. In this paper, several aspects are highlighted which should be taken into account when deciding on key comparison strategies, protocols, and the best approach to reliable key comparison reference value and uncertainty. Some of these aspects are briefly discussed. The paper is intended to intensify discussions, and any comments and opinions are welcome. Presented at the CCQM 2008 KCRV Workshop, April 2008, Sèvres, France. Papers published in this section do not necessarily reflect the opinion of the Editors, the Editorial Board and the Publisher.     

Chlorophyll-a determination: results of an interlaboratory comparison

A chlorophyll-a interlaboratory comparison was carried out to compare three different analytical chlorophyll-a determination methods: a German standard DIN 38412-16, a method of the HELCOM-Combine-Manual and the different “in-house” methods of participating laboratories. Eleven laboratories took part. They had to determinate the chlorophyll-a and phaeopigment content in two seawater samples taken from the Baltic Sea. Furthermore, for the assessment three different statistical evaluation methods were applied: the German standard DIN 38402-42, the Q-method combined with an estimator according to Huber and the Cofino-method. All analytical methods were appropriate to determine the chlorophyll-a content. The relative standard deviations of reproducibility for chlorophyll-a varied between 12 and 31%. None of the analytical methods was appropriate to determine the phaeopigment content quantitatively. The relative standard deviations of reproducibility for phaeopigments ranged between 87 and 158%. The applied statistical evaluation methods resulted in different assessments. The Q-method combined with an estimator according to Huber proved to be the best qualified method.Presented at the Eurachem PT Workshop September 2005, Portorož, Slovenia     

EAL interlaboratory comparison Wa1 – Testing of potable water

 The accreditation of laboratories has emphasized the use of interlaboratory comparisons as a tool to monitor the comparability and accuracy of results laboratories produce. An interlaboratory comparison for water laboratories was organized among European Cooperation for Accreditation (EA) member countries; 30 laboratories, 7 of which were not accredited, from 14 European countries participated in this intercomparison. All the laboratories were chosen by the appropriate national accreditation bodies, with the instruction to select as participants those laboratories which act as national reference laboratories in this field. About 90% of the data collected was considered satisfactory after statistical treatment. Non-accredited laboratories performed as well as accredited laboratories. The laboratories were asked to take corrective action and report the corrections to the accreditation bodies. A great variation in the reported uncertainties of the results was observed. There seems to be a need to organize EA interlaboratory comparisons for national reference laboratories analysing water. It is obvious that even reference laboratories need training in how to estimate the uncertainty of results. Received: 22 July 1998 · Accepted: 21 September 1998     

Establishment of SI-traceable reference values for the content of various elements in the IMEP-14 sediment sample

For the first time in the International Measurement Evaluation Programme (IMEP)-14, a sediment sample was offered to analytical laboratories to perform measurements of As, Cd, Cr, Cu, Fe, Pb, Hg, Ni, U and Zn. In line with IMEP policy, the results were presented according to the certified / assigned reference values established by several reference laboratories around the world. The certification campaign is described in detail. Isotope dilution mass spectrometry was applied as a primary method of measurement, whenever possible, to achieve SI-traceable results. For reference measurements of As, Fe, Hg and Zn, k₀-neutron activation analysis and Zeeman atomic absorption spectrometry were applied. The reference values (ranges) were characterised as ”certified” (for Cd, Cr, Pb, Ni and U) or ”assigned” (for As, Cu, Fe, Hg and Zn) according to IMEP policy. The measurement uncertainty of the certified / assured reference values was calculated according to the ISO/BIPM Guide. Received: 7 June 2001-10-27 Accepted: 19 August 2001     

Estimation of measurement uncertainty in organic analysis: two practical approaches

Estimation of measurement uncertainty has become a more regularly performed part of the whole analytical process. However, there is still much on-going discussion in the scientific community about ways of building up the uncertainty budget. This study describes two approaches for estimation of measurement uncertainty in organic analysis: one which can be used for single sets of measurements and the other based on validation studies. In both cases the main contributions to the uncertainty are presented and discussed for the analysis of PCBs in mussel tissue, but the approaches can be extended to other organic pollutants in environmental/food samples. The main contributions to the uncertainty budget arise from calibration, sample preparation, and GC–MS measurements. A comparison of the relevant sources and their contributions to the expanded uncertainty is presented.     

A practical approach to assessment of sampling uncertainty

The paper reports the approach followed in the SOILSAMP project, funded by the National Environmental Protection Agency (ANPA)of Italy. SOILSAMP is aimed at assessing uncertainties associated with soil sampling in agricultural, semi-natural, urban, and industrial environments. The uncertainty assessment is based on a bottom-up approach, according to the Guide to the Expression of Uncertainty in Measurement published by the International Organization for Standardization (ISO). A designated agricultural area, which has been characterized in terms of elemental spatial distribution, will be used in future as a reference site for soil sampling intercomparison exercises. Received: 19 November 2001 Accepted: 6 January 2002     

Interlaboratory study of a liquid chromatography method for erythromycin: determination of uncertainty

Erythromycin is a mixture of macrolide antibiotics produced by Saccharopolyspora erythreas during fermentation. A new method for the analysis of erythromycin by liquid chromatography has previously been developed. It makes use of an Astec C18 polymeric column. After validation in one laboratory, the method was now validated in an interlaboratory study. Validation studies are commonly used to test the fitness of the analytical method prior to its use for routine quality testing. The data derived in the interlaboratory study can be used to make an uncertainty statement as well. The relationship between validation and uncertainty statement is not clear for many analysts and there is a need to show how the existing data, derived during validation, can be used in practice. Eight laboratories participated in this interlaboratory study. The set-up allowed the determination of the repeatability variance, s(2)r and the between-laboratory variance, s(2)L. Combination of s(2)r and s(2)L results in the reproducibility variance s(2)R. It has been shown how these data can be used in future by a single laboratory that wants to make an uncertainty statement concerning the same analysis.     

Twenty years of the Me.Tos. Project: an Italian national external quality assessment scheme for trace elements in biological fluids

The Me.Tos. Project, started in 1983 and still running, is an external quality assessment (EQA) scheme for laboratories performing specialized analyses in occupational and environmental laboratory medicine. Besides the organization of EQA exercises, initiatives for further education of the participants and the harmonization of EQA procedures at a European level are carried out. Participation in EQA schemes allows laboratories to comply with the international standards for the quality and competence of testing and clinical laboratories. The organization of the scheme includes the preparation of control materials, their distribution to the participants, according to strategies aimed to avoid identification of the samples, the statistical analysis of the results and the evaluation of laboratories' performance according to international guidelines and criteria set by the organizers. An overview of the scheme operation and the current performances of participants will be given.     

Reflections regarding uncertainty of measurement, on the results of a Nordic fatigue test interlaboratory comparison

This paper presents the experiences of calculation and reporting uncertainty of measurement in fatigue testing. Six Nordic laboratories performed fatigue tests on steel specimens. The laboratories also reported their results concerning uncertainty of measurement and how they calculated it. The results show large differences in the way the uncertainties of measurement were calculated and reported. No laboratory included the most significant uncertainty source, bending stress (due to misalignment of the testing machine, incorrect specimens and/or incorrectly mounted specimens), when calculating the uncertainty of measurement. Several laboratories did not calculate the uncertainty of measurement in accordance with the Guide to the Expression of Uncertainty in Measurement (GUM) [1].     

Establishment of SI-traceable reference ranges for the content of various elements in the IMEP-9 water sample

 The International Measurement Evaluation Programme (IMEP) attempts to shed light on the current state of the practice in chemical measurements. The main tool, which assists this attempt and also differentiates IMEP from similar projects, is the establishment of SI-traceable reference ranges (where possible) for the elements offered for measurement to the participants for every IMEP round. The Institute for Reference Materials and Measurements (IRMM), as the founder and co-ordinator of IMEP has the responsibility of establishing the SI-traceable reference ranges. This is a large task that requires knowledge, skill and resources. IRMM collaborates with a network of reference laboratories in order to achieve the establishment of SI-traceable reference ranges in a transparent and reliable way. The IMEP reference laboratories must have demonstrated experience and have a proven and successful record in the use of primary methods of measurements (mainly isotope dilution mass spectrometry) and the application of uncertainty evaluation according to ISO/BIPM guidelines. In IMEP-9 "trace elements in water", results from 7 reference laboratories (including IRMM) were combined by IRMM to establish SI-traceable ranges for the 15 elements, which were then offered for measurement to the 200 participants worldwide. This paper does not discuss the individual contribution of the reference laboratories (this could be the subject of individual papers) but describes the procedures and criteria used in order to establish the reference ranges for the IMEP-9 samples by combining the individual contributions. All results submitted to IRMM are included, so as to make this publication as realistic as possible. Received: 31 December 1999 / Accepted: 7 March 2000     

Macrozoobenthos interlaboratory comparison on taxonomical identification and counting of marine invertebrates in artificial sediment samples including testing various statistical methods of data evaluation

A macrozoobenthos interlaboratory comparison was carried out by 16 laboratories to check the taxonomical expertise and the precision of sorting and counting. Participating laboratories had to determine and count in an artificial sediment sample 22 selected macrozoobenthos species taken from the western Baltic Sea. Two methods for the analysis of data were applied: assessment of qualitative and quantitative successful hits and the maximum-likelihood method.The results of counting were mostly precise (one lab without mistake). Four laboratories had a rate of false determination of 10%, eight laboratories between 10 and 20% and four laboratories of more than 20%.The species Arctica islandica, Retusa obtusa, Fabricia stellaris, Polydora quadrilobata, Pholoe assimilis, Microdeutopus gryllotalpa, and Corophium crassicorne caused some problems at the species determination step.The comparison of the different methods of statistical data analysis shows that the maximum-likelihood method is more sensitive than the method of successful hits.Presented at the Eurachem PT Workshop September 2005, Portorož, Slovenia.     

A comparative uncertainty study of the calibration of macrolide antibiotic reference standards using quantitative nuclear magnetic resonance and mass balance methods

This study introduces the general method of quantitative nuclear magnetic resonance (qNMR) for the calibration of reference standards of macrolide antibiotics. Several qNMR experimental conditions were optimized including delay, which is an important parameter of quantification. Three kinds of macrolide antibiotics were used to validate the accuracy of the qNMR method by comparison with the results obtained by the high performance liquid chromatography (HPLC) method. The purities of five common reference standards of macrolide antibiotics were measured by the ¹H qNMR method and the mass balance method, respectively. The analysis results of the two methods were compared. The qNMR is quick and simple to use. In a new medicine research and development process, qNMR provides a new and reliable method for purity analysis of the reference standard.     

Development of a standard for the organization of the interlaboratory comparisons in microbiology of food

The ILAC G13 Guide and the ISO IEC Guide 43-1 are the common, general and horizontal bases for accreditation of providers of proficiency testing and interlaboratory comparisons used by several accreditation bodies. Despite their widespread use, these guides omit specific technical requirements, and sometimes even elements of quality management, clearly defined for the organization of proficiency-testing schemes for microbiology of food. The Sub-Committee 9 “Microbiology of food” of ISO TC34 has created a working group (WG4) to establish a standard detailing such specific requirements for microbiology of food. This technical standard will describe those specific requirements of proficiency testing which organizers of proficiency-testing schemes and any subcontractors must satisfy in addition to the requirements of the ILAC G13 Guide and the ISO IEC Guide 43-1 to achieve accreditation or other recognition.     

IMEP-12: trace elements in water; objective evaluation of the performance of the laboratories when measuring quality parameters prescribed in the European Directive 98/83/EC

The International Measurement Evaluation Programme (IMEP) is an interlaboratory comparison scheme, founded, owned and co-ordinated by the Institute for Reference Materials and Measurements (IRMM) since 1988. IMEP-12, for the fourth time in the series, focused on trace elements in water and it was designed specifically to support European Commission directive 98/83/EC. Reference values for the concentration of ten elements were established with expanded uncertainties according to GUM. In total, 348 laboratories from 46 countries in five continents participated in the comparison and the degree of equivalence between the results of the laboratories and the reference values is presented graphically. Samples from the same batch were distributed to ten laboratories from European Countries, which represented their country in the framework of the EUROMET project 528. Participation in this comparison was offered to the European Co-operation for Accreditation (EA) for participation of accredited laboratories from all over Europe in the framework of the collaboration between IRMM and EA and to laboratories from the EU new member states and acceding countries in the frame of IRMM’s ‘Metrology in Chemistry support program for EU new member states and acceding countries.’     

The present situation of Japanese certified reference materials registered in the COMAR database

 In the field of reference materials, COMAR (Code d'Indexation des Matériaux de Référence) is now internationally known as a reliable directory. In order to improve the quality of COMAR, a document which covers general requirements for the registration of reference material has recently been adopted by the Japanese coding centre, NITE. This paper describes the general requirements for reference materials and the current status of the COMAR database coded by the National Institute of Technology and Evaluation (NITE), Japan. The concept of the requirements is fundamentally based on the ISO Guides 30, 31, 33, 34 and 35. Certifications of reference materials are divided into the following three categories in the newly adopted document. 1. Certifications based on the results of interlaboratory comparisons 2. Certifications in accordance with the Measurement Law 3. Certifications in accordance with the measurement results of national institutions An example of an uncertainty evaluation is also presented in the paper. Received: 14 October 1996 Accepted: 3 December 1996