IMEP in support of the comparability of measurement results across the Romanian chemical metrology infrastructure

On the basis of quantitative chemical measurements many important decisions are made in support of legislation or in industrial processes or social aspects. For this reason it is important to improve the quality of chemical measurement results and thus make them comparable and acceptable everywhere. The measurement quality is important to enable an equivalent implementation of the European Union regulations and directives across an enlarged EU. In this context, the European Commission–Joint Research Centre–Institute for Reference Materials and Measurement (EC-JRC-IRMM) set up a programme to improve the scientific basis for metrology in chemistry (MiC) in EU candidate countries in the framework of EU enlargement. Several activities were initiated, such as training, fellowships, sponsoring of seminars, conferences and participation in interlaboratory comparisons. To disseminate measurement traceability, IRMM provides through its International Measurement Evaluation Programme (IMEP) an interlaboratory tool to enable the benchmarking of laboratory performance. IMEP emphasizes the metrological aspects of measurement results, such as traceability and measurement uncertainty. In this way it has become a publicly available European tool for MiC. The Romanian Bureau of Legal Metrology – National Institute of Metrology (BRML-INM) actively supports the participation of Romanian authorized and field laboratories in IMEP interlaboratory comparisons. This paper describes the interest of Romanian laboratories participating in this programme, the analytical and metrological problems that became relevant during these exercises and some actions for improvement. The results from Romanian laboratories participating in IMEP-12 (water), IMEP-16 (wine), IMEP-17 (human serum) and IMEP-20 (tuna fish) are presented. To conclude, the educational and training activities at national level organized jointly by the Romanian National Institute of Metrology (INM) and IRMM are also mentioned.     

Establishment of SI-traceable reference ranges for the content of various elements in the IMEP-9 water sample

 The International Measurement Evaluation Programme (IMEP) attempts to shed light on the current state of the practice in chemical measurements. The main tool, which assists this attempt and also differentiates IMEP from similar projects, is the establishment of SI-traceable reference ranges (where possible) for the elements offered for measurement to the participants for every IMEP round. The Institute for Reference Materials and Measurements (IRMM), as the founder and co-ordinator of IMEP has the responsibility of establishing the SI-traceable reference ranges. This is a large task that requires knowledge, skill and resources. IRMM collaborates with a network of reference laboratories in order to achieve the establishment of SI-traceable reference ranges in a transparent and reliable way. The IMEP reference laboratories must have demonstrated experience and have a proven and successful record in the use of primary methods of measurements (mainly isotope dilution mass spectrometry) and the application of uncertainty evaluation according to ISO/BIPM guidelines. In IMEP-9 "trace elements in water", results from 7 reference laboratories (including IRMM) were combined by IRMM to establish SI-traceable ranges for the 15 elements, which were then offered for measurement to the 200 participants worldwide. This paper does not discuss the individual contribution of the reference laboratories (this could be the subject of individual papers) but describes the procedures and criteria used in order to establish the reference ranges for the IMEP-9 samples by combining the individual contributions. All results submitted to IRMM are included, so as to make this publication as realistic as possible. Received: 31 December 1999 / Accepted: 7 March 2000     

International Measurement Evaluation Programme: IMEP-9, trace elements in water

The International Measurement Evaluation Programme (IMEP) is an interlaboratory comparison scheme, founded, owned and coordinated by the Institute for Reference Materials and Measurements (IRMM) since 1988. IMEP-9 is the third round of trace elements in water evaluation following IMEP-3 and IMEP-6. Reference values for 15 elements stating total concentrations and combined uncertainties (according to GUM) were established. The reference values were established mainly by isotope dilution mass spectrometry (IDMS) as a primary method of measurement, and values traceable to the SI were obtained. The four elements that could not be certified by IDMS were assigned values by means of other measurement techniques. Results from 201 laboratories from 35 countries and four continents were evaluated against the reference values and the comparability between the laboratories is presented graphically.     

Performance evaluation of polycyclic aromatic hydrocarbons analysis in sediment from proficiency testing with metrological reference values

This paper describes a metrological approach to evaluate the measurement capability of laboratories participating in two proficiency testing (PT) programmes involving the analysis of five polycyclic aromatic hydrocarbons (PAHs) in sediment samples. Reference values of PAHs in the programmes for performance assessment were obtained from an accurate isotope dilution gas chromatography mass spectrometry (ID-GCMS) method which was thoroughly validated and verified. Isotope dilution mass spectrometry (IDMS) technique usually has a well-defined measurement uncertainty budget and a traceability link to an International System of Units. Provision of the metrological reference values in PT enables the establishment of a technical platform to assess the actual competence of the participating laboratories in sediment PAHs analysis. Results of the PT programmes showed that about 80 % of the laboratories employed gas chromatography in their analyses and the remaining used liquid chromatography. Irrespective of the techniques being used, however, the majority of the participating laboratories were observed to underestimate values in which the mean values of the five reported PAHs were less than those of the ID-GCMS-derived reference values by 13–20 %. Only 41–44 % of the participating laboratories were able to achieve satisfactory z-scores. The present study revealed that the reinforcement of the capability for accurate measurement of PAHs in sediment samples in laboratories worldwide should be addressed.     

Integration of metrological principles in a proficiency-testing scheme in the field of water analysis

Measurement traceability is universally recognised as one of the basic prerequisites for comparability of results obtained in different laboratories and is a basic aspect of metrological sciences such as analytical chemistry. This requirement is underscored by the increasing adoption of standards and measurement quality systems, such as laboratory accreditation against ISO/IEC 17025. Testing laboratories ensure traceability of their measurement results by using appropriate reference standards for calibration of instruments and control of measurement processes. For routine work in the field of water analysis, these standards are usually commercial solutions or in-house solutions prepared from pure products. Therefore, laboratories should demonstrate that their use of reference standards is appropriate and sufficient, which can be done by participation in an appropriate proficiency-testing scheme. The paper reports how measurement traceability of results from field laboratories (nitrite nitrogen, nitrate nitrogen, chloride and sulphate; all in water) can be demonstrated by participation in a proficiency-testing scheme based on reference values.     

An inter-calibration campaign using various selected Pu spike isotopic reference materials

In nuclear safeguards, precise and accurate isotopic analyses are needed for two major elements from the nuclear fuel cycle: uranium and plutonium. This can be achieved by Isotope Dilution Mass Spectrometry (IDMS), which is one of the most reliable analytical techniques for the determination of plutonium amount content to a high level of accuracy. In order to achieve reliable isotope measurements isotopic reference materials with certified amount of plutonium and isotopic composition are required. At the Institute for Reference Materials and Measurements (IRMM) various plutonium spike reference materials for isotopes ²³⁹Pu, ²⁴⁰Pu, ²⁴²Pu and ²⁴⁴Pu are available. This enabled the setup of an inter-calibration campaign inter-linking selected plutonium spikes on a metrological basis applying state-of-the-art measurement procedures. The aim of this campaign is threefold: firstly to perform measurements on selected plutonium spike isotopic reference materials for quality control purposes, secondly to verify the amount content and the isotopic composition of the recently produced IRMM-1027m large sized dried (LSD) spikes and thirdly to demonstrate IRMM’s measurement capabilities for plutonium analysis via external quality tools. The obtained results using various spike isotopic reference materials will be presented and discussed in this paper. The measurement uncertainties of the IDMS results were calculated according to the guide to the expression of uncertainty in measurement (GUM).     

European measurement comparison of <Superscript>137</Superscript>Cs, <Superscript>40</Superscript>K and <Superscript>90</Superscript>Sr in milk powder

Recently, the Institute for Reference Materials and Measurements (IRMM) has assumed responsibility for organizing regular measurement comparisons among those laboratories which provide radioactivity monitoring data from their country to authorities of the European Commission (EC) under various EC legislation articles. The most recent exercise under this International Comparison Scheme for Radioactivity Environmental Monitoring (ICS-REM) in measuring the ¹³⁷Cs, ⁴⁰K and the ⁹⁰Sr activity concentration in milk powder is presented here. The complete cycle of the comparison is described, including the establishment of reference values traceable to SI units, the demonstration of the homogeneity of the distributed samples, the treatment and measurement of samples in the participating laboratories, and the evaluation of the results.     

IMEP-12: trace elements in water; objective evaluation of the performance of the laboratories when measuring quality parameters prescribed in the European Directive 98/83/EC

The International Measurement Evaluation Programme (IMEP) is an interlaboratory comparison scheme, founded, owned and co-ordinated by the Institute for Reference Materials and Measurements (IRMM) since 1988. IMEP-12, for the fourth time in the series, focused on trace elements in water and it was designed specifically to support European Commission directive 98/83/EC. Reference values for the concentration of ten elements were established with expanded uncertainties according to GUM. In total, 348 laboratories from 46 countries in five continents participated in the comparison and the degree of equivalence between the results of the laboratories and the reference values is presented graphically. Samples from the same batch were distributed to ten laboratories from European Countries, which represented their country in the framework of the EUROMET project 528. Participation in this comparison was offered to the European Co-operation for Accreditation (EA) for participation of accredited laboratories from all over Europe in the framework of the collaboration between IRMM and EA and to laboratories from the EU new member states and acceding countries in the frame of IRMM’s ‘Metrology in Chemistry support program for EU new member states and acceding countries.’     

Metrological concept for comparable measurement results under the European water framework directive: demonstration of its applicability in elemental analysis

Within the scope of a project of the “European Association of National Metrology Institutes??(EURAMET), a European metrological dissemination system (network) providing traceable reference values assigned to matrix materials for validation purposes is described and put to the test. It enables testing laboratories (TL) to obtain comparable results for measurements under the “EU Water Framework Directive 2000/60/EC??(WFD) and thus, to comply with a core requirement of this very directive. The dissemination system is characterized by the fact that it is available to all laboratories throughout Europe which intend to perform measurements in the context of the WFD and that it can ensure sustainable metrological traceability to the International System of Units (SI) as a reference point for the measurement results. This dissemination system is set up in a hierarchical manner and links up the level of the national metrology institutes (NMI) with that of the TLs via an intermediate level of calibration laboratories (CL) by comparison measurements. The CLs are expert laboratories with respect to the measurement of the analytes considered here (within the project, the CLs are called potential calibration laboratories (PCL)) and are additionally involved in the organization of comparison measurements within the scope of regional quality assurance (QA) systems. Three comparison measurements have been performed to support the approach. A total of about 130 laboratories participated in this exercise with the focus on the measurement of the priority substances Pb, Cd, Hg, and Ni defined in the WFD. The elemental concentrations in the water samples roughly corresponded to one of the established environmental quality standards (EQS), the annual average concentration (AA-EQS), which is defined in the daughter Directive 2008/105/EC of the WFD. It turned out that a significant number of TLs still need to improve their measurement methods in order to be able to fulfill the minimum requirements of the WFD, in particular, with regard to the elements Cd and Hg probably due to their low EQS values. Furthermore, it became obvious that the hierarchical dissemination system suggested here actually corresponds to the measuring capabilities of the three participating groups (NMIs, PCLs, and TLs).     

The IRMM – International Measurement Evaluation Programme,IMEP

 The aim of the International Measurement Evaluation Programme (IMEP) is to give an objective picture of the state-of-the-practice (SoP) of chemical measurements in field laboratories by comparing them to a reference range that contains a value that is as traceable to the SI system of measurements (in this case to the Avogadro Constant, one of the best realizations of the mole so far), as can presently be achieved, but which in any case is independent of human or political decision. Thus, a large-scale field test has been made to realize (international) comparability of these measurements by providing them with an independent scientific common basis. In the third measurement round, IMEP-3, ten trace elements, B, Ca, Cd, Cu, Fe, K, Li, Pb, Rb and Zn were measured in a synthetic and in a natural water by about 155 participating laboratories using their routine methods. The (coded) results are graphically reported and compared to certified reference values, established by IRMM and NIST, using isotope specific methods (isotope dilution mass spectrometry and neutron activation analysis), wherever possible. One of these methods (IDMS) has recently been defined as a primary method of measurement by the Consultative Committee on Amount of Substance (Comité Consultatif pour la Quantité de Matière: CCQM) in its founding meeting in April 1995 at BIPM, Paris. Results indicate a spread of more than ±50%, asymmetrically distributed around the reference range, although the declared accuracy was 5–10%. Self-assessment by participants of their analytical capabilities does not show a high correlation between a self-rating ("more experienced" or "less experienced") and actual performance. In the way they have been applied, all methods seem to produce results of approximately the same quality. There is little reduction in the spread of the measurements if the results obtained for one element in the natural water B are divided by the results obtained for the same element in the synthetic water A (which was unknowingly, a reference material). Index entries International measurement evaluation programme (IMEP).     

Providing a traceable assigned value in a proficiency testing programme on the determination of benzoic acid in orange juice

A proficiency testing (PT) programme on the determination of benzoic acid in orange juice was organised by the Chemical Metrology Laboratory, Health Sciences Authority, Singapore, for the local food testing laboratories. The PT programme used a metrologically traceable assigned value determined by isotope dilution mass spectrometry to assess the performance of the participating laboratories. This paper discusses the reasons and approach to applying metrological principles to determine the assigned value of a PT programme. The procedure undertaken by the Laboratory to prepare a batch of PT sample, conduct homogeneity and stability testings, as well as value assignment, is presented. The discussions also include the estimation of the measurement uncertainties arising from the characterisation, testing for homogeneity and testing for stability of the PT sample. The Coordinator of the PT programme used the assigned value and its associated measurement uncertainty, together with those of the participating laboratories to assess their performances. Statistical tools applied in the performance evaluations are also presented.     

Key metrological issues in proficiency testing––response to “Metrological compatibility-a key issue in further accreditation” by K. Heydorn

A discussion of proficiency testing (PT) topics started by Heydorn (Accred Qual Assur 15:643–645, 2010) is continued in the present paper. The role of PT in the accreditation of testing/analytical laboratories, the use of consensus values (average or weighted average, median, observed standard deviation, etc.) and a metrological background of PT schemes are discussed. It is shown that metrological traceability, comparability, and compatibility, as well as commutability of a reference material, are the key issues of any PT scheme that applies certified reference material as test items. Metrological compatibility of PT results in such schemes is a property demonstrating the closeness of the PT results to the certified value in comparison with the measurement uncertainty of their difference. The metrological background is especially important for the selection and use of PT schemes for a limited number of participants (fewer than 30) as detailed in IUPAC/CITAC Guide on the topic published in 2010 in Pure Appl Chem 82(5):1099–1135.     

The International Measurement Evaluation Programme,IMEP-8: carbon and oxygen isotope ratios in CO<Subscript>2</Subscript>

In IMEP-8, two samples of high purity CO(2)(g), with different carbon and oxygen isotope ratios were distributed to 27 participants, originating from 14 countries and from various isotopic measurement domains (geochemistry, atmospheric and food chemistry), but particularly set up for food laboratories. In total 19 laboratories reported results. The outcome of this comparison exercise shows that the laboratories reported carbon and oxygen isotope results in good agreement with the reference values across the domains. The reported results for delta(13)C(VPDB) (carbon) for both materials are within 1 per thousand. However, for the reported results of delta(18)O(VPDB) (oxygen) for both materials the overall spread of the reported results is about 11 per thousand. Within this spread two distinct groups of participants can be identified, where the results within each group vary about 2 per thousand. The latter seems to be caused by calculation errors by participants of the reporting delta(18)O(VPDB) values. As requested, participants also reported the isotope amount ratio for carbon and oxygen in the CO(2) samples. For carbon, all reported results for both materials agree with the isotope ratio value, which can be traced back to the value reported by Craig. For oxygen, all results are in good agreement and deviate by a maximum of 0.5% from the reference values measured at IRMM. Work carried out indicates the carbon isotope ratio, for both samples IMEP-8A and IMEP-8B, differ from those reported by Craig by as much as 1.2%. In the case of oxygen, this deviation is far smaller. Both data sets, i.e. the one realised by Craig and the one realised at IRMM, demonstrate traceability to SI. It is clear that both values significantly disagree.     

Atomic spectrometry and trends in clinical laboratory medicine

Increasing numbers of clinical laboratories are transitioning away from flame and electrothermal AAS methods to those based on ICP-MS. Still, for many laboratories, the choice of instrumentation is based upon (a) the element(s) to be determined, (b) the matrix/matrices to be analyzed, and (c) the expected concentration(s) of the analytes in the matrix. Most clinical laboratories specialize in measuring Se, Zn, Cu, and Al in serum, and/or Pb, Cd, Hg, As, and Cr in blood and/or urine, while other trace elements (e.g., Pt, Au etc.) are measured for therapeutic purposes. Quantitative measurement of elemental species is becoming more widely accepted for nutritional and/or toxicological screening purposes, and ICP-MS interfaced with separation techniques, such as liquid chromatography or capillary electrophoresis, offers the advantage of on-line species determination coupled with very low detection limits. Polyatomic interferences for some key elements such as Se, As, and Cr require instrumentation equipped with dynamic reaction cell or collision cell technologies, or might even necessitate the use of sector field ICP-MS, to assure accurate results. Nonetheless, whatever analytical method is selected for the task, careful consideration must be given both to specimen collection procedures and to the control of pre-analytical variables. Finally, all methods benefit from access to reliable certified reference materials (CRMs). While a variety of reference materials (RMs) are available for trace element measurements in clinical matrices, not all can be classified as CRMs. The major metrological organizations (e.g., NIST, IRMM, NIES) provide a limited number of clinical CRMs, however, secondary reference materials are readily available from commercial organizations and organizers of external quality assessment schemes.     

What is new in certified reference materials and measurements at IRMM?

IRMM is developing more and more isotopic spike reference materials since these are increasingly needed in trace analysis. In addition, they appear to play an increasingly important role in ensuring traceability to the SI system of isotope-specific measurements made by e.g. isotope dilution mass spectometry (IDMS). Their present availability and future development is summarised. IDMS is also applied in a definitive way to establish reference measurements for IRMM's international measurement evaluation programme (IMEP), which aims at the realisation of traceability for field laboratories. IRMM uses its advanced technology for the preparation and contamination-free handling of large quantities of biological and environmental reference materials. These facilities are used for the preparation of both BCR CRM's (orange juice, sheep milk curd, sediments, etc.) and reference materials for private customers (catalytic converter materials, apple powder, flour, animal innards, tomato powder, etc.).     

Achieving traceability in chemical measurement—a metrological approach to proficiency testing

ISO/IEC 17025 requires that testing laboratories establish the traceability of their measurements, preferably to the SI units of measurement. The responsibility for establishing traceability lies with each individual laboratory and must be achieved by following a metrological approach.The results of measurements made in such a way are traceable to the standards used in method validation and to the calibration standards used during the measurement process. If these standards are traceable to SI then the measurements will also be traceable to SI.Participation in appropriate proficiency studies (an ISO/IEC 17025 requirement) enables laboratories to demonstrate the comparability of their measurements. If the materials used for the studies have traceable assigned values, then proficiency testing also provides information about measurement accuracy and confirms, or otherwise, that appropriate traceability has been established. This paper will report on a new approach for the establishment of traceable assigned values for chemical testing proficiency studies. The work is conducted at a "fit for purpose" level of measurement uncertainty, with costs contained at a level similar to previous "consensus" based proficiency studies. By establishing traceable assigned values in a cost effective way, NARL aims to demonstrate the added value of the metrological approach to participant laboratories.     

Quality in point-of-care testing: what drives the system—personnel, regulatory standards, or instrumentation?

The European Commission (EC) Directive on in vitro diagnostic medical devices requires—amongst other obligations—manufacturers to establish metrological traceability of values assigned to calibrators to available measurement procedures and/or available reference materials of a higher order. Manufacturers use different procedures to accomplish this task and to indicate uncertainties of assigned values. Medical laboratories may want to calculate the uncertainties of their results or accreditation bodies may require them to do so. For this purpose some practical approaches are presented and some examples discussed.Presented at the Roche Diagnostic Workshop on In Vitro Diagnostics Directive: A Nordic event about the implication of traceability and uncertainty in practice, 13–15 February, 2003, Helsinki, Finland. Organized in connection with Labquality Days, 13 February, 2003, Helsinki.     

“Demonstration” vs. “designation” of measurement competence: the need to link accreditation to metrology

Formal acceptance of the results of chemical laboratories is increasingly organized through a) accreditation of measuring laboratories nationally and b) mutual recognition of accreditation internationally (through formal Multilateral Recognition Agreements, MRAs). However, real comparability of results of measurements is realized by using common (internationally agreed) measurement scales which make these results traceable to this scale, i.e. “traceable” to the same (internationally agreed) value of the unit of that scale. In addition, the criterion against which the evaluation is done, should be “external” to the measurement laboratories which are being evaluated. This is realized in IRMM’s International Measurement Evaluation Programme (IMEP) where evaluation is performed against values which are anchored using “metrology”, the science of measurement with its own rules, which offers a sound foundation for measurement in all scientific disciplines. It is argued in this paper that the demonstration of measurement capability against values on such scales provides a result-oriented rather than a procedure-oriented evaluation. Thus, competence can be “demonstrated” rather than just “designated” and this can be shown to both customers and regulators. It inspires more confidence.     

Use of an excess variance approach for the certification of reference materials by interlaboratory comparison

In the nuclear field, the accuracy and comparability of analytical results are crucial to insure correct accountancy, good process control and safe operational conditions. All of these require reliable measurements based on reference materials whose certified values must be obtained by robust metrological approaches according to the requirements of ISO guides 34 and 35. The data processing of the characterization step is one of the key steps of a reference material production process. Among several methods, the use of interlaboratory comparison results for reference material certification is very common. The DerSimonian and Laird excess variance approach, described and implemented in this paper, is a simple and efficient method for the data processing of interlaboratory comparison results for reference material certification. By taking into account not only the laboratory uncertainties but also the spread of the individual results into the calculation of the weighted mean, this approach minimizes the risk to get biased certified values in the case where one or several laboratories either underestimate their measurement uncertainties or do not identify all measurement biases. This statistical method has been applied to a new CETAMA plutonium reference material certified by interlaboratory comparison and has been compared to the classical weighted mean approach described in ISO Guide 35. This paper shows the benefits of using an “excess variance” approach for the certification of reference material by interlaboratory comparison.