A practical procedure for assigning a reference value and uncertainty in the frame of an interlaboratory comparison

A method is suggested for the calculation of a reference value and its uncertainty to be used in the frame of an interlaboratory comparison (ILC). It is assumed that the reference value of the measurand is determined independently from the ILC round. It is derived from a limited set of measurement results obtained from one or several expert laboratories. The procedure involves three stages: (1) check of the experimental data and possible corrections; (2) check of the consistency of data, and possibly increase of the uncertainties in order to attain internal consistency; (3) choice between fully, partially or un-weighted mean.     

Determination of uncertainty for hardness measurement: proposal of the standard,available software

After the next revision of the ISO-standards for hardness testing (ISO 6506–6508) an estimation of the uncertainty (ISO/IEC 17025, ISO 5725) is mandatory. The two proposed approaches of part one (ISO 6506–6508) of the ISO Standards for hardness are exemplified. The calculation approach implemented in an Excel-based file, which is available via , is announced.Presented at the Metro Trade Workshop on Traceability and Measurement Uncertainty in Testing, 30–31 January 2003, Berlin, Germany     

分析测试不确定度的评定与表示(Ⅰ)

就“不确定度”概念的来历和意义;基本术语;误差与不确定度;化学分析测量不确定度的来源;不确定度的评定;标准物质的不确定度;不确定度的评定实例等7个方面概述分析测试不确定度的评定与表示,介绍不确定度的基本知识与应用。     

Design of a modified three-rail shear test for shear fatigue of composites

There are various ways of determining the static in-plane shear properties of a fibre-reinforced composite. One of them is the standard three-rail shear test, as described in “ASTM D 4255/D 4255M The standard test method for in-plane shear properties of polymer matrix composite materials by the rail shear method”. This setup, however, requires drilling holes through the specimen. In this study, a new design based on friction and geometrical gripping, without the need of drilling holes through the composite specimen is presented. Quasi-static tests have been performed to assess the symmetry of the setup and the occurrence of buckling. Then, fatigue tests were done to assess the behaviour of the grips under fatigue loading conditions, yielding excellent results; the specimen fails under shear loading conditions in the loaded area. The material used to validate this setup was a carbon fabric-reinforced polyphenylene sulphide.

During fatigue, this material shows an increase in permanent deformation and a decrease in shear stiffness until a certain point in time, after which a drastic increase in deformation and temperature, higher than the softening temperature of the matrix occurs. Furthermore, the maximum value of the shear stress for fatigue with R=0 has a large influence on the fatigue lifetime.     

Application of consistency checking to evaluation of uncertainty in multiple replicate measurements

Use of repeated measurements in quantitative chemical analysis is common but leads to the problem of how to combine the measurement values and produce a result with an uncertainty following the GUM. There is often confusion between repeated indications or observations of an input quantity, for whose uncertainty the GUM prescribes a type A evaluation, and complete measurements repeated on multiple sub-samples, as considered here. A solution for combining repeated measurement results and their individual uncertainties based on simple interval logic is proposed here. The individual measurement values and their uncertainties are compared with the calculated average value to see if this implies that another, possibly unknown, source of uncertainty is present. The model of the individual results is modified for this possible between-replicate effect so that the repeated measurements are consistent. Lack of consistency is a strong indication that the measurement is not fully under control and needs further development or investigation. This is not always possible, however and the method given here is proposed to ensure that the values of the repeated measurements agree with each other. A simple numerical example is given showing how the method can be implemented in practice.     

Introducing the concept of uncertainty of measurement in testing in association with the application of the standard ISO/IEC 17025

ISO/IEC 17025 requests laboratories to estimate the overall uncertainty associated with a test result. In many cases this means a new requirement to laboratories. It is essential to understand the importance of the knowledge of the uncertainty of measurements as well as the principle that not always the smallest possible uncertainty is needed, but fitness for purpose has to be achieved. The paper suggests a policy on the implementation of the concept of uncertainty and guidance on how to proceed, taking into account the present state of the art of understanding the problem.     

Estimates of uncertainty of measurement from proficiency testing data: a case study

The results obtained by a laboratory over a number of proficiency testing/external quality assessment schemes (PT/EQAS) rounds can give information on the uncertainty of its measurements for a given test, provided that conditions such as full coverage of the routine analytical range, traceability, and small uncertainty of the assigned values (compared to the spread of the results) are met and provided that systematic deviations and any other sources of uncertainty are considered. As organisers of the Italian EQAS (ITEQAS) in occupational and environmental laboratory medicine, we tested this hypothesis using as model data from well-performing laboratories taking part in ITEQAS for lead in blood over the last 2 years. We also investigated how different PT/EQAS features (frequency of trials and number of samples) would affect a laboratory estimate of its uncertainty. Such information can be helpful in improving PT/EQAS organisation and define, for a given test: (a) the state of the art of the uncertainty of current measurement procedures, (b) identify needs for improvement of analytical methodologies and (c) set targets for acceptable uncertainty values.Presented at the Eurachem PT Workshop September 2005, Portorož, Slovenia.Papers published in this section do not necessarily reflect the opinion of the Editors, the Editorial Board and the Publisher.     

Appropriate rather than representative sampling, based on acceptable levels of uncertainty

Appropriate sampling, that includes the estimation of measurement uncertainty, is proposed in preference to representative sampling without estimation of overall measurement quality. To fulfil this purpose the uncertainty estimate must include contribution from all sources, including the primary sampling, sample preparation and chemical analysis. It must also include contributions from systematic errors, such as sampling bias, rather than from random errors alone. Case studies are used to illustrate the feasibility of this approach and to show its advantages for improved reliability of interpretation of the measurements. Measurements with a high level of uncertainty (e.g. 50%) can be shown to be fit for some specified purposes using this approach. Once reliable estimates of the uncertainty are available, then a probabilistic interpretation of results can be made. This allows financial aspects to be considered in deciding upon what constitutes an acceptable level of uncertainty. In many practical situations ”representative” sampling is never fully achieved. This approach recognises this and instead, provides reliable estimates of the uncertainty around the concentration values that imperfect appropriate sampling causes. Received: 28 December 2001 Accepted: 25 April 2002     

Estimating the uncertainty of binary test results to assess their compliance with regulatory limits

A procedure to calculate the uncertainty associated to a binary response, of the type yes/no, originated from an instrumental screening system, is described. Useful equations have been developed based on statistical intervals, and their validation were performed with standard commercial solution. It was applied to a differential pulse anodic stripping voltammetry (DPASV) screening system to analyse tap water, specifically, for determining Pb²⁺ and Cd²⁺ above the UE legislation limits, 10 and 5 μg/l, respectively. A cut-off value from the responses of the calibration samples is calculated and compared with the responses obtained for unknown samples. From this comparison, we will be able to take a compliance yes/no decision, with an alpha probability of committing a type I error. Another parameter, r_screening, is calculated in order to compare different methods for the same screening application.     

Determination of uncertainty in analytical measurements from collaborative study results on the analysis of a phenoxymethylpenicillin sample

The correct interpretation of a measurement result requires knowledge about its uncertainty. Depending on the conditions under which the analyst is operating, different operational definitions of uncertainty have been proposed. They include: within-laboratory uncertainty, reproducibility uncertainty, bias-included uncertainty and absolute uncertainty. Here we consider the evaluation of the reproducibility uncertainty derived from the results obtained in an inter-laboratory experiment. Nine laboratories participated in an inter-laboratory study for the analysis of phenoxymethylpenicillin. The analyses consisted of a Karl-Fischer water determination, an acid-base titration to assay phenoxymethylpenicillin and a liquid chromatography (LC) method to determine 4-hydroxyphenoxymethylpenicillin and other impurities. The experimental set-up allowed to obtain for each determination s_r² and s_L² as estimates of the repeatability variance (σ_r²) and the between-laboratory variance (σ_L²), respectively. The reproducibility uncertainties for the different assays were then derived from these estimates.     

A survey of workload, facilities and awareness of uncertainty of measurement among Italian laboratories performing analyses in occupational and environmental medicine

Biological monitoring is essential for risk assessment in the presence of exposure of workers or the general population to harmful chemical agents. Besides the choice of analytical methods which are fit for purpose and the skills of the analysts, the performance of laboratories, including those working in the field of environmental and occupational medicine, also depends on other technical factors such as frequency of testing, the use of well maintained and properly functioning equipment and the implementation of quality control procedures including the participation in External Quality Assessment Schemes (EQAS). Surveys of laboratory workload have been organized periodically since 1997 within the MeTos Project, an Italian national EQAS for biomarkers of environmental and occupational exposure to chemical agents. In 2001, a more extensive survey, including specific technical issues, was organized as part of the activities of the Thematic Network of European Organizers of External Quality Assessment/Proficiency Testing Schemes Related to Occupational and Environmental Medicine (Network survey). In addition, information on the awareness and implementation of the new requirement for laboratories to estimate the uncertainty of their measurements was collected since 2000. The results of these surveys are reported and compared here. In all surveys, Pb in blood was the biomarker most frequently determined. As for biomarkers of exposure to organic compounds, the data collected in the Network survey indicate that methylhippuric acid, hippuric acid and mandelic acid in urine were the assays most commonly performed. About a third of the participants stated that they estimate the uncertainty of at least some of their measurements. Preliminary analysis of data, limited to Pb in blood, showed that analytical performance improved with continuous participation in EQAS and was positively influenced by a high workload.     

234U and 238U in mineral water: reference value and uncertainty evaluation in the frame of an interlaboratory comparison

In 2007/2008 the Institute for Reference Materials and Measurements (IRMM) organised an interlaboratory comparison (ILC) on the determination of ²²⁶Ra, ²²⁸Ra, ²³⁴U and ²³⁸U activity concentrations in mineral water. This paper describes the determination of the reference values for the activity concentrations of ²³⁴U and ²³⁸U by radiochemical separation and α-particle spectrometry performed at two independent laboratories. The experimental uncertainty of the reference values is discussed in detail.     

Towards a new edition of the “Guide to the expression of uncertainty in measurement”

The “Guide to the expression of uncertainty in measurement” (GUM) is an extremely important document. It unifies methods for calculating measurement uncertainty and enables the consistent interpretation and comparison of measurement results, regardless of who obtained these measurements and where they were obtained. Since the document was published in 1995, it has been realised that its recommendations do not properly address an important class of measurements, namely, non-linear indirect measurements. This drawback prompted the initiation of the revision of the GUM in the Working Group 1 of the Joint Committee for Guides in Metrology, which commenced in October 2006. The upcoming revision of the GUM provides the metrological community with an opportunity to improve this important document, in particular, to reflect developments in metrology that have occurred since the first GUM publication in 1995. Thus, a discussion of the directions for this revision is important and timely. By identifying several shortcomings of the GUM and proposing directions for its improvement, we hope this article will contribute to this discussion. Papers published in this section do not necessarily reflect the opinion of the Editors, the Editorial Board and the Publisher.     

Measurement of PAHs in environmental matrices: results from an interlaboratory comparison on the different steps of the measurement procedure

Proficiency testing (PT) is becoming a feature of laboratory accreditation and the PT results are used to assess the technical competence of the participating laboratories. ISPRA (former APAT) plays an important role in supporting the Italian laboratories belonging to the network of the Regional Environmental Agencies to improve the quality of their analytical measurements. As a consequence, ISPRA organized an interlaboratory comparison to assess the performance of the laboratories on PAH measurement procedure. The interlaboratory comparison was drawn separating the different steps of the measurement (from the extraction to the instrumental measurement). Two matrix reference materials: (1) a polluted soil and (2) an extract reference material of the same polluted soil and a “blind” PAH mixture standard stock solution were distributed to 59 Italian laboratories. The results of interlaboratory comparison showed a significant dispersion of the PAH measurements that masks the effects of the different extraction and cleanup procedures used, but it is consistent with the results of other European interlaboratory comparisons.     

HPLC法测定辣椒油中苏丹红染料的测量不确定度评定

建立了HPLC法分析辣椒油中苏丹红染料的不确定度模型,分析了方法中的不确定度分量及其来源,计算了各不确定度分量和合成标准不确定度。     

Considering uncertainty of measurement when assessing compliance or non-compliance with reference values given in compositional specifications and statutory limits: a proposal

Considering the uncertainty of measurement (UOM) is mandatory when assessing compliance with reference values given in compositional specifications and statutory limits, but the matter is still open to question. Working in the signal or concentration domains and considering false negative together with false positive errors are the main points of debate. Frequently, the available approaches look too simplified for being accurate or too complex (since more rigorously formulated from a theoretical point of view) for being largely acceptable. In the Authors opinion, assessing compliance with reference values given in compositional specifications and statutory limits is a problem similar to that of estimating the limit of detection. This allows proposing a simple operational approach based on well-known and accepted assumptions and approximations. This proposal, described in the light of the most recent literature information, is aimed to stimulate a critical discussion in view of evaluating possible corrections to the generally accepted approach.Papers published in this section do not necessarily reflect the opinion of the Editors, the Editorial Board and the Publisher.     

Evaluation of uncertainty utilising the component by component approach

 This paper reviews the so-called "component by component approach" of evaluating measurement uncertainty. An overview of the evaluation process is given followed by an in-depth discussion of some of the differences between this approach and the approach of utilising validation data. Some of the advantages and disadvantages of using the component by component approach are outlined at the end. Received: 4 August 1999 · Accepted: 11 November 1999     

Revisiting type-A uncertainties relating to the measurement of mass fraction of lead using isotope-dilution inductively coupled plasma mass spectrometry: a way of improving measurement precision and expanded uncertainty

A quadrupole inductively coupled plasma mass spectrometer (Q-ICP-MS) has been used for determination of lead in plant materials using isotope-dilution inductively coupled plasma mass spectrometry. The accuracy of the method was demonstrated by analysis of a matrix certified reference material, NIST SRM 1547 Peach Leaves. Specific instrumental parameters of Q-ICP-MS, including isotope analysis mode, integration time per point, number of points per mass, and number of measurements, were optimized to obtain the best measurement precision. The precision (expressed as relative standard deviation) associated with replicate measurement of the ²⁰⁸Pb/²⁰⁶Pb isotope ratio and its mass-bias correction factor was <0.2%. Following “Example A7” of the Eurachem/CITAC Guide, the relative expanded uncertainty, U _rel, (coverage factor k = 2) was found to be ±1.1%, which fulfilled the target value of ±2% maximum and was lower than the uncertainty of ±3.4% reported by NIST based on isotope-dilution thermal ionization mass spectrometry. Sample recovery of 99% was obtained.     

The Japanese traceability system and the role of uncertainty evaluation in measurement

 The new traceability system of measurement standards based on the Japanese Measurement Law has been established since November 1993. Some reference materials such as metal standard solutions, pH standard solutions and standard gas mixtures are included in the system together with relevant physical quantities. In this system, primary measurement standard instruments or primary reference materials are designated by the regulation for each quantity. For the practical dissemination of each quantity, accreditation of calibration bodies is recognized by the steering committee under the supervision of the government. In the course of assessment of a candidate calibration body, the concepts of ISO/IEC Guide 25 and ISO/IEC Guide 58 are effectively introduced. For the estimation of reliability, the concept of how to introduce the statistical approach is effectively considered. The method of uncertainty evaluation described in the ISO document entitled "Guide to the expression of uncertainty in measurement" is adopted.     

Use of uncertainty estimates as reported by participants in proficiency testing for the evaluation of their results: pros and cons

The aim of this paper is to study the measurement uncertainties reported in proficiency tests (PTs) using examples from PTs in the environmental sector and to compare the obtained measurement uncertainty estimates using different approaches. In addition, the paper focusses on the differences between the z-score and the zeta score. Since the year 2000, the Finnish Environment Institute has asked participants to report analytical methods as well as measurement uncertainties in connection with PT results. The measurement uncertainties of the assigned value have also been evaluated. On the basis of the results, the measurement uncertainties reported by the participants varied greatly. Participants often reported underestimated measurement uncertainties, but overestimated uncertainties were also reported. At the moment, it seems as if performance assessment should be based on the z-score because of a number of significant over- and underestimated measurement uncertainties. The zeta score should be used for information and educational purposes mainly.