A new approach in assessing microbiological results in water analysis proficiency testing

Due to the relatively large spread in the results of microbiological proficiency tests, the z-scores are often not able to detect zero or low results as being ‘bad’ results. This paper describes an adapted z-score based on the average or the standard deviation of the 50% ‘highest’ results. The combination of the adapted z-scores of four samples enables a better judgement of the performance of each laboratory. Papers published in this section do not necessarily reflect the opinion of the Editors, the Editorial Board or the Publisher.     

Comparability and compatibility of proficiency testing results in schemes with a limited number of participants

Comparability and compatibility of proficiency testing (PT) results are discussed for schemes with a limited number of participants (less than 20–30) based on the use of reference materials (RMs) as test items. Since PT results are a kind of measurement/analysis/test result, their comparability is a property conditioned by traceability to measurement standards applied in the measurement process. At the same time, metrological traceability of the certified value of the RM (sent to PT participants as test items) is also important, since the PT results are compared with the RM certified value. The RM position in the calibration hierarchy of measurement standards sets the degree of comparability for PT results, which can be assessed in the scheme. However, this assessment is influenced by commutability (adequacy or match) of the matrix RM used for PT and routine samples. Compatibility of PT results is a characteristic of the collective (group) performance of the laboratories participating in PT that can be expressed as closeness of the distribution of the PT results to the distribution of the RM data. Achieving quality-of-measurement/analysis/test results in the framework of the concept “tested once, accepted everywhere” requires both comparability and compatibility of the test results.     

A new approach for proficiency test exercise data evaluation

In this paper, a new data evaluation method for proficiency test exercises consisting of a combination of a z-test, a zeta test and an uncertainty outlier test is presented. This new method is compared with eight other evaluation methods (both measurement uncertainty using and measurement uncertainty ignoring) in common use and/or recommended by ISO 13528. The data set used to test the evaluation methods is real data and consists of the ⁹⁵Nb results of the National Physical Laboratory Environmental Radioactivity Proficiency Test Exercise 2007. The evaluation of 14 out of 32 results were affected by the choice of method.     

An error model for evaluation and interpretation of proficiency testing

Data from proficiency testing can be used to increase our knowledge of the performance of populations of laboratories, individual laboratories and different measurement methods. To support the evaluation and interpretation of results from proficiency testing an error model containing different random and systematic components is presented. From a single round of a proficiency testing scheme the total variation in a population of laboratories can be estimated. With results from several rounds the random variation can be separated into a laboratory and time component and for individual laboratories it is then also possible to evaluate stability and bias in relation to the population mean. By comparing results from laboratories using different methods systematic differences between methods may be indicated. By using results from several rounds a systematic difference can be partitioned into two components: a common systematic difference, possibly depending on the level, and a sample-specific component. It is essential to distinguish between these two components as the former may be eliminated by a correction while the latter must be treated as a random component in the evaluation of uncertainty. Received: 20 November 2000 Accepted: 3 January 2001     

Uncertainty evaluation in proficiency testing: state-of-the-art, challenges, and perspectives

The evaluation of measurement uncertainty, and that of uncertainty statements of participating laboratories will be a challenge to be met in the coming years. The publication of ISO 17025 has led to the situation that testing laboratories should, to a certain extent, meet the same requirements regarding measurement uncertainty and traceability. As a consequence, proficiency test organizers should deal with the issues measurement uncertainty and traceability as well. Two common statistical models used in proficiency testing are revisited to explore the options to include the evaluation of the measurement uncertainty of the PTRV (proficiency test reference value). Furthermore, the use of this PTRV and its uncertainty estimate for assessing the uncertainty statements of the participants for the two models will be discussed. It is concluded that in analogy to Key Comparisons it is feasible to implement proficiency tests in such a way, that the new requirements can be met. Received: 29 September 2000 Accepted: 3 December 2000     

Approaching target uncertainty in proficiency testing schemes: experience in the field of water measurement

Good correspondence between evaluations of the proficiency testing data for water measurements according to different scoring schemes was found as a result of implementation of the measurement quality according to the target uncertainty defined in the Drinking Water Directive. The accuracy of the evaluation is determined by the uncertainty of the assigned value, and this uncertainty should be in correspondence with the target uncertainty. Modification of the zeta-score by the thorough application of the target uncertainty is presented. It is convenient for generalised presentation of the proficiency testing data. The allowed bias is included as a linear term on the measured value scale, as it is treated in uncertainty analysis. The importance of implementation of the target measurement uncertainty in other fields of the routine measurements is indicated.     

The application of data from proficiency testing to laboratory accreditation according to ISO 17025

Current methods of testing laboratories for their proficiency in reporting correct measurement results are liable to substantial errors of the second kind. This means that laboratories with deflated uncertainties are accepted as proficient, even though their reported measurement results pave the way for erroneous conclusions. Only by using E _n numbers based on an accepted reference value with the lowest possible uncertainty can the risk of recognising incorrect measurement results be kept at an acceptable level. Based on an actual set of proficiency test (PT)-data for the concentration of Pb in water, this paper compares PT results obtained by methods using E _n numbers with methods based on z-scores. Kaj Heydorn is a technical assessor at The Danish Accreditation and Metrology Fund (DANAK).     

Interpretation of interlaboratory comparison results to evaluate laboratory proficiency

Guidelines are given for the evaluation of proficiency test (PT) results in order to increase the effectivity of PT participation. For better understanding, some statistical background is given along with some examples to show the effects of the choices made by the PT provider. The calculation method of the assigned value and the selection of the standard deviation both affect the z-score that is used by the participating laboratory to judge the quality of its performance in the PT. Therefore, the participating laboratory is advised to use the PT results with care and, if necessary, to recalculate the z-scores. Finally, advice is given on how not to follow up bad PT results along with some valuable steps that could be part of an effective follow-up procedure.     

Integration of metrological principles and performance evaluation in a proficiency testing scheme in support of the Council Directive 98/83/EC

Proficiency testing as a means of external quality assessment plays the role of independent evidence of laboratories’ performance. To enable laboratories to fulfil the requirements stated in legislation, methodology for evaluation of laboratories’ performance in proficiency testing schemes should incorporate principles of measurement results which are fit for intended use and incorporate evaluation of laboratories’ performances based on independent reference value. A proficiency testing scheme was designed to support Drinking Water Directive (98/83/EC) specifically. The methodology for performance evaluation, which takes into account a “fitness for purpose”-based standard deviation for proficiency assessment, is proposed and discussed in terms of requirements of the Drinking Water Directive. A ζ′-score, modified by application of target uncertainty was developed in a way that fulfils requirements defined in the legislation. As an illustration, results are reported for nitrate concentration in water. The approach presented can also be applied to other fields of measurements.     

Estimation of uncertainty in p<Emphasis Type="Italic">K</Emphasis><Subscript>a</Subscript> values determined by potentiometric titration

A procedure is presented for estimation of uncertainty in measurement of the pK(a) of a weak acid by potentiometric titration. The procedure is based on the ISO GUM. The core of the procedure is a mathematical model that involves 40 input parameters. A novel approach is used for taking into account the purity of the acid, the impurities are not treated as inert compounds only, their possible acidic dissociation is also taken into account. Application to an example of practical pK(a) determination is presented. Altogether 67 different sources of uncertainty are identified and quantified within the example. The relative importance of different uncertainty sources is discussed. The most important source of uncertainty (with the experimental set-up of the example) is the uncertainty of pH measurement followed by the accuracy of the burette and the uncertainty of weighing. The procedure gives uncertainty separately for each point of the titration curve. The uncertainty depends on the amount of titrant added, being lowest in the central part of the titration curve. The possibilities of reducing the uncertainty and interpreting the drift of the pK(a) values obtained from the same curve are discussed.     

The uncertainty in the calculation of the amount of blocked and reactive lysine in milk products,as determined by the furosine method

The measurement uncertainty in the calculation of the amount of blocked and reactive lysine (as determined by the furosine method) was evaluated according to the procedure described in the Eurachem/CITAC guide. The analytical method involves the chromatographic determination of lysine and furosine after acid hydrolysis. The calculation of blocked and reactive lysine in the initial protein is based on known conversion factors. The estimation of the uncertainty was performed in two steps: (1) determination of the uncertainty in the chromatographic determination of lysine and furosine, and (2) determination of the uncertainty in the calculation of blocked and reactive lysine. The individual contributions to the final uncertainty were identified, quantified, and combined in uncertainty budgets. The largest contribution to the calculation of blocked lysine came from estimating the conversion factor of blocked lysine into furosine during acid hydrolysis. For the calculation of reactive lysine, the main contribution came from the chromatographic determination of lysine. The uncertainty estimates were compared to available validation data (in-house and collaborative standard deviations of reproducibility).     

Bimodality of molecular mass distribution of polydienes obtained under the action of dilithium initiators in hydrocarbon media: the reasons,mathematical simulations,and their experimental testing

Bimodal molecular mass distribution (MWD) of polymers, obtained upon polymerization of hydrocarbon monomers in the nonpolar media under the action of dilithium initiators, is the consequence of separation of the reaction mixture into two phases. Bifunctional /living/ oligomers produce the insoluble sediment due to tetrameric association of the lithium active sites (the swollen gel-fraction). Part of the active site remains in the solution (the solfraction). Difference in the concentrations of the active sites into the phases leads to difference between the propagation rates of the /living/ chains and, as a result, to Bimodal MWD. The mathematical model of polymerization in the two-phase system is proposed. Satisfactory agreement between the calculations and the experiments is shown for butadiene polymerization in heptane under the action of 1,4-dilithiumpentane. Regulation of MWD up to the complete elimination of bimodality is possible via the programmed dosage of monomer and solvent into the reactor.     

QUASIMEME results of laboratories involved in the German Marine Monitoring Programme for the North and Baltic Seas

This case study is written for laboratories in the German Marine Monitoring Program (GMMP) for the North and Baltic Seas in order to give support to the assessment of proficiency testing results for their external quality assurance. A second issue is to provide a practical, understandable and common way for the calculation of laboratory performance parameters, so-called combination scores. In this paper, the GMMP laboratory proficiency testing results of QUASIMEME (Quality Assurance of Information for Marine Environmental Monitoring in Europe) Laboratory Performance Studies for the last 5 years were reviewed. Combination scores for organochlorine pesticides and chlorinated biphenyls in marine sediment are presented and explained. However, the assessment approach is very general and should be applicable to most testing laboratories in the chemical field.Presented at the Eurachem PT Workshop September 2005, Portorož, Slovenia     

Synthesis of chiral sulfinamido-sulfonamides and their evaluation as ligands for the enantioselective ethylation of aldehydes

A family of chiral sulfinamido-sulfonamide ligands have been synthesized from sulfinimines and has been evaluated as ligands for the enantioselective addition of diethylzinc to aldehydes with Ti(OⁱPr)₄. The structure of these diamino compounds has been systematically modified to optimize the results.     

Quantification of measurement uncertainty in the sequential determination of <Superscript>210</Superscript>Pb and <Superscript>210</Superscript>Po by liquid scintillation counting and alpha-particle spectrometry

Methodologies for the quantification of measurement uncertainties associated with the determination of ²¹⁰Pb- and ²¹⁰Po-specific activities by liquid scintillation counting (LSC) and alpha-particle spectrometry are presented, and are demonstrated using the soil reference material IAEA-326. Major contributors to the combined uncertainty associated with the measurement result of ²¹⁰Pb were the uncertainties of net count rates in the ²¹⁰Pb energy region of the sample spectrum and in the ²¹⁰Bi energy region of the blank spectrum. The predominant sources of uncertainty in the measurement of ²¹⁰Po were the uncertainties of net count rates in the regions of interest of ²⁰⁹Po and ²¹⁰Po. The relative standard uncertainty of ²¹⁰Po exponentially increases with the time interval between the sampling date and the separation date of Po, and this effect is strongly dependent on the ²¹⁰Po/²¹⁰Pb activity ratio. When the specific activity of ²¹⁰Pb is much higher than that of ²¹⁰Po in the sample, the relative standard uncertainty of the ²¹⁰Po determination increases significantly within a short time interval between the sampling date (or reference date) and the separation date of Po in samples.     

Reliability and uncertainty in the estimation of p<Emphasis Type="Italic">K</Emphasis><Subscript>a</Subscript> by least squares nonlinear regression analysis of multiwavelength spectrophotometric pH titration data

When drugs are poorly soluble then, instead of the potentiometric determination of dissociation constants, pH-spectrophotometric titration can be used along with nonlinear regression of the absorbance response surface data. Generally, regression models are extremely useful for extracting the essential features from a multiwavelength set of data. Regression diagnostics represent procedures for examining the regression triplet (data, model, method) in order to check (a) the data quality for a proposed model; (b) the model quality for a given set of data; and (c) that all of the assumptions used for least squares hold. In the interactive, PC-assisted diagnosis of data, models and estimation methods, the examination of data quality involves the detection of influential points, outliers and high leverages, that cause many problems when regression fitting the absorbance response hyperplane. All graphically oriented techniques are suitable for the rapid estimation of influential points. The reliability of the dissociation constants for the acid drug silybin may be proven with goodness-of-fit tests of the multiwavelength spectrophotometric pH-titration data. The uncertainty in the measurement of the pK _a of a weak acid obtained by the least squares nonlinear regression analysis of absorption spectra is calculated. The procedure takes into account the drift in pH measurement, the drift in spectral measurement, and all of the drifts in analytical operations, as well as the relative importance of each source of uncertainty. The most important source of uncertainty in the experimental set-up for the example is the uncertainty in the pH measurement. The influences of various sources of uncertainty on the accuracy and precision are discussed using the example of the mixed dissociation constants of silybin, obtained using the SQUAD(84) and SPECFIT/32 regression programs.     

Quantification of the push-pull character of azo dyes and a basis for their evaluation as potential nonlinear optical materials

The push-pull characters of a large series of donor-acceptor substituted azo dyes—71 structures in all—have been quantified by the NN double bond lengths, d_NN, the ¹⁵N NMR chemical shift differences, Δδ_15N, of the two nitrogen atoms and the quotient, π^∗/π, of the occupations of the antibonding π^∗, and bonding π orbitals of this partial NN double bond. The excellent correlation of the occupation quotients with the bond lengths strongly infers that both π^∗/π and d_NN are excellent parameters for quantifying charge alternation in the push-pull chromophore and the molecular hyperpolarizability, β₀, of these compounds. By this approach, selected compounds can be appropriately considered as viable candidates for nonlinear optical (NLO) applications.     

Comparison of ISO-GUM and Monte Carlo methods for the evaluation of measurement uncertainty: application to direct cadmium measurement in water by GFAAS

The propagation stage of uncertainty evaluation, known as the propagation of distributions, is in most cases approached by the GUM (Guide to the Expression of Uncertainty in Measurement) uncertainty framework which is based on the law of propagation of uncertainty assigned to various input quantities and the characterization of the measurand (output quantity) by a Gaussian or a t-distribution. Recently, a Supplement to the ISO-GUM was prepared by the JCGM (Joint Committee for Guides in Metrology). This Guide gives guidance on propagating probability distributions assigned to various input quantities through a numerical simulation (Monte Carlo Method) and determining a probability distribution for the measurand.In the present work the two approaches were used to estimate the uncertainty of the direct determination of cadmium in water by graphite furnace atomic absorption spectrometry (GFAAS). The expanded uncertainty results (at 95% confidence levels) obtained with the GUM Uncertainty Framework and the Monte Carlo Method at the concentration level of 3.01 μg/L were ±0.20 μg/L and ±0.18 μg/L, respectively. Thus, the GUM Uncertainty Framework slightly overestimates the overall uncertainty by 10%. Even after taking into account additional sources of uncertainty that the GUM Uncertainty Framework considers as negligible, the Monte Carlo gives again the same uncertainty result (±0.18 μg/L). The main source of this difference is the approximation used by the GUM Uncertainty Framework in estimating the standard uncertainty of the calibration curve produced by least squares regression. Although the GUM Uncertainty Framework proves to be adequate in this particular case, generally the Monte Carlo Method has features that avoid the assumptions and the limitations of the GUM Uncertainty Framework.     

Tetracyanonickelate compounds as sorptive materials and the substitution of their H2O content by D2O

The compounds NiNi(CN)₄·3,5H₂O and Ni(NH₃)₂Ni(CN)₄·H₂O have been studied to examine the possibility of substituting their H₂O or NH₃ content by D₂O. Contact with D₂O was performed after heating the compounds to several temperatures. Depending on the degree of decomposition of the original compounds different ranges of substitution were possible. In such manner the compounds NiNi(CN)₄·3,5D₂O, NiNi(CN)₄·5D₂O, Ni(NH₃)₂Ni(CN)₄·D₂O, and Ni(D₂O)₂Ni(CN)₄·D₂O were prepared and thermally they were less stable than the original ones. The substitution by D₂O is in agreement with the sorptive properties of the original tetracyanonickelate against different organic compounds using GC, since these could substitute the guest component and sometimes also the ligands during their decomposition.