Comparability and traceability of coal ash analyses in an interlaboratory study program

From results obtained in an interlaboratory study program, performance characteristics for the determination of major and minor elements in coal ash have been established. For several parameters, a functional relationship between the content (grand mean) and the reproducibility and reproducibility standard deviations could be established: Fe₂O₃, MnO₂, Na₂O, K₂O, MgO, CaO, and SO₃ content in ash. In the interlaboratory study program, it was verified that the data between rounds were comparable. This verification was carried out using blind samples. Received: 28 May 1997 / Revised: 25 June 1998 / Accepted: 26 June 1998     

Comparability and traceability of coal ash analyses in an interlaboratory study program

From results obtained in an interlaboratory study program, performance characteristics for the determination of major and minor elements in coal ash have been established. For several parameters, a functional relationship between the content (grand mean) and the reproducibility and reproducibility standard deviations could be established: Fe₂O₃, MnO₂, Na₂O, K₂O, MgO, CaO, and SO₃ content in ash. In the interlaboratory study program, it was verified that the data between rounds were comparable. This verification was carried out using blind samples.     

A collaborative study to investigate the retention reproducibility of barbiturates in HPLC with a view to establishing retention databases for drug identification

A collaborative study among 10 laboratories has been undertaken to investigate the interlaboratory reproducibility of retention measurements in a high performance liquid chromatographic (HPLC) system for separating barbiturates. The system involved an ODS-Hypersil column with an eluent of methanol:phosphate buffer (40:60, v/v) at pH 8.5; all laboratories used the same batch of packing material. The conventional methods of recording retention properties (retention times and capacity factors) gave poor interlaboratory reproducibility. Better results were obtained by expressing the retentions relative to a standard barbiturate (quinalbarbitone); relative adjusted retention times proved to be more effective than straightforward relative retention times. Retention indices based on the alkylarylketone scale were not as reproducible as the methods based on a single closely related compound. The best reproducibility was obtained using corrected capacity factors based on the retention of four barbiturates in a standard mixture. The results of the study are discussed with a view to selecting the best methods of recording retention in HPLC when considering the establishment of databases for drug identification.     

ISO uncertainty and collaborative trial data

 The possibility of using interlaboratory study repeatability and reproducibility estimates as the basis for measurement uncertainty estimates is discussed. It is argued that collaborative trial reproducibility is an appropriate basis for estimating uncertainty in routine testing provided certain conditions are met by the laboratory. The primary shortcomings relate to establishment of traceability and consequent estimation of bias associated with the method, and quantitatively establishing the relevance to the single laboratory. Approaches to resolving both difficulties are proposed, the former via full implementation of trueness determination suggested in ISO 5725 : 1994 or by independent checks on individual accuracy and precision, the latter via a reconciliation procedure. The paper also discusses other factors including sampling and sample pre-treatment, change in sample matrix, and the influence of level of analyte. Received: 28 October 1997 · Accepted: 17 November 1997     

ELISA kit for mustard protein determination: interlaboratory study

An interlaboratory study in 12 laboratories was performed to prove the validation of the ELISA method developed for the quantitative determination of mustard protein in foods. The ELISA kit used for this study is based on rabbit polyclonal antibody. This kit did not produce any false-positive results or cross-reactivity with in-house validation for a broad range of food matrixes with no detectable mustard protein. All participants obtained the Mustard ELISA kit with standard operational procedures, a list of samples, samples, and a protocol for recording test results. The study included 15 food samples and two spiked samples. Seven food matrix samples of zero mustard content and four samples with mustard declared as an ingredient showed mustard protein content lower than that of the first standard (0.42 mg/kg). Four samples with mustard declared as an ingredient revealed mustard protein content above 12.5 mg/kg (the highest standard). The statistical tests (Cochran, Dixon, and Mandel) and analysis of variance were used to evaluate the interlaboratory study results. Repeatability and reproducibility limits, as well as an LOQ (1.8 mg mustard proteins/kg) and LOD (0.5 mg mustard proteins/kg), for the kit were calculated.     

Determination of measurement uncertainty for the determination of triazines in groundwater from validation data

Laboratories are increasingly urged to submit full uncertainties of their analytical results rather than only standard deviations. The determination of measurement uncertainties in compliance with the Guide to the Expression of Uncertainty in Measurement (GUM) is demonstrated using the validation approach explicitly endorsed by the recent edition of the EURACHEM guide for the determination of measurement uncertainty. Measurement uncertainty was split into uncertainty of the sample mass, uncertainty of the concentration of the stock standard solution, uncertainty of the calibration and uncertainty connected to within- and between-series precision. Uncertainties of sample mass and of the concentration of the stock standard solution were 0.26 and 1.14% for all analytes, which is negligible compared with the contributions of precision and calibration. Uncertainty of calibration was estimated from the calibration graph. Relative uncertainty of calibration was found to be strongly concentration dependent and to be the main uncertainty contribution below 0.2 microgram L-1. Precision was split into within-series and between-series standard deviation, which dominate the combined standard uncertainty at higher concentrations. The results obtained from these calculations are compared with results for a certified reference material and with the performance in an interlaboratory comparison. It was found that all results agreed within their uncertainty with the target values, showing that the estimated uncertainties are realistic.     

A convenient and economic approach to achieve SI-traceable reference values to be used in drinking-water interlaboratory comparisons

Metrologically traceable reference values add an essential benefit to interlaboratory comparisons: unlike consensus values, they can be used to establish national and international comparability. Furthermore, the participating laboratories obtain a reliable and unbiased benchmark to check their results for accuracy. Usually, metrologically traceable reference values are obtained by so-called primary methods which demand excessive efforts at great expense. Within the framework of two national drinking-water interlaboratory comparisons (proficiency testing rounds), a new approach to provide metrologically traceable reference values was applied. It is solely based on existing data which were collected during the comparison itself. Lead (Pb) measurements serve as an example to show how metrologically traceable reference values were derived from the lead amount added during sample preparation and the amount of lead already present in the drinking-water matrix used to prepare these samples. Within this approach, the matrix content is calculated in a way similar to a standard addition experiment. An uncertainty budget for the reference value was set up which describes the link to the corresponding SI units. Isotope dilution mass spectrometry (IDMS) as a primary method was used to validate this approach in the case of cadmium, chromium, copper, lead, and nickel.     

Interlaboratory study of a liquid chromatography method for erythromycin: determination of uncertainty

Erythromycin is a mixture of macrolide antibiotics produced by Saccharopolyspora erythreas during fermentation. A new method for the analysis of erythromycin by liquid chromatography has previously been developed. It makes use of an Astec C18 polymeric column. After validation in one laboratory, the method was now validated in an interlaboratory study. Validation studies are commonly used to test the fitness of the analytical method prior to its use for routine quality testing. The data derived in the interlaboratory study can be used to make an uncertainty statement as well. The relationship between validation and uncertainty statement is not clear for many analysts and there is a need to show how the existing data, derived during validation, can be used in practice. Eight laboratories participated in this interlaboratory study. The set-up allowed the determination of the repeatability variance, s(2)r and the between-laboratory variance, s(2)L. Combination of s(2)r and s(2)L results in the reproducibility variance s(2)R. It has been shown how these data can be used in future by a single laboratory that wants to make an uncertainty statement concerning the same analysis.     

ELISA kit for determination of egg white proteins: interlaboratory study

An interlaboratory study was conducted in 11 laboratories to validate an ELISA method developed for the quantitative determination of egg white proteins (EWPs) in foods. The ELISA kit used for this study is based on sheep polyclonal antibody. It does not produce any false-positive results or cross-reactivity in a broad food matrix range with zero EWP content. All participants obtained the Egg ELISA Kit-native with standard operational procedure and the list of samples, as well as the samples and a protocol for recording test results. The study included 10 food samples. Four samples of food matrix with zero EWP content showed EWP content lower than the first standard (EWP content 0.5 mg/kg). One sample of food matrix with zero EWP content revealed EWP content higher than standard 3 (1.5 mg EWP/kg). Five food samples containing EWP as an ingredient tested positive and one negative. The statistical tests (Cochran, Dixon, and Mandel) and analysis of variance were used to evaluate the interlaboratory study results. Repeatability and reproducibility limits, as well as LOQ (1.4 mg EWP/kg) and LOD (0.43 mg EWP/kg), were calculated for the kit.     

Determination of uncertainty in analytical measurements from collaborative study results on the analysis of a phenoxymethylpenicillin sample

The correct interpretation of a measurement result requires knowledge about its uncertainty. Depending on the conditions under which the analyst is operating, different operational definitions of uncertainty have been proposed. They include: within-laboratory uncertainty, reproducibility uncertainty, bias-included uncertainty and absolute uncertainty. Here we consider the evaluation of the reproducibility uncertainty derived from the results obtained in an inter-laboratory experiment. Nine laboratories participated in an inter-laboratory study for the analysis of phenoxymethylpenicillin. The analyses consisted of a Karl-Fischer water determination, an acid-base titration to assay phenoxymethylpenicillin and a liquid chromatography (LC) method to determine 4-hydroxyphenoxymethylpenicillin and other impurities. The experimental set-up allowed to obtain for each determination s_r² and s_L² as estimates of the repeatability variance (σ_r²) and the between-laboratory variance (σ_L²), respectively. The reproducibility uncertainties for the different assays were then derived from these estimates.     

Multielement trace determination in SiC powders: assessment of interlaboratory comparisons aimed at the validation and standardization of analytical procedures with direct solid sampling based on ETV ICP OES and DC arc OES

The members of the committee NMP 264 “Chemical analysis of non-oxidic raw and basic materials” of the German Standards Institute (DIN) have organized two interlaboratory comparisons for multielement determination of trace elements in silicon carbide (SiC) powders via direct solid sampling methods. One of the interlaboratory comparisons was based on the application of inductively coupled plasma optical emission spectrometry with electrothermal vaporization (ETV ICP OES), and the other on the application of optical emission spectrometry with direct current arc (DC arc OES). The interlaboratory comparisons were organized and performed in the framework of the development of two standards related to “the determination of mass fractions of metallic impurities in powders and grain sizes of ceramic raw and basic materials” by both methods. SiC powders were used as typical examples of this category of material. The aim of the interlaboratory comparisons was to determine the repeatability and reproducibility of both analytical methods to be standardized. This was an important contribution to the practical applicability of both draft standards. Eight laboratories participated in the interlaboratory comparison with ETV ICP OES and nine in the interlaboratory comparison with DC arc OES. Ten analytes were investigated by ETV ICP OES and eleven by DC arc OES. Six different SiC powders were used for the calibration. The mass fractions of their relevant trace elements were determined after wet chemical digestion. All participants followed the analytical requirements described in the draft standards. In the calculation process, three of the calibration materials were used successively as analytical samples. This was managed in the following manner: the material that had just been used as the analytical sample was excluded from the calibration, so the five other materials were used to establish the calibration plot. The results from the interlaboratory comparisons were summarized and used to determine the repeatability and the reproducibility (expressed as standard deviations) of both methods. The calculation was carried out according to the related standard. The results are specified and discussed in this paper, as are the optimized analytical conditions determined and used by the authors of this paper. For both methods, the repeatability relative standard deviations were <25%, usually ~10%, and the reproducibility relative standard deviations were <35%, usually ~15%. These results were regarded as satifactory for both methods intended for rapid analysis of materials for which decomposition is difficult and time-consuming. Also described are some results from an interlaboratory comparison used to certify one of the materials that had been previously used for validation in both interlaboratory comparisons. Thirty laboratories (from eight countries) participated in this interlaboratory comparison for certification. As examples, accepted results are shown from laboratories that used ETV ICP OES or DC arc OES and had performed calibrations by using solutions or oxides, respectively. The certified mass fractions of the certified reference materials were also compared with the mass fractions determined in the interlaboratory comparisons performed within the framework of method standardization. Good agreement was found for most of the analytes.     

IMEP in support of the comparability of measurement results across the Romanian chemical metrology infrastructure

On the basis of quantitative chemical measurements many important decisions are made in support of legislation or in industrial processes or social aspects. For this reason it is important to improve the quality of chemical measurement results and thus make them comparable and acceptable everywhere. The measurement quality is important to enable an equivalent implementation of the European Union regulations and directives across an enlarged EU. In this context, the European Commission–Joint Research Centre–Institute for Reference Materials and Measurement (EC-JRC-IRMM) set up a programme to improve the scientific basis for metrology in chemistry (MiC) in EU candidate countries in the framework of EU enlargement. Several activities were initiated, such as training, fellowships, sponsoring of seminars, conferences and participation in interlaboratory comparisons. To disseminate measurement traceability, IRMM provides through its International Measurement Evaluation Programme (IMEP) an interlaboratory tool to enable the benchmarking of laboratory performance. IMEP emphasizes the metrological aspects of measurement results, such as traceability and measurement uncertainty. In this way it has become a publicly available European tool for MiC. The Romanian Bureau of Legal Metrology – National Institute of Metrology (BRML-INM) actively supports the participation of Romanian authorized and field laboratories in IMEP interlaboratory comparisons. This paper describes the interest of Romanian laboratories participating in this programme, the analytical and metrological problems that became relevant during these exercises and some actions for improvement. The results from Romanian laboratories participating in IMEP-12 (water), IMEP-16 (wine), IMEP-17 (human serum) and IMEP-20 (tuna fish) are presented. To conclude, the educational and training activities at national level organized jointly by the Romanian National Institute of Metrology (INM) and IRMM are also mentioned.     

One way of disseminating reference values with demonstrated traceability and demonstrated uncertainty to field laboratories: IMEP

An operational interlaboratory comparison programme is described which disseminates SI-traceable reference values to laboratories worldwide. These reference values have an uncertainty and traceability that is demonstrated at the highest metrological level. Participating laboratories can use these values to establish the degree of equivalence of their measurement results and can use this to support their measurement capability claims, e.g. towards third parties. The programme has been run by the Institute for Reference Materials and Measurements (IRMM) since 1988, in the first phase as an awareness programme. Currently, IRMM is focusing its efforts on educational aspects of metrology via a collaboration with the European Co-operation for Accreditation, national metrological institutes (NMIs) and interested academic networks. The viewgraphs used are presented in the “Electronic Supplementary Material” of this ACQUAL issue.     

Interlaboratory study of the bioluminescence inhibition tests for rapid wastewater toxicity assessment

Several toxicity procedures are currently being used for the wastewater toxicity assessment. We have undertaken an interlaboratory comparison of the use of different bioluminescence inhibition toxicity tests based on Vibrio fischeri, in order to evaluate their reproducibility for the rapid wastewater toxicity assessment. Twenty-two laboratories took part in this study organized by the Institut Català de Tecnologia (ICT) and the Consejo Superior de Investigaciones Cientificas (CSIC). During the exercise, six series of six samples were analyzed along 5 months. Every batch of samples was composed by three real samples and three standard solutions. The real samples were: an untreated effluent of a paper industry, a sample from a first settlement of a wastewater treatment plant (WWTP) and the final effluent of the WWTP. The goals of the interlaboratory study were to evaluate the repeatability (r) and reproducibility (R) when different laboratories conduct the test, the influence of different matrix samples, the variability between different tests based on the same principle: the bioluminescence inhibition of V. fischeri, but involving different commercial devices and to determine the rate at which participating laboratories successfully completed tests initiated. The maximum number of outlier values was corresponding to a non-treated effluent from a paper industry. This also was the most complex and toxic sample analyzed. An increase on the non-convergent values obtained for the participants was observed at higher matrix complexity and at lower toxicity level. In comparison with other editions of this interlaboratory study the matrixes of real samples analyzed were more complex, nevertheless the final variability coefficient for the exercise was nearby to the average value for the past editions. Due to the high complexity of some samples involved in this intercalibration the stability of real samples were also followed during the test. On the other hand, no relation was found between final results and the different devices, as show the cluster analysis.     

Determination of the total nitrogen content of hard, semihard, and processed cheese by the Kjeldahl method: collaborative study

The objective of this collaborative study was to determine interlaboratory performance statistics for a modified and optimized version of AOAC Method 920.123 for the determination of the total nitrogen content of hard, semihard, and processed cheese by Kjeldahl analysis. Details included addressing the issues of material homogeneity, test portion size (1 g), quantitative transfer (weighing on to filter paper), ensuring system suitability (nitrogen recoveries), and using AOAC Method 991.20 as the basis for nitrogen analysis. Fifteen laboratories tested 18 pairs of blind duplicate cheese materials with a crude protein content between 18 and 36%. Materials represented hard, semihard, and processed commercial cheeses with a wide range of composition. Statistical performance parameters expressed as crude protein (nitrogen x 6.38), g/100 g, with invalid and outlier data removed were mean = 26.461, repeatability standard deviation (Sr) 0.111, reproducibility standard deviation (S(R)) = 0.153, repeatability relative standard deviation (RSDr) = 0.42%, reproducibility relative standard deviation (RSDR) = 0.58%, repeatability (r) = 0.312, and reproducibility (R) = 0.428. The interlaboratory study results were acceptable and comparable to those for the milk Kjeldahl nitrogen method on a relative nitrogen basis. The Study Directors recommend that this modified method for the determination of total nitrogen in hard, semihard, and processed cheese by Kjeldahl analysis be adopted First Action as an improved method to replace Method 920.123.     

Liquid chromatographic method for nicarbazin in broiler feeds and premixtures: development, validation, and interlaboratory study

A reversed-phase liquid chromatography method for nicarbazin in broiler feeds and premixtures was developed, validated, and interlaboratory studied. The extraction solvent was an acetonitrile-methanol (1 + 1) mixture. For feedingstuffs, water was also added. The 4,4'-dinitrocarbanilide moiety of nicarbazin was detected at a wavelength of 350 nm. Recovery was > or =87%. At 20 mg/kg, the repeatability was 0.7% and the within-laboratory reproducibility was 2.7%. The limit of determination was <20 mg/kg. Other feed additives did not interfere in the assay that proved to be applicable to broiler feeds from different European Union countries. In an interlaboratory study, 4 positive broiler feeds, 1 blank pig feed, and 1 broiler premixture were analyzed by 19 laboratories using the method developed in this study. The relative standard deviation for repeatability (RSDr) of the feedingstuffs (20-240 mg/kg) varied between 2.6 and 10.2%. The HORRAT ranged between 0.70 and 1.22. Recoveries were 91-108%. Three laboratories detected small signals in the blind blank samples, ranging from 0.4 to 2 mg/kg. For the premixture, acceptable results for reproducibility could only be obtained after the sample weight and volume of extraction had been doubled. To avoid excessive dilution of the extracts, the range of the calibration curve had also been doubled. With this modified method, the RSDr was 5.7% and the HORRAT was 1.95 (10 laboratories).     

Validation of a new enzyme-linked immunosorbent assay to detect the triggering proteins and peptides for celiac disease: interlaboratory study

The performance of Gluten-Tec (EuroProxima, Arnhem, The Netherlands) was tested through an interlaboratory study in accordance with AOAC guidelines. Gluten-Tec is a competitive ELISA that detects an immunostimulatory epitope of a-gliadin in dietary food for celiacs. Fifteen laboratories, representing 14 different countries, announced their interest in taking part in this study. Of the 12 laboratories that sent the results within the established timeframe, two submitted inappropriate standard curves and were excluded from the statistical analysis. Four different food matrixes (rice-based baby food, maize bread, chocolate cake mix, and beer) were selected for preparing the test samples. Two gliadin extraction procedures were used: the conventional 60% ethanol, and a new method based on the reducing reagent dithiothreitol. The 38 samples (19 blind duplicates) tested in this study were prepared by diluting the different extracts in order to cover a wide range of gliadin levels. Both sample extraction and dilution were performed by EuroProxima; the present interlaboratory study was focused only on testing the ELISA part of the Gluten-Tec kit protocol. Repeatability values (within-laboratory variance), expressed as RSD(r) ranged from 6.2 to 25.7%, while reproducibility values (interlaboratory variance), expressed as RSD(R), ranged from 10.6 to 45.9%. Both statistical parameters were in the acceptable range of ELISAs under these conditions, and the method will be presented to the Codex Alimentarius as a preferred method for gluten analysis.     

Experimental evaluation of different precision criteria applicable to microbiological counting methods

The dispersion of microbiological counting measurements, when repeating the analysis on the same material both within a laboratory (repeatability) and between laboratories (reproducibility) can be characterized by the organization of interlaboratory studies, where several sets of identical test materials are sent to several laboratories. Using the example of data generated by an interlaboratory study on enumeration of Listeria monocytogenes in foods by the standardized reference method (colony-count technique), 2 types of robust estimators of reproducibility standard deviations, based on the median, were examined, in comparison with the classical estimators, based on the mean. Experimental evaluation indicated that the 3 approaches gave consistent results for most of the combinations. The usual log10 transformation of the enumeration results was also questioned before these calculations were conducted.     

Alternative calculation of measurement uncertainty with global approach in food microbiology

Calculation of measurement uncertainty is a requirement for all laboratories accredited to ISO/IEC 17025 including those carrying out microbiological analyses. Today, calculation of measurement uncertainty in microbiological analyses using precision data according to global approach principles is widely recognized by the microbiologists due to difficulties in quantification of individual uncertainty sources. In food microbiology, precision data obtained from different samples usually show over-dispersion, and the use of over-dispersed data may result in large variance. The current ISO standard on measurement uncertainty in food microbiology proposes the use of log-transformed precision data to overcome this problem. This paper proposes an alternative procedure to calculate the measurement uncertainty in food microbiology using non-logarithmic precision data. The calculations used in this procedure based on relative range of duplicate analyses can be applied to intra-laboratory reproducibility data obtained from microbiological analyses of which duplicate results show relatively low variation.