Comparison of international standards concerning the capability of detection for analytical methods

The international standard ISO 11843 specifies the experimental conditions for the estimation of critical values of analytical methods referring to the capability of detection. The present paper aimed at a formal comparison of the ISO 11843 standard with the German standard DIN 32645 and the Commission Decision 2002/657/EC of the EU. In this context the particular scope of each standard is discussed based on a numerical example given in the DIN standard. For practitioners a better understanding of the different guidelines based on the same basics, i.e. the statistical theory of hypothesis testing and the probabilities of false positives α and false negatives β, is to be achieved.     

Multielement trace determination in SiC powders: assessment of interlaboratory comparisons aimed at the validation and standardization of analytical procedures with direct solid sampling based on ETV ICP OES and DC arc OES

The members of the committee NMP 264 “Chemical analysis of non-oxidic raw and basic materials” of the German Standards Institute (DIN) have organized two interlaboratory comparisons for multielement determination of trace elements in silicon carbide (SiC) powders via direct solid sampling methods. One of the interlaboratory comparisons was based on the application of inductively coupled plasma optical emission spectrometry with electrothermal vaporization (ETV ICP OES), and the other on the application of optical emission spectrometry with direct current arc (DC arc OES). The interlaboratory comparisons were organized and performed in the framework of the development of two standards related to “the determination of mass fractions of metallic impurities in powders and grain sizes of ceramic raw and basic materials” by both methods. SiC powders were used as typical examples of this category of material. The aim of the interlaboratory comparisons was to determine the repeatability and reproducibility of both analytical methods to be standardized. This was an important contribution to the practical applicability of both draft standards. Eight laboratories participated in the interlaboratory comparison with ETV ICP OES and nine in the interlaboratory comparison with DC arc OES. Ten analytes were investigated by ETV ICP OES and eleven by DC arc OES. Six different SiC powders were used for the calibration. The mass fractions of their relevant trace elements were determined after wet chemical digestion. All participants followed the analytical requirements described in the draft standards. In the calculation process, three of the calibration materials were used successively as analytical samples. This was managed in the following manner: the material that had just been used as the analytical sample was excluded from the calibration, so the five other materials were used to establish the calibration plot. The results from the interlaboratory comparisons were summarized and used to determine the repeatability and the reproducibility (expressed as standard deviations) of both methods. The calculation was carried out according to the related standard. The results are specified and discussed in this paper, as are the optimized analytical conditions determined and used by the authors of this paper. For both methods, the repeatability relative standard deviations were <25%, usually ~10%, and the reproducibility relative standard deviations were <35%, usually ~15%. These results were regarded as satifactory for both methods intended for rapid analysis of materials for which decomposition is difficult and time-consuming. Also described are some results from an interlaboratory comparison used to certify one of the materials that had been previously used for validation in both interlaboratory comparisons. Thirty laboratories (from eight countries) participated in this interlaboratory comparison for certification. As examples, accepted results are shown from laboratories that used ETV ICP OES or DC arc OES and had performed calibrations by using solutions or oxides, respectively. The certified mass fractions of the certified reference materials were also compared with the mass fractions determined in the interlaboratory comparisons performed within the framework of method standardization. Good agreement was found for most of the analytes.     

The determination of adsorbable organically bound halogens (AOX) in soil: interlaboratory comparisons and reference materials

The interlaboratory variability in the quantification of adsorbable organically bound halogens (AOX) in industrially contaminated soil is presented. Three consecutive rounds of a proficiency testing scheme, in which between 88 and 119 routine laboratories participated, yielded relative reproducibility standard deviations between 7 and 20% at AOX contents between 10.9 and 268 mg kg⁻¹. Nineteen laboratories with established proficiency were invited to participate in the certification of the AOX content in three soil reference materials meant for the internal quality control in analytical laboratories. The certified values are (1349 ± 59) mg kg⁻¹, (80 ± 7) mg kg⁻¹ and (102 ± 8) mg kg⁻¹, respectively.     

Swedish interlaboratory trials on proximates and certain macro minerals

Summary During the period 1980–1986 a number of samples representing different kinds of food items were distributed to about thirty laboratories for analysis. The objective was to test the laboratories with respect to their analytical skill in proximate analyses. Towards the end of the period the condition for analyses and the statistical technique had been developed in such a way that variations could be estimated within laboratories (repeatability) as well as between laboratories (reproducibility). An ellipse was constructed so that the probability for a randomly selected laboratory to fall within the ellipse would be 95%. This presentation also gives an example of wether mean values and standard deviations for a specific item change depending on the time between two courses of analysis.     

Round robin for uranium isotopic measurements by mass spectrometry

A round-robin for uranium isotopic analysis in two solutions with different concentrations prepared and certified by the Institute for Reference Materials and Measurements (IRMM, Geel, Belgium) was organized by CETAMA, a division of the Commissariat à l’énergie Atomique (CEA: French Atomic Energy Commission Fourteen laboratories took part in the program using twenty-five different instruments (ICP-QMS, ICP-SFMS and TIMS). For each solution and each isotopic ratio, a statistical analysis based on standard ISO 5725 was carried out to calculate the mean, the repeatability and reproducibility standard deviations, the z-score and zeta-score, the bias with respect to the target values, and to compare their precision. The mean measurement results for the ²³⁴U/²³⁸U and ²³⁵U/²³⁸U isotopic ratios show no significant biases compared with the target values, whatever is the analytical technique. The results were much less satisfactory for the ²³⁶U/²³⁸U isotopic ratio, for which only the laboratories specialized in traces analyses and/or precise isotopic analyses submitted results in good agreement with the target values. A detailed discussion is given in this article.     

The degree of efficiency, the degree of reproducibility and the equivalence probability in statistical comparisons of analytical methods for the determination of tin in tin ores

Summary In most cases investigations concerning the reproducibility of different analytical methods for the determination of tin in tin ores consist only in comparisons of means, i.e. detection of systematic errors. The fact that the methods use different calibrating procedures, on the one hand, and that their accuracy varies, on the other hand, makes it necessary, to look for more sensitive criteria. For this purpose, the degree of efficiency regarding the determination of the true mean of a reference method, the degree of (mutual) reproducibility, and the equivalence probability are defined and their meaning is statistically interpreted. The degree of efficiency ɛ of any two methods is defined as the ratio of their mean square errors in determining the true mean of a reference method. This quantity can be described by the ratio of the upper bounds for the probabilities of an error by the two methods. The degree of reproducibility P* of different analytical methods we understand as minimal probability of comparable measuring results. The equivalence probability P_e is defined as a-posteriori probability of the hypothesis that the two distribution functions considered are identical. The criteria ɛ, P* and P_e seem to be more suitable for statistical comparisons as compared to known statistical standard procedures, such as the t-test criterion. The applicability of these quantities was checked by the example of 6 different methods for the determination of tin in tin ores. For this purpose, it was necessary to evaluate objectively the efficiency of sample division in order to get reproducible final samples for analysis using the hierarchical two-way classification of variance analysis. General knowledge concerning the analytical methods used could be completed.     

Interactive programme for evaluation of circular analyses (IPECA)

A PC-based interactive programme is described which is designed to help in suggesting the best estimate of the true value of an analyte content from results of collective studies aiming at deriving consensus values and/or reference material preparation by employing combined statistical and analytical considerations. The Grubbs, Dixon, Huber tests, and the coefficients of skewness and curtosis tests are used for outlier detection, the Bartlett, Cochran, and the standard error tests are employed for testing variance homogeneity testing and/or variance outliers identification, while the normality of results distribution is tested according to the Kolmogoroff-Smirnoff-Lilliefors and Shapiro-Wilk tests. One-way analysis of variance (ANOVA) is employed to test differences among means of results obtained in different conditions (laboratories, analytical methods, etc.) and to calculate the overall mean and its confidence interval accordingly. Points for an analytical discussion are given which should be considered prior to a decision whether a result of a trace element determination, identified as an outlier from statistical reasons, should be rejected.     

Quality assurance in the view of a commercial analytical laboratory

 The necessity for analytical quality assurance is primarily a feature of the analytical process itself. With the full establishment of the EU domestic market, it is also becoming a legal necessity for an increasing number of analytical laboratories. The requirements which laboratories will need to fulfil are stipulated in DIN EN 45 001. Accredited testing laboratories must in fact provide evidence that they work solely in accordance with this standard. National and EU commissions, which are legislative authorities, tend therefore to specify analytical methods, e.g. in the form of regulations or appendices thereto, intended to ensure that results from different laboratories will be comparable and hence will stand up in a court of law. The analytical quality assurance system (AQS), introduced by the Baden-Württemberg Ministry for the Environment in 1984, obliges laboratories to regularly participate in collaborative studies and thereby demonstrate their ability to provide suitably accurate analyses. This alone, however, does not sufficiently demonstrate the competence of a laboratory. Only personal appraisal of the laboratory by an auditor, together with the successful analysis of a sample provided by the same and performed under his observation, can provide proof of the competence of the laboratory. From an analytical point of view, the competence of a laboratory must be regarded as the decisive factor. Competence can only be attained through analytical quality assurance, which thus must be demanded of all laboratories. Received: 4 October 1996 Accepted: 15 January 1997     

Photoinduced electron transfer of chlorophyll in lipid bilayer system

Photoinduced electron transfer from chlorophyll-a throughtheinterface of dipalmitoylphosphatidylcholine (DPPC) headgroup of the lipid bilayers was studied with electron magnetic resonance (EMR). The photoproduced radicals were identified with electron spin resonance (ESR) and radical yields of chlorophyll-a were determined by double integration ESR spectra. The formation of vesicles was identified by changes in measured λ_max values from diethyl ether solutions to vesicles solutions indirectly, and observed directly with SEM and TEM images. The efficiency of photosynthesis in model system was determined by measuring the amount of chlorophyll-a radical yields which were obtained from integration of ESRspectra.     

Quality control in extended measurement campaigns: selection of contract laboratories by proficiency testing exemplified for the trace analysis of anilines in groundwater

An interlaboratory comparison for the determination of aniline, nine methylated anilines and chlorinated anilines in contaminated groundwater (each compound between 1 µg L^?1 and 750 µg L^?1) was conducted as proficiency test for the selection of contract laboratories for a groundwater monitoring campaign. For the 13 participants, two different test sample series were prepared from a stabilized real case groundwater. Series A was the groundwater as sampled in the field and series B was prepared from series A by spiking with selected anilines. Homogeneity and stability investigations revealed that contaminated groundwater provides a viable basis for the preparation of ring test samples for the determination of anilines. Analytical procedures were limited to the standardized liquid–liquid extraction or solid-phase extraction in combination with gas chromatography/mass spectrometry (DIN 38407-16:1999). The robust consensus values were evaluated according to the standardized protocol of DIN 38402-45:2013. Robust reproducibility standard deviations ranged largely between 20?% and 60?% depending on the analyte. The proficiency assessment of individual participants combined the qualitative aspect of correct peak identification with the quantitative determination of individual concentrations within set limits in a unified approach. It could be shown that the accreditation status of laboratory and the existence of a standardized analytical procedure do not substitute a problem-related proficiency assessment of potential contractors.     

Semiautomatic flow-injection method for determination of volatile acidity in wines.

A flow-injection (FI) method based on analytical pervaporation was assessed for its routine use in the determination of volatile acidity in winery laboratories. The new method was compared with both the official method and the Mathieu method, which is most often used in Spanish wineries, by testing 30 different wines, including young and aged, and sweet and dry wines from Montilla-Moriles appellation d'origine. The robustness of the new method was established, and then all 3 methods were studied in terms of range of linearity and regression of the calibration curve, repeatability, reproducibility, sensitivity, detection and quantitation limits (LOD and LOQ, respectively), and time of analysis. The FI method surpassed the Mathieu method in reproducibility and both the Mathieu and official methods in LOD and LOQ and sensitivity; it also required less personnel involvement and shorter analysis time. The statistical criteria established by the Office International de la Vigne et du Vin were applied to the data and the results obtained indicated that the differences between the analytical parameters of the 3 methods are not significant and can be applied indistinctly. The correlation of the methods was studied by taking them 2 by 2, and the corresponding equations, coefficients, and deviations confirmed the statistical results. Thus, the new method can be used in winery laboratories with clear advantages over its 2 counterparts (the routine and official methods).     

Determination of fluoride in wine by fluoride selective ion electrode, standard addition method: collaborative study

The accuracy, precision, and reproducibility of a rapid method for determination of fluoride in wine, using a fluoride selective ion electrode, were established by a collaborative study involving 12 laboratories, 5 in Europe and 7 in the United States. The laboratories assayed 6 Youden pairs of fluoride-fortified, red and white wine samples with fluoride concentrations ranging from 0.2 to 3.0 mg/L. The relative standard deviations of repeatability ranged from 1.94 to 4.88%; relative standard deviations of reproducibility ranged from 4.15 to 18.40%. HORRAT values ranged from 0.30 to 0.97. The average recovery was 99.97%. Based on the statistical results of this collaborative study, the Study Director recommends that this method be adopted First Action.     

The results of HbA1c measurement and its comparison with reference method values in an EQA programme

This article describes the effect of a change in reference method for HbA_1c measurement on results in our EQA programme. Important indicators of analytical quality, particularly reproducibility, bias and uncertainty, were assessed. Basic analytical quality indicators for the measurement of HbA_1c in an EQA survey during 2000–2008 were evaluated. Three EQA surveys per year were performed. Usually there were more than 200 participating laboratories in each survey. Reproducibility, systematic differences, bias, and methodology changes before and after IFCC reference method implementation were determined. In the EQA surveys, target values traceable to the IFCC reference method are used. Estimation of the combined uncertainty of the result was a voluntary part of the surveys and was reported by 50% of participating laboratories. Reproducibility of all participants’ measurements was close to the target value of CV = 5.0% (coefficient of variation). The group of participants using HPLC methodology had reproducibility lower than 5.0% in each survey, whilst the immunochemistry group usually had CV values more than 6.0%. The differences in individual results from target values ranged in the interval ±12% for HPLC methods but more (−8 to +30%) for immunochemistry methods. During the monitored time interval the number of participants using HPLC methods increased up to 70% whilst the number of participants using immunochemistry methods decreased approximately to 30%. The combined uncertainty (u _c ) reported by participants varies between 4.0 and 4.5% for HbA_1c values between 30 and 90 mmol/mol. No significant differences between precision and systematic errors (bias) after the implementation of IFCC method of measurement for HbA_1c to routine processes for HPLC were observed. Immunochemical methods do not fulfil requirements for analytical reproducibility.     

Determination of Deoxynivalenol in Poultry Feed by Three Gas Chromatographic Detection Techniques

Three different gas chromatographic detection techniques were applied for the determination of deoxynivalenol (DON) present in poultry feed samples. Extraction and cleanup procedures were kept the same for GC–FID, GC–ECD and GC–MS methods. Although all three GC methods provided good and comparable results, but more attention was focused on GC–FID due to its lower cost and easy availability in many laboratories. Therefore, a short 15 m DB-1 short column was introduced for the determination of DON in poultry feed to reduce the time of analysis and initial cost of column. An inter-laboratory study for GC–FID was performed in two laboratories using four naturally DONS-contaminated feed samples and one spiked with standard. The relative standard deviations for repeatability (RSDr) and relative standard deviations for reproducibility (RSD_R) of naturally contaminated feed were in the range 5–23 and 11–24 %, respectively. The Horwitz Ratio (HORRAT) was less than 1.0 in each sample. From the spiking test, recovery, RSDr, RSD_R and value of HORRAT were 93, 5, 11 and 0.6 %, respectively. For GC–FID method, limit of quantification was found to be 6 μg kg^?1. Thus, GC–FID method using 15 m DB-1 capillary column is sensitive and validated analytical method for the determination of DON for poultry feed.     

Quality assurance in analytical measurement

 The peculiarities of analytical measurement require to check characteristics of the error (its components) of the obtained analysis results to assure the quality of the measurements. This article deals with the various quality assurance procedures and algorithms which are used to check the quality indices, i.e. the accuracy, reproducibility, certainty and repeatability of analytical measurements: These procedures include: laboratory rapid control; Intra-laboratory statistical control (statistical selection control by alternative attribute, statistical selection control by quantity method of periodic check of the analysis procedure for conformity to the specified requirements) and external control (inter-laboratory control checks, inter-laboratory comparison tests, and intra-laboratory control algorithms carried out by the appropriate supervisory body.) in the separately taken laboratory. The respective algorithms, control plans and control requirements, specified according to the different control aims and assurance tasks, enable the quality and certianty of analytical information obtained in laboratories in Russia to be assured. Received: 9 November 1998 / Accepted: 24 November 1998     

Comparison of different statistical methods for evaluation of proficiency test data

In analytical chemistry, proficiency testing usually consists in tests that laboratories conduct under routine conditions and report the result to the PT provider who then converts the result to a score which helps the participant to assess the accuracy of the result. The aim of this work is to show PT providers, accreditations bodies, and participating laboratories that different scoring results can be achieved depending on the evaluation system selected. The influence of different evaluation techniques on the results of an interlaboratory comparison for determination of gold in precious metals alloys was investigated. Results from 19 participating laboratories were evaluated by means of the three procedures: (1) classical statistical approach—outliers detection; (2) robust methods—(2A) robust procedure and (2B) ISO 13528; and (3) fitness for purpose. Evaluation of the same PT data revealed very interesting issues depending on the different scoring systems that were used and the robustness of the statistical methods used for detecting outliers. As a general rule, laboratories with scoring Z > 2 offered clearly poorer performance in robust approaches than classical ones. In order to support this first evidence, we evaluated a second data set with results from 24 laboratories (mercury from soil samples) by means of the four mentioned approaches. Selection and comparison of different scoring systems must be done very carefully, because sometimes they are not the best approach for studying the data population or the more appropriate one for evaluating the distribution of the data. Finally it should be taken into account that sometimes the robust scoring systems are not always suitable for evaluating the results of some PT schemes.     

Regulatory aspects of proficiency testing: experience from the water sector

Proficiency tests in the regulated sector have requirements different from other areas. Repeated unsuccessful participation can lead to the economic ruin of a laboratory. This is illustrated at the water analyses sector in Germany as an example. Collusion and falsification have to be avoided. A special and uniform evaluation technique is necessary that includes the possibility of a common evaluation of different concentration levels and considers the skewed distribution of data. A suitable approach is published in a new German DIN standard (DIN 38402-45). The assessment of the values and the laboratories as a whole also needs special attention. A concept to do this with as few injustices as possible was developed in an inter-state working group in Germany.

     

Intercomparison study for the determination of selected polychlorinated biphenyls (PCBs) in feed matrices

Analytical methodology currently employed for the determination of seven indicator PCBs in three compound feeds and fish meal has been evaluated in a collaborative study. The majority of the obtained relative standard deviations of the PCBs varied from 20 to 30%. On assuming a target relative standard deviation of 22% for the analytical results, statistical evaluation showed that about 80% of the participating laboratories delivered data within an acceptable range of +/- 44% of the assigned concentration in the test materials. However, between 10 and 20% of the participating laboratories reported unacceptable results. Major problems seemed to arise from insufficient separation of PCB congeners, low extraction efficiency, and calculation errors. Correct identification of the target PCB congeners was a prevalent problem if only one capillary column in combination with an electron capture detector (ECD) was employed. The correct preparation of the calibration solution by the laboratories turned out to be only a minor problem. The laboratories participating in this study employed quite different techniques at all stages of the analytical procedure. Principal component analysis indicated that laboratories using an internal standard tended to report higher values for the target analytes. If the PCB concentrations were related to the fat content of the sample, the variability of the reported results decreased for compound feed but increased for fish meal. These inconsistent results are probably due to the fact that fat is not an objective parameter but is defined by the analytical technique employed. It is assumed that harmonizing analytical methods for the determination of this parameter could improve the precision of the PCB results.