Assessment of performance of laboratories in determining acrylamide in crispbread

A proficiency testing round was undertaken to assess the performance of laboratories to measure acrylamide in a sample of crispbread. Retail samples of crispbread were ground to a fine powder and after thorough mixing were packed in 40 g units for distribution. Ten samples were selected at random and analyzed in duplicate for acrylamide by liquid chromatography/mass spectrometry (LC/MS). Standard statistical tests showed that the material was homogeneous for the purposes of proficiency testing. Test samples were distributed to 55 laboratories in 16 countries in Europe, North America, Australia, and the Middle East. The results were analyzed by standard proficiency testing statistical procedures, and laboratories were awarded z-scores on the basis of their reported results. Based on a target standard deviation (sigmap value) taken from the Horwitz equation, for a robust mean value of 1.2 mg/kg acrylamide, satisfactory results (z-score within +/- 2 for those between 0.8 and 1.6 mg/kg) were obtained by 86% of the 37 laboratories that returned results. Only 1 laboratory was unsatisfactory and 4 had questionable results. About equal numbers of laboratories used gas chromatography (GC)/MS and LC/MS procedures with about 25% using MS/MS and one using GC with electron capture detection. There was no evident trend in performance or bias in results. GC/MS and LC/MS data were evenly distributed across the population of laboratories reporting results.     

水中易释放氰化物能力验证样品的研制及应用

根据国家地表水环境质量监测网监测任务要求和环境监测的实际需要,制备了水中易释放氰化物能力验证样品。通过均匀性、稳定性检验以及量值一致性评价,研制的样品均匀性良好,在3℃~6℃冷藏避光保存条件下1年内稳定,样品配制值与多家实验室协作测定结果一致。探讨了样品在能力验证活动中的应用,共有来自全国11个省的32家实验室参加了水中易释放氰化物的能力验证计划,实验室满意率在80%以上,实验室结果出现有问题或不满意主要是由于样品前处理以及检测过程质量控制不当导致的。经检测及实验室反馈的数据验证,该能力验证样品能够应用于能力验证活动。     

Acrylamide analysis: assessment of results from six rounds of Food Analysis Performance Assessment Scheme (FAPAS) proficiency testing

Six proficiency tests have now been completed in an ongoing program of the UK Food Analysis Performance Assessment Scheme (FAPAS) for the analysis of acrylamide in a range of food matrixes. Homogeneous test material samples were requested by laboratories throughout the world, with 29 to 45 submitting results for each test. Results were analyzed by appropriate statistical procedures, and z-scores were awarded for reported values. In the absence of both legislation and collaborative trial data, the target standard deviation was derived from the Horwitz equation, although it is acknowledged that there is a need to establish a "fit for purpose" target standard deviation specifically for acrylamide analysis. Participants were encouraged to use the analytical method routinely used in their own laboratory and to provide details of their procedure. Close examination of the data submitted indicates that performance is generally acceptable in terms of accuracy. There is no significant difference between results submitted by gas chromatography and liquid chromatography (GC and LC) methods, and no method dependency on the use of internal standards or sample size. However, choice of extraction solvent may be important, with indications that plain water is an acceptable extraction method. There is evidence from the most recent test that direct (underivatized) GC methodology may present problems, but more data are required and this aspect will be monitored in the continuing proficiency testing program.     

Update on the activities of the National Cooperation for Laboratory Accreditation

 The efforts to form a laboratory accreditation cooperation in the United States and North America are described, including activities of the Laboratory Accreditation Working Group and the interim board of the National Cooperation for Laboratory Accreditation. The vision, mission, and guiding principles developed by the two groups are presented, along with the operational documents, such as bylaws, the recognition document, guidance documents and the quality manual drafted by the interim board. Received: 8 June 1998 · Accepted: 16 June 1998     

Quality issues in proficiency testing

 Proficiency testing is a means of assessing the ability of laboratories to competently perform specific tests and/or measurements. It supplements a laboratory's own internal quality control procedure by providing an additional external audit of their testing capability and provides laboratories with a sound basis for continuous improvement. It is also a means towards achieving comparability of measurement between laboratories. Participation is one of the few ways in which a laboratory can compare its performance with that of other laboratories. Good performance in proficiency testing schemes provides independent evidence and hence reassurance to the laboratory and its clients that its procedures, test methods and other laboratory operations are under control. For test results to have any credibility, they must be traceable to a standard of measurement, preferably in terms of SI units, and must be accompanied by a statement of uncertainty. Analytical chemists are coming to realise that this is just as true in their field as it is for physical measurements, and applies equally to proficiency testing results and laboratory test reports. Recent approaches toward ensuring the quality and comparability of proficiency testing schemes and the means of evaluating proficiency test results are described. These have led to the drafting of guidelines and subsequently to the development of international requirements for the competence of scheme providers. Received: 2 January 1999 · Accepted: 7 April 1999     

The establishment of quality systems in veterinary diagnostic testing laboratories in developing countries: experiences with the FAO/IAEA External Quality Assurance Programme

Quality systems, established to internationally accepted standards, are one mechanism that can assist in evaluations of the sustainability of technology transfer, the proficiency of the user, and the reliability and comparability of data generated, resulting in potential enhancement of laboratory credibility. The means of interpreting existing standards and implementing quality systems in developing country veterinary diagnostic laboratories has become a significant adjunct to the technology transfer element within the Food and Agriculture/ International Atomic Energy Agency, FAO/IAEA programme. The FAO/IAEA External Quality Assurance Programme (EQAP) is given as an example for an initial step towards enhancing the “quality” culture in developing country veterinary laboratories. In 1995 the EQAP began as an effort to assure that test results emanating from laboratories using FAO/IAEA ELISA kits for animal disease diagnosis are valid. For this purpose 15 international external quality-assurance rounds have been performed to date for a variety of animal diseases e.g. Rinderpest, brucellosis, trypanosomosis, and foot-and-mouth disease (FMD). Results indicate that the EQAP is a valuable tool in the assessment of both the results provided by, and use of the ELISA kits provided through, the joint FAO/IAEA programme. Furthermore EQAP can assist laboratory diagnosticians to enhance quality control/quality assurance (QC/QA) procedures for conducting FAO/IAEA ELISAs and to advise on the implementation of similar QC/QA procedures in other laboratory activities. Based on the experiences made during the implementation of the EQAP a proposal for establishing a quality system standard was ratified through the World Organization for Animal Health (OIE) general conference in May 2000. The OIE Standard On Management And Technical Requirements For Laboratories Conducting Tests For Infectious Animal Diseases is based on ISO 17025 and provides a clear formula for establishing quality systems in veterinary diagnostic laboratories world-wide.     

氧指数检测能力验证结果分析

为了解氧指数检测实验室的能力水平,中国合格评定国家认可委员会(CNAS)开展了"塑料燃烧性能试验(氧指数法)"能力验证计划。通过对氧指数能力验证计划的结果进行统计分析,评价了氧指数检测实验室的整体水平,指出了氧指数检测实验室普遍存在的几类问题并提出了相应的建议。     

Uncertainty evaluation in proficiency testing: state-of-the-art, challenges, and perspectives

The evaluation of measurement uncertainty, and that of uncertainty statements of participating laboratories will be a challenge to be met in the coming years. The publication of ISO 17025 has led to the situation that testing laboratories should, to a certain extent, meet the same requirements regarding measurement uncertainty and traceability. As a consequence, proficiency test organizers should deal with the issues measurement uncertainty and traceability as well. Two common statistical models used in proficiency testing are revisited to explore the options to include the evaluation of the measurement uncertainty of the PTRV (proficiency test reference value). Furthermore, the use of this PTRV and its uncertainty estimate for assessing the uncertainty statements of the participants for the two models will be discussed. It is concluded that in analogy to Key Comparisons it is feasible to implement proficiency tests in such a way, that the new requirements can be met. Received: 29 September 2000 Accepted: 3 December 2000     

Draft radioanalytical water and soil performance testing: Uncertainty acceptance criteria derived from historical mixed-analyte performance evaluation program results

Radioanalytical performance testing programs provide radioassay laboratories, regulators and the public performance-based evidence that measurement capabilities are in control. Performance acceptance criteria that combine aspects of measurements difference from a known value and the associated combined uncertainty establishes a quantitative statement of statistical confidence. However, there is need for a reasonable upper limit of the reported measurement uncertainty. Evaluation of thousands of historical U.S. DOE Mixed-Analyte Performance Evaluation Program measurement results for 17 radionuclides in soil and water samples provides predictive expectations for future measurement results and a statistical basis for establishing reasonable upper limits for reported measurement uncertainties for performance evaluation programs.     

Quality assurance in analytical measurement

 The peculiarities of analytical measurement require to check characteristics of the error (its components) of the obtained analysis results to assure the quality of the measurements. This article deals with the various quality assurance procedures and algorithms which are used to check the quality indices, i.e. the accuracy, reproducibility, certainty and repeatability of analytical measurements: These procedures include: laboratory rapid control; Intra-laboratory statistical control (statistical selection control by alternative attribute, statistical selection control by quantity method of periodic check of the analysis procedure for conformity to the specified requirements) and external control (inter-laboratory control checks, inter-laboratory comparison tests, and intra-laboratory control algorithms carried out by the appropriate supervisory body.) in the separately taken laboratory. The respective algorithms, control plans and control requirements, specified according to the different control aims and assurance tasks, enable the quality and certianty of analytical information obtained in laboratories in Russia to be assured. Received: 9 November 1998 / Accepted: 24 November 1998     

First proficiency test for the determination of NORM in contaminated soil from the oil field

The Atomic Energy Commission of Syria (AECS), in cooperation with the Arabic Atomic Energy Agency (AAEA), has initiated the first proficiency test exercise for the determination of naturally occurring radioactive materials (NORM) in contaminated soil from the oil field. The soil sample was collected from one of the most highly radioactively contaminated lagoons with production water in the Syrian oil fields, which was then prepared, characterised and certified according to a standard procedure. Samples were dispatched to laboratories from eight Arab countries; Kuwait, Egypt, Yemen, Tunisia, Jordan, the Kingdom of Saudi Arabia, Libya and Syria. The results were evaluated using three statistical criteria; z-score, the U _test score and the relative bias. These statistical methods were used to evaluate the performance of each laboratory, in addition to the overall evaluation for each radionuclide. This evaluation has indicated that 57% and 86% of the results passed the criteria set for precision and accuracy applied for this test in relation to ²²⁶Ra and ²²⁸Ra, respectively. These two radionuclides are considered to be the most important radionuclides in the oil industry.     

New certified reference materials and proficiency test for environmental radioactivity measurements

A reliable determination of natural and anthropogenic radionuclides in environmental samples is necessary to comply with the radiation protection and environmental regulations. This paper presents the results of the characterisation of massic activities of natural and anthropogenic radionuclides in soil and water matrices produced as test items to conduct the proficiency test ERAD-PT-2013. The proficiency test ERAD-PT-2013 was designed to investigate analytical performance in analysing both natural and anthropogenic radionuclides, to assist laboratories to identify analytical problems, and to improve the quality of measurement results. The proficiency test items, their spectral interferences and the activity concentration levels of the analytes were designed in a way to enable identification of potential analytical problems. Methodologies, data evaluation approach and evaluation of proficiency test results for each radionuclide are described and discussed.     

Evaluation of food emergency response laboratories’ capability for <Superscript>210</Superscript>Po analysis using proficiency test material with verifiable traceability

Measurement capability and data comparability are essential for emergency response when analytical data from cooperative laboratories are used for risk assessment and post incident decision making. In this study, the current capability of food emergency response laboratories for the analysis of ²¹⁰Po in water was evaluated using a proficiency test scheme in compliance with ISO-43 and ILAC G13 guidelines, which comprises a test sample preparation and verification protocol and an insightful statistical data evaluation. The results of performance evaluations on relative bias, value trueness, precision, false positive detection, minimum detection limit, and limit of quantification, are presented.     

Bias analysis of proficiency testing programme results

A proficiency testing programme might involve a great number of participating laboratories coming from different countries or regions, and normally they analysed the same test materials using their own routine analytical methods. Hence, the results of a proficiency testing programme may contain valuable information which could serve purposes other than just performance evaluation. This study attempted to extract information from the results of a proficiency testing programme for the purposes of educating the participating laboratories as suggested by ISO/IEC 17043. The “bias analysis” approach introduced in this study was based on the statistical model of measurement and the nature of bias in chemical analysis. With this approach, the participating laboratories could estimate the bias associated with different settings of experimental conditions according to the statistics of subset distribution of the reported results from the participating laboratories. This would be useful for them to review the analytical procedures they used and modify their methods if needed. The approach was applied to the analysis of data obtained from a number of past proficiency testing programmes, and the findings were discussed in this paper.     

Proficiency testing in food microbiology “Aqua”: enumeration of Staphylococcus aureus

In 1999 the Food Microbiology laboratory of the Istituto Zooprofilattico Sperimentale delle Venezie (IZSVe) started an interlaboratory comparison program for food microbiological tests, known as “Aqua, interlaboratory comparisons for quality assurance”. Aqua produces the test samples, applies statistical methods to estimate homogeneity and stability, processes and evaluates the results. The proficiency testing results allow to evaluate the performance of the laboratories, to identify possible differences and non-conformity, to demonstrate the competence and the quality of results, in order to take suitable corrective and/or preventive action after the individuation of the causes. Moreover, elaborating the results of several proficiency testing by using the control chart method, it is possible to evaluate the trend of the laboratory and to verify that the results are in statistical quality control.     

Regular participation in proficiency testing provides long term improvements in laboratory performance: an assessment of data over time

Data from various proficiency testing schemes, operated by LGC Standards, was collated and reviewed to determine whether regular involvement within third party, proficiency testing, either over a prolonged period of time or via multiple participation, had improved the performance of those laboratories taking part. Three statistical evaluations were applied to historical PT results, a review of improvements over time, demonstrated by the evaluation of satisfactory performance scores achieved, a review of the relative robust standard deviations obtained from multiple methods and a focused review of one analyst participating in proficiency testing over a prolonged period of time. In each case the data indicated that long term participation and evaluation via proficiency testing had resulted in consistent and sustained improvements in laboratory performance.     

稳健统计技术及其在实验室能力验证数据处理中的应用

介绍了传统统计方法存在的问题及稳健统计技术的发展历史、稳健统计技术的属性、基本假设模型、稳健统计量及在实验室能力验证数据处理中的具体应用,提出了实验室能力验证的评价标准。     

用经验模型评估环境样品测量不确定度

利用水样、土壤和沉积物标准样品定值数据,建立了评估环境样品测量结果不确定度的经验模型。讨论了判断模型质量的指标。用建立的经验模型估算了实际标样和能力验证数据不确定度,并与实测结果进行了比较。探讨了利用本模型计算的相对标准偏差允许限用于实验室内部质量管理与控制的可行性。经验模型能帮助客户判断送检样品检测结果在临界值时能否满足相关要求。     

Note on the bimodal distribution of PT results

The practitioner’s report "Treatment of bimodality in proficiency test of pH in bioethanol matrix" by Sarmanho et al. deals with a proficiency test (PT) for the measurement of pH in bioethanol. One group of 19 participating laboratories used an electrode that contained saturated LiCl and the other one KCl. The results of the LiCl group are biased, and those of the KCl group are unbiased as compared with the assigned reference value \(y_\mathrm{{RM}}\), and hence, the distribution of the laboratory means is bimodal. In order to deal with this situation, Sarmanho et al. present and carry out two different methods of fitting the bimodal distribution of the laboratory means: a fit by a mixture of two normal distributions and a Gaussian kernel estimation. Since this rather advanced statistical analysis does not help to solve the practical problem, some recomendations of ISO 17043 are discussed that might be useful for the coordinator of the PT and as well for the participating laboratories.