EPTIS update

An update on EPTIS, the European Proficiency Testing Information System is given. Two developments are discussed: the extension of EPTIS towards a world-wide database and the provision of additional, topical information on forthcoming PT rounds, workshops, training courses or surplus PT samples.     

Harmonisation of proficiency testing schemes

The harmonisation of proficiency testing (PT) schemes has been under debate for a long time. There are obvious reasons why harmonisation of the practices in PT would be beneficial. In many areas, there is still a belief that further harmonisation of practices in PT would improve the comparability of measurement data. In particular when two laboratories are to be compared that have not participated in a single PT, problems arise which allegedly can be overcome by further harmonisation of PT schemes. In practice, however, parties involved in PT are not always embracing the idea of harmonisation. With the results of two European projects in mind, a discussion is given on harmonisation aspects, and some considerations are given that may help to decide in practice whether harmonisation is likely to solve particular problems. The first project, the European Proficiency Testing Network (EPTN), is concerned with further harmonisation. The second European project (COEPT) aims at providing a basis to assess equivalence across proficiency tests, and explores the conditions under which such an assessment is feasible.     

Harmonisation of proficiency testing schemes

The harmonisation of proficiency testing (PT) schemes has been under debate for a long time. There are obvious reasons why harmonisation of the practices in PT would be beneficial. In many areas, there is still a belief that further harmonisation of practices in PT would improve the comparability of measurement data. In particular when two laboratories are to be compared that have not participated in a single PT, problems arise which allegedly can be overcome by further harmonisation of PT schemes. In practice, however, parties involved in PT are not always embracing the idea of harmonisation. With the results of two European projects in mind, a discussion is given on harmonisation aspects, and some considerations are given that may help to decide in practice whether harmonisation is likely to solve particular problems. The first project, the European Proficiency Testing Network (EPTN), is concerned with further harmonisation. The second European project (COEPT) aims at providing a basis to assess equivalence across proficiency tests, and explores the conditions under which such an assessment is feasible.

     

Blood lead proficiency testing: overview of the federally sponsored program in the U.S.

External proficiency testing is a proven method for improving the quality of laboratory measurements, including lead in blood. Several proficiency testing programs exist to fill this need. This article describes the U.S. federally sponsored Blood Lead Proficiency Testing Program. Three specimens, composed of blood from dosed cows, are distributed to participants each month. Target values are determined by a group of 10 referee laboratories. Participant performance has shown steady improvement over time.     

Harmonization and transferability of performance assessment: experience from four serum aluminum proficiency testing schemes

Proficiency testing schemes monitor laboratory performance and provide a stimulus for improvement in accuracy. Where several schemes operate in the same analytical sector, there are risks that assessments of performance may be in conflict. Performance assessment for the determination of trace elements such as aluminum in serum is particularly important due to the high risk of contamination and therefore erroneous results. The objectives of this work were (1) to compare several mathematical models to establish a predefined standard deviation for proficiency assessment and (2) to evaluate the influence of instrumental methods and proficiency testing scheme on the assessment of performance for serum aluminum measurements. For this purpose, three samples were sent to the participants of four proficiency testing schemes. Assigned values were calculated according to algorithm A according to ISO 13528 and standard deviation for proficiency assessment according to three methods based on individual variability, state of the art or previous proficiency testing results. The method based on individual variability produced a more stringent standard deviation compared to analytical imprecision based on the state of the art. The instrumental methods gave similar results, whereas significant differences were observed between the four proficiency testing schemes indicating that harmonization of the standard deviation for proficiency assessment fails to allow transferability from one proficiency testing scheme to another and that additional factor(s) contribute to variability in performance assessment.     

Cyclosporin Measurement – who cares about inaccuracy?

Most medical laboratories measure the immunosuppressive drug cyclosporin using one of a number of commercial immunoassays, or high-performance liquid chromatography (HPLC). The calibration of these assays is based on material supplied by the kit manufacturers or prepared in-house. We have examined inaccuracy for the measurement of cyclosporin in samples spiked to known concentrations and the impact of any inaccuracy on the results for cyclosporin measurement in pooled samples from patients prescribed the drug. The data were from the International Cyclosporin Proficiency Testing Scheme, based on aliquots of cyclosporin-free blood to which known amounts of the drug had been added or aliquots of pooled samples collected from patients receiving cyclosporin. Compared with the results using HPLC, the immunoassays had a median bias which ranged from –4.5% to 8.2% for the spiked samples. When pooled samples from patients were analysed the percentage difference from the measured HPLC value, allowing for assay inaccuracy, was as high as 29.9%. It is concluded that inaccuracy is a factor in between-assay performance for this measurement and that proficiency testing schemes should attempt to put more emphasis on this aspect of assay performance.     

Comparison of evaluation procedures used by European external quality assessment scheme organizers for haemoglobin concentration and leukocyte concentration

This study aimed to assess currently used evaluation procedures for haemoglobin concentration and leukocyte concentration in European external quality assessment schemes (EQAS). Participating EQAS organizers were asked to complete a questionnaire gathering information on the statistical procedures used to assess the performance of participants, and to analyse an Excel file with 262 results for haemoglobin concentration and leukocyte concentration. Responses were received from the New York State Proficiency Testing programme in the US and from 11 European EQAS: Belgium, Croatia, Finland, France, Germany, Hungary, Russia, Slovenia, Spain (two organizers), and Switzerland. Five of the 11 European EQAS use fixed limits based upon experience, biological variation, state of the art, or professional consensus. The other EQAS use variable limits based upon statistical analysis of the performance attained. With the exception of the German, Hungarian, and Slovenian schemes, all European EQAS use consensus target values. The percentage of unsatisfactory results obtained by the European EQAS organizers for the given set of data varied between 0.4 and 15.6% for haemoglobin concentration and between 0 and 19.8% for leukocyte concentration.     

Quality issues in proficiency testing

 Proficiency testing is a means of assessing the ability of laboratories to competently perform specific tests and/or measurements. It supplements a laboratory's own internal quality control procedure by providing an additional external audit of their testing capability and provides laboratories with a sound basis for continuous improvement. It is also a means towards achieving comparability of measurement between laboratories. Participation is one of the few ways in which a laboratory can compare its performance with that of other laboratories. Good performance in proficiency testing schemes provides independent evidence and hence reassurance to the laboratory and its clients that its procedures, test methods and other laboratory operations are under control. For test results to have any credibility, they must be traceable to a standard of measurement, preferably in terms of SI units, and must be accompanied by a statement of uncertainty. Analytical chemists are coming to realise that this is just as true in their field as it is for physical measurements, and applies equally to proficiency testing results and laboratory test reports. Recent approaches toward ensuring the quality and comparability of proficiency testing schemes and the means of evaluating proficiency test results are described. These have led to the drafting of guidelines and subsequently to the development of international requirements for the competence of scheme providers. Received: 2 January 1999 · Accepted: 7 April 1999     

The challenges and benefits of implementing the requirements of ISO/IEC 17043 by PT/EQA providers

ISO/IEC 17043 Conformity assessment??general requirements for proficiency testing is intended to replace previous international guides used to assess the competence of proficiency testing (PT) providers. It expands on the requirements of previous guides and is intended to accommodate PT providers of calibration laboratories and testing laboratories handling both qualitative and quantitative data. QMP-LS is an office-based external quality assessment provider for medical laboratories in Ontario, Canada and operates 46 different PT schemes for approximately 250 diagnostic tests. In 2010, these schemes were accredited to ISO/IEC 17043. Schemes included tests from the following disciplines: chemistry, hematology, microbiology, transfusion medicine, cytology, histology and genetics. Thirty of the schemes were qualitative. The challenges and benefits of implementing ISO/IEC 17043 are discussed, with particular emphasis on clauses addressing the following requirements: statistical design, determination of assigned value, homogeneity and stability testing, packaging, labeling and distribution, performance evaluation and subcontracting services.     

纺织品中4-氨基偶氮苯的测定能力验证分析

“P00012-2011-T07纺织品中禁用偶氮染料的测定(测试项目:4-氨基偶氮苯)”能力验证严格按照能力验证计划运作要求实施,并采用稳健统计法对测试结果进行统计,测试样品指定值为54.8 mg/kg,标准化四分位距(NIQR)为6.8941 mg/kg.共有12个省市、自治区的61家实验室参加本次能力验证,采用Z比分数对各实验室结果进行评价,结果满意率为86.9％.     

Results of two European interlaboratory studies for the determination of beta-agonists in various matrices.

Two Beta-Agonist Interlaboratory Studies, 5/96 and 11/97, were designed and evaluated according to the International Harmonised Protocol for the Proficiency Testing of (Chemical) Analytical Laboratories (ISO/REMCO N 280) jointly elaborated by ISO, IUPAC and AOAC. In the sense of proficiency testing, interlaboratory studies are part of external quality assurance systems. The Beta-Agonist Interlaboratory Studies 5/96 and 11/97 were intended to offer laboratories in the EU Member States an opportunity to check objectively their routine methods for the detection of beta-agonists and to demonstrate the reliability of their analytical results; 48 and 44 laboratories, respectively, all involved in official residue control, participated in the studies. Irrespective of the large number of satisfactory results achieved at higher concentration levels according to the z-score evaluation, the number of false negative results is still unsatisfactory. The results of both Beta-Agonist Interlaboratory Studies confirmed that comparability of analytical results is not yet ensured within the European residue control system.     

Interlinkages and recognition of proficiency-testing schemes

 Because proficiency testing (PT) is increasingly used for the accreditation of testing laboratories and as a tool for backing up existing multilateral recognition arrangements between accreditation bodies, the question of performance and comparability of the proficiency-test providers arises. In this paper different approaches to assess the equivalence of European PT schemes and the competence of their providers are presented. As a first step a workshop is proposed to agree on a pilot study. The final aim is to create confidence in the existing PT schemes in Europe and to use them as common European tools.     

实验室能力验证的发展

实验室能力验证对于判定实验室的检测能力非常重要。回顾了国际实验室能力验证的起源和发展,重点分析了我国能力验证的发展历程和成就,探讨了我国实验室能力验证中存在的问题和有争议的技术要点。     

Regional cooperation in proficiency testing: strategy planning and practical experiences in Western Balkan countries

The article describes the project of regional cooperation in proficiency testing within CARDS 2006 (assistance programme to the Western Balkans), which was coordinated by European Committee for Standardization, European Commission and European Free Trade Association and conducted by the University of Ljubljana, Faculty of Electrical Engineering, Laboratory of Metrology and Quality. The later is the holder of the national standard for thermodynamic temperature as well as an accredited proficiency testing provider and also accredited as a calibration, testing and inspection laboratory. It is also responsible for graduate study programme Quality Engineering. Proficiency testing was considered as a core activity of the entire project, but additionally as a very appropriate platform for knowledge transfer of EU technical legislation in selected sectors, metrology, testing and quality assurance in general. The project had a high added value for participating laboratories in countries of Western Balkans, because it required an active role of all participating laboratories, assured participation of staff from national metrology institutions, all national accreditation bodies, and was supported by national quality infrastructures, such as standardization, governmental institutions etc. in the entire Western Balkans region. The activities stimulated progress in the area of conformity assessment, added knowledge to the implementation of technical directives and development of the technical part of national legislation and therefore facilitated the process toward the accession to the European Union. The main objective was therefore to organize proficiency testing in those sectors (construction, consumer protection and environment) that were vital in the pre-accession process of countries seeking full implementation of EU technical legislation.     

Integration of metrological principles and performance evaluation in a proficiency testing scheme in support of the Council Directive 98/83/EC

Proficiency testing as a means of external quality assessment plays the role of independent evidence of laboratories’ performance. To enable laboratories to fulfil the requirements stated in legislation, methodology for evaluation of laboratories’ performance in proficiency testing schemes should incorporate principles of measurement results which are fit for intended use and incorporate evaluation of laboratories’ performances based on independent reference value. A proficiency testing scheme was designed to support Drinking Water Directive (98/83/EC) specifically. The methodology for performance evaluation, which takes into account a “fitness for purpose”-based standard deviation for proficiency assessment, is proposed and discussed in terms of requirements of the Drinking Water Directive. A ζ′-score, modified by application of target uncertainty was developed in a way that fulfils requirements defined in the legislation. As an illustration, results are reported for nitrate concentration in water. The approach presented can also be applied to other fields of measurements.     

Criteria to define the standard deviation for proficiency assessment for the determination of essential trace elements in serum: comparison of Z-scores based on the Horwitz function or on biological variability

A critical issue in the organisation of Proficiency Testing/External Quality Assessment Schemes is the definition of the criteria against which the performance of individual laboratories should be evaluated. Organisers of EQAS in Occupational and Environmental Laboratory Medicine (http://www.occupational-environmental-laboratory.com) collaborate to define common acceptable levels of performance. The aim of this study was to compare the Horwitz function to the Fraser’s approach. Sets of results obtained from the distribution of test materials in the Network schemes (for the measurands: copper, selenium or zinc in serum) were used to calculate Z-scores according to both approaches. Quality specifications derived from both approaches were also compared to the standard deviations obtained. Except for selenium, Horwitz criteria suggests a more stringent evaluation than Fraser criteria, the latter being very stringent as regard the participant analytical variability.     

Proficiency testing programmes as a tool in food quality assurance: Overview of Italian experiences

Proficiency testing involves the performance of test procedures on routine samples by a number of laboratories. Interlaboratory proficiency testings provide multiple benefits to participants since they play a key-role in the total quality control of laboratory activities. They serve as a means of self-improving, as a mechanism of continuing education and as a source of information for accreditation agencies. This review highlights basic principles, benefits, criteria and capabilities of a proficiency testing programme for food analysis laboratories as well as their role in the implementation of rapidly developing food control legislation.     

Accreditation of PT providers – is it worth the money?

This topic is being presented from two perspectives, namely the views of an accreditation body and those of an accredited provider of external quality assessment schemes. The first perspective, from an accreditation body, is based on the experience of Australia's national laboratory accreditation body (NATA), which has accredited fourteen proficiency testing (PT) providers and is currently processing an application from another. The second perspective is based on the experience of EQUALIS, the national quality assurance organisation for laboratory medicine in Sweden, which was granted accreditation in 2002.Presented at 5^th Eurachem Workshop on Proficiency testing in analytical chemistry, microbiology and laboratory medicine, Portorož (Slovenia) 25–27 Sept 2005     

Accreditation of proficiency-testing schemes in The Netherlands

Proficiency testing by laboratories, national accreditation bodies, and other third parties is becoming more and more considered as a standard and integral part of the quality control system. Therefore, it is of utmost importance that the quality of the provided proficiency-testing (PT) service is outstanding. If PT-schemes are set up in order to help laboratories monitor and improve their quality, PT-schemes need not only be of high quality themselves, but the organizer also needs to be able to demonstrate this. In The Netherlands formal accreditation of the organization of proficiency testing schemes is used as a tool to guarantee high quality schemes and also to enable organizers to demonstrate their competence. Since 1996, the Dutch Council for Accreditation (RvA) has used the ISO-Guide 43–1 to assess PT-organizers in The Netherlands. From January 2000, the ISO-guide 43–1 was replaced by the ILAC G13 document for assessing organizers. Up till now, four institutes have been accredited by the RvA for the organization of PT-schemes.     

Proficiency testing in occupational and environmental health – Current practice and international initiatives for harmonisation

An increasing number of proficiency testing schemes (PT schemes) related to occupational and environmental health have been organised. Most schemes emphasise the importance of the validation of analytical results. With regards to harmonisation of the schemes, there are many differences between the schemes at many levels. These include factors concerning their relationship with legislation, national status, type and quality of proficiency testing material, analytical range and priorities for future development. Since differences between PT schemes have been recognised at the European level by organisers of PT schemes and external quality assessment schemes (EQASs) it seems appropriate to reinforce collaboration between scheme organisers in order to improve the quality of analytical performance in occupational and environmental health.