Information system and qualifying criteria for proficiency testing schemes

Since October 1998 the European Commission has financed a concerted action on Information System and Qualifying Criteria for Proficiency Testing Schemes within the 4th framework program. As a major result of this project EPTIS, the European Information System on Proficiency Testing Schemes which is available on the Internet since March 2000, is presented in this paper. Today EPTIS contains comprehensive information on approximately 640 proficiency testing schemes from 16 European countries providing information on the state of the art in proficiency testing in Europe. Finally some possible approaches for interlinkages and recognition of proficiency testing schemes are discussed.     

Environmental analysis in the Czech Republic: organisation of proficiency testing and its use in laboratory assessment

The history, origin, and development of a system for monitoring and assessing water and other environmental laboratories in the Czech Republic is described. The system started in 1991 and has matured to its present complexity with similarities to the accreditation systems found in other countries. Differences from internationally recognized procedures are being corrected step by step. During the first year of its existence ASLAB, as part of its brief, organised proficiency testing (PT) programs for fifty laboratories. Today the total number of regularly participating laboratories exceeds 700 from the Czech Republic, the Slovak Republic, and Germany. This paper describes the ASLAB PT system, discusses some experiences with its use, and describes the use of PT results in assessment of the competence of laboratories. Received: 12 October 2000 Accepted: 7 January 2001     

Benefits arising from proficiency testing schemes: The comparison of analytical methods

 The primary objective of proficiency testing (PT) is in the provision of information and support to participating laboratories, to enable them to monitor and improve the quality of their measurements. However, other benefits can be obtained from PT. These include the comparison of data for a given measurement by different methods, the validation of new methods, and the provision of information for laboratories' customers and accreditation bodies. This paper considers the subject of method comparison, and highlights some of the approaches which can be followed, as well as the practical use to which this can be put, to benefit the analytical community more widely. This is illustrated by a case study concerning the measurement of haze in beer. In this study the United Kingdom Institute of Brewing (IoB) conducted a survey of participants in the Brewing Analytes Proficiency Scheme (BAPS). From the survey data taken together with data from the BAPS scheme, the IoB is now in a position to give guidance on the use of particular instruments and procedures, as well as consider changes to the scope of the BAPS scheme to provide greater benefits for participants concerned with measuring haze. Received: 3 March 1998 · Accepted: 9 June 1998     

Statistical treatment of proficiency testing data

 There are three stages to evaluating a laboratory's results in an interlaboratory proficiency test: establishing the correct result for the test item, determining an evaluation statistic for the particular result, and establishing an acceptable range. There are a wide variety of procedures for accomplishing these three stages and a correspondingly wide variety of statistical techniques in use. Currently in North America the largest number of laboratory proficiency test programs are in the clinical laboratory field, followed by programs for environmental laboratories that test drinking water and waste water. Proficiency testing in both of these fields is under the jurisdiction of the federal government and other regulatory and accreditation agencies. Many of the statistical procedures are specified in the regulations, to assure comparability of different programs and a fair evaluation of performance. In this article statistical procedures recommended in International Organization for Standardization Guide 43, Part 1, are discussed and compared with current practices in North America. Received: 22 April 1998 · Accepted: 12 May 1998     

Requirements vs acceptability in proficiency testing schemes and other interlaboratory comparisons

Many laboratories take part in proficiency testing schemes, external quality assessment programmes and other interlaboratory comparisons. These have many similarities but also important differences in their modus operandi and evaluation of performance of participating laboratories. This paper attempts to highlight both the similarities and differences. It also puts particular emphasis on requirements called ”target values for uncertainty” and their meaning. Received: 24 January 2001 Accepted: 25 January 2001     

Quality assurance in the view of a commercial analytical laboratory

 The necessity for analytical quality assurance is primarily a feature of the analytical process itself. With the full establishment of the EU domestic market, it is also becoming a legal necessity for an increasing number of analytical laboratories. The requirements which laboratories will need to fulfil are stipulated in DIN EN 45 001. Accredited testing laboratories must in fact provide evidence that they work solely in accordance with this standard. National and EU commissions, which are legislative authorities, tend therefore to specify analytical methods, e.g. in the form of regulations or appendices thereto, intended to ensure that results from different laboratories will be comparable and hence will stand up in a court of law. The analytical quality assurance system (AQS), introduced by the Baden-Württemberg Ministry for the Environment in 1984, obliges laboratories to regularly participate in collaborative studies and thereby demonstrate their ability to provide suitably accurate analyses. This alone, however, does not sufficiently demonstrate the competence of a laboratory. Only personal appraisal of the laboratory by an auditor, together with the successful analysis of a sample provided by the same and performed under his observation, can provide proof of the competence of the laboratory. From an analytical point of view, the competence of a laboratory must be regarded as the decisive factor. Competence can only be attained through analytical quality assurance, which thus must be demanded of all laboratories. Received: 4 October 1996 Accepted: 15 January 1997     

Quality issues in proficiency testing

 Proficiency testing is a means of assessing the ability of laboratories to competently perform specific tests and/or measurements. It supplements a laboratory's own internal quality control procedure by providing an additional external audit of their testing capability and provides laboratories with a sound basis for continuous improvement. It is also a means towards achieving comparability of measurement between laboratories. Participation is one of the few ways in which a laboratory can compare its performance with that of other laboratories. Good performance in proficiency testing schemes provides independent evidence and hence reassurance to the laboratory and its clients that its procedures, test methods and other laboratory operations are under control. For test results to have any credibility, they must be traceable to a standard of measurement, preferably in terms of SI units, and must be accompanied by a statement of uncertainty. Analytical chemists are coming to realise that this is just as true in their field as it is for physical measurements, and applies equally to proficiency testing results and laboratory test reports. Recent approaches toward ensuring the quality and comparability of proficiency testing schemes and the means of evaluating proficiency test results are described. These have led to the drafting of guidelines and subsequently to the development of international requirements for the competence of scheme providers. Received: 2 January 1999 · Accepted: 7 April 1999     

Practical uses of proficiency testing as valuable tools for validation and performance assessment in environmental analysis

Besides their role as an external quality control tool, PT results or samples could be used as an alternative to fulfil some of the quality assurance requirements such as analytical precision, uncertainty assessment, and internal quality control. This additional use of proficiency testing could help laboratories to reduce the financial impact of their quality assurance process. The purpose of this paper is to highlight some practical uses of PT results or samples in the environmental analytical field, which have been implemented at ISSeP (Institut Scientifique de Service Public), either for method validation or for internal quality control.Presented at the Eurachem PT Workshop September 2005, Portorož, Slovenia     

The practice of proficiency testing in China

This paper briefly summarises the current situation for proficiency testing (PT) in China, outlines the policy for PT of China’s national accreditation committee for laboratories (CNACL), and exemplifies activities of the CNACL’s metal working group. Received: 9 December 2000 Accepted: 14 December 2000     

Accreditation for United States environmental laboratories

 There is currently no national program for recognition of United States environmental laboratories. This situation should change sometime in 1998 as environmental testing laboratories should be able to apply for accreditation in the United States via a system developed by the National Environmental Laboratory Accreditation Conference (NELAC). NELAC is an organization whose purpose is to establish performance standards for accrediting environmental laboratories. Laboratories to be accredited will be required to demonstrate qualifications of testing personnel, pass on-site inspections, perform satisfactorily on proficiency test samples, and meet specified quality assurance standards.     

Experience with in-house PT-schemes in the chemical industry

There are many different means of demonstrating the quality of performance of an analytical laboratory. Proficiency testing (PT) is just one! As in other analytical fields, interlaboratory comparisons play an important role in the chemical industry. Collaborative trials or method performance studies do have a long tradition in this field. Sometimes they were designed as laboratory performance studies with the clear aim of making analytical results comparable, e.g. petrol, coal, gas, noble metals analyses – not to mention the biggest PT scheme run on a daily world-wide basis – trade itself. All this is an ongoing process, which started long before the idea of assessing and accrediting the performance of analytical laboratories was born. However, when striving for accreditation in 1996, the analytical production laboratories of the Chemicals Business Unit of the Bayer AG in Germany implemented another facet of PT schemes. In-house-PT schemes are performed regularly and turned out to be useful in evaluating, monitoring, and thus improving, the quality of routine analytical work. Received: 5 December 2000 Accepted: 15 January 2001     

Do we need to accredit proficiency testing schemes?

 Proficiency testing (PT) is being increasingly used as an important quality assurance tool for laboratories. The subject of quality of the providers of PT schemes has been discussed increasingly in recent years. Some countries have implemented systems for the accreditation of PT schemes. This paper looks at the background to the accreditation of PT schemes, the likely mechanisms which could be employed for accreditation, and some of the practical aspects.     

The Russian system for accreditation of analytical laboratories (centers)

 The history and the present state of the national system for accreditation of analytical laboratories in Russia are described. Received: 1 September 1998 / Accepted: 1 September 1998     

How valid are our QA assumptions: an examination of underpinning Axioms

 There is no universally accepted approach to analytical quality assurance (QA) and different laboratories place emphasis on widely different aspects. The difficulties in agreeing what constitutes best practice originate, in part, from a lack of clarity concerning the underpinning principles or axioms. This paper aims to set out some of the axioms which underpin current thinking and to discuss their validity and interplay, in order to provide a more rational, or at least transparent basis, for the evaluation of different strategies. The selection of issues and the discussion are necessarily subjective and based on the authors experience. It is concluded that current practice is generally soundly based but there is a need for a better understanding of the efficacy and cost-benefit of the various QA techniques available. Scepticism concerning the value of systems and documentation is not well founded, provided they are not taken to excess. There are, however, issues concerning the military-based command-and-control style and the engineering origins of ISO 9000 and ISO Guide 25 requirements which make them not entirely suitable for a modern analytical laboratory. There are also dangers that the command-and-control style could discourage measurement scientists from thinking for themselves or lull them into a false sense of security. Received: 24 December 1998 · Accepted: 18 May 1999     

The rational use of proficiency tests and intercomparisons

 Interlaboratory comparisons (in the following abbreviated as intercomparisons) regarding tests, analyses or measurements are among the most worthwhile measures a laboratory can take in order to confirm that its services to clients include the provision of correct results within a stated uncertainty. They give a picture of the whole performance of the laboratory, and they should be used much more than at present. Unfortunately such intercomparisons are, and are made, expensive and prestigious by the formalisms employed in many cases. The connection between intercomparisons and proficiency tests and their use for different purposes is briefly discussed. Some suggestions are made on how to improve the present state of the art, i.e. how to increase the use of intercomparisons, how to perform them efficiently and how to make optimal use of the results. Received: 6 December 1997 · Accepted: 30 January 1998     

Quality in clinical laboratory measurements

 Clinical chemistry deals with measurements and observations using samples from patients in order to supply clinicians with information to support their decisions in diagnosis and treatment. The discipline utilizes advanced chemical and biochemical methods and also sophisticated instrumentation which allows a high throughput. Clinical chemistry has a long tradition of quality assessment and improvement. The major tools have been proficiency testing or external quality assessment and internal quality control. Nowadays, total quality management has become widely recognized, and accreditation according to international, regional or national schemes has contributed to the design of quality systems and improvement of the reliability of results from clinical laboratories.     

Why do food analysts need quality assurance?

 Most sophisticated products require testing for compliance with specifications and safety regulations before release into many markets, and trade in many simpler commodities and products also requires supporting technical information. Test documentation has become an essential element in this trade. Food intended for human consumption certainly falls into the "sophisticated products" category. Lack of acceptance of laboratory test data across national borders may be a significant barrier to trade. In order to avoid such barriers and unnecessary duplication of laboratory tests, mutual recognition of laboratory results should be regarded as an important means of facilitating international trade in food products. It is difficult to envisage recognition of test data across borders without internationally agreed criteria for assessing the competence of testing. These criteria should, as a minimum, require that a laboratory involved in the analysis of foods operates a suitable quality system. The laboratory must create a quality system appropriate to the type, range and volume of work performed. It is necessary for the elements of this system to be documented in a quality manual which is available for use by the laboratory personnel. The quality manual must be kept up-to-date by a person or persons having responsibility for quality assurance within the laboratory. This paper describes and discusses the elements of a quality system in a food laboratory, including suitable quality assurance measures, the use of validated analytical methods and participation in proficiency testing schemes. Received: 24 February 1996 Accepted: 13 March 1996     

Economy of proficiency testing: reference versus consensus values

Many proficiency tests are operated with a consensus value derived from the participants’ results. Apart from technical issues, one of the reasons often mentioned is that proficiency tests operated with consensus values would be cheaper than those using reference values obtained from a priori characterisation measurements. The economy of a proficiency test must of course be balanced by the need of the participants, and the quality of the comparison in general. The proficiency tests selected in this study had both a reference value and a consensus value, one of which was used for assessing the performance of the participating laboratories. In this work, both a technical and an economical assessment of how the comparisons were operated is made. From the evaluation, it follows that usually the use of consensus values does not necessarily reduce the costs of a proficiency test. However, frequently it may be observed that the quality of the assessment of the laboratories is better with a reference value. Received: 11 October 2000 Accepted: 3 January 2001     

Advances for proficiency testing for genetic laboratory science

Nucleic acid based clinical genetic testing has undergone explosive growth in recent years due in large part to the human genome project. Characterization of the human genome has led to a molecular understanding of the pathogenesis of many human diseases, and ultimately to clinical molecular tests becoming routinely used to diagnose a wide diversity of diseases. This rapid growth in clinical molecular genetic testing coupled with the complexity of the analytical procedures underscores the necessity for proficiency testing (i.e. external quality assessment) to allow laboratories offering such services the ability to evaluate their analytical procedures via inter-laboratory comparisons. The American College of Medical Genetics (ACMG) in partnership with the College of American Pathologists (CAP) have been offering proficiency testing for clinical molecular genetics laboratories since 1995, and presently have more than 230 laboratories from 11 countries enrolled in this program. This paper describes the evolution of this program and several challenges encountered in the delivery of a proficiency testing program for laboratories offering clinical molecular genetic services. Received: 13 April 2002 Accepted: 18 July 2002     

Proficiency testing in analytical chemistry, microbiology, and laboratory medicine – working group discussions on current status, problems, and future directions

Working group (WG) discussions on proficiency testing (PT) held at the joint Eurachem/ EQALM workshop, Borås, Sweden, 24–26 September 2000 are summarized. The discussions focused on aspects of PT and accreditation (WG 1), general aspects of PT in analytical chemistry (WG 2), microbiology (WG 3), and laboratory medicine (WG 4), incorporation of measurement uncertainty into PT schemes (WG 5), international harmonization of PT schemes (WG 6), and the role of PT in the international structure of chemical measurement (WG 7). Current status, problems and future directions are identified. Each WG contained a majority of participants experienced in the subject being covered by that WG, and a few participants with different expertise. This was done to promote cross-fertilization of ideas between sectors, a key objective of the workshop. The WG issues reflected the content of the keynote lectures and some issues were covered from different perspectives by more than one group.