Application of a new AMIQAS computer program for integrated quality control, method evaluation and proficiency testing

Summary The computer program AMI - Quality Assessment Scheme (AMIQAS) was designed to give easy statistical management of analytical data in relation to method evaluation, internal quality control and proficiency testing. The program is designed in accordance with the recommendation of the ISO 5725 guideline and other official recommendations. The program consists of a database, test for outliers, statistics and graphs for evaluation of an analytical method for chemical, biological and environmental analysis, different control charts to be used in day-to-day internal quality control (Shewhart charts and z-charts). Finally the program has facilities to perform proficiency testing (also called external quality control) and produce the relevant evaluation reports for the documentation of method performance and quality control of results of measurements. The present paper demonstrates the applicability of the AMIQAS program for integrated method evaluation, internal quality control and proficiency testing using the determination of the concentration of lead in human whole blood as the numerical example.     

Proficiency tests using four batches of green alga with controlled levels of cadmium

A set of test materials of the green alga Chlorella vulgaris with different levels of naturally bound Cd and about the same levels of other 13 essential or trace elements (BIOMA 1–4) was produced for proficiency testing of laboratories involved in elemental analysis of food. Criteria of the laboratories’ performance, such as the z-score and combination scores RSZ and SSZ were evaluated and discussed in terms of their suitability for proficiency testing using a set of test materials with the same matrix. The use of the test materials as a set of internal reference materials has also been suggested. Received: 23 May 1997 / Revised: 1 August 1997 / Accepted: 11 August 1997     

Proficiency testing as a tool to assess the performance of visual TLC quantitation estimates

The use of rapid and inexpensive nonlaboratory-based screening tests for drug quality assessments is recommended as a component of a drug quality assurance program in poor resource settings. We have established routine Minilab test procedures to screen product quality and a proficiency testing program to determine the competency of the inspectors and reliability of results. Samples for the proficiency testing were prepared by pulverizing a standard reference tablet of the appropriate drug and making serial dilutions with starch to obtain concentrations of 0, 40, and 100%. The samples, which were labeled only with the drug name and an identifying letter, were given to inspectors for quality screening using Minilab procedures. In round 1 of the proficiency test, only 3 of 28 substandard samples were correctly identified. Round 2 of the proficiency test, which was administered after a performance qualification test for the analytical method, showed much improvement: 19 of 27 substandard drugs were correctly identified, while 5 out of 9 inspectors made the correct inference on the quality of 45 samples. However, in both rounds, 2 inspectors failed to identify substandard samples, indicating that their technical competencies need to be improved for the reliability of the results. Although the thin-layer chromatography screening methods provide a rapid means for drug quality assessment, they need to be put in the hands of competent users. The inclusion of a proficiency test in the screening program provides a measure of determining competency of the personnel and reliability of the results.     

A new test for 'sufficient homogeneity'

Certified reference materials and materials distributed in proficiency testing need to be 'sufficiently homogeneous', that is, the variance in the mean composition of the distributed portions of the material must be negligibly small in relation to the variance of the analytical result produced when the material is in normal use. The requirement for sufficient homogeneity suggests the use of a formal test. Such tests as have been formulated rely on the duplicated analysis of the material from a number of portions, followed by analysis of variance. However, the outcome is not straightforward. If the analytical method used is very precise, then an undue proportion of the materials will be found to be significantly heterogeneous. If it is too imprecise, the test may be unable to detect heterogeneity. Moreover, the Harmonised Protocol Procedure (M. Thompson and R. Wood, Pure Appl. Chem., 1993, 65, 2123) seems to be unduly prone to the rejection of material that is in fact satisfactory. We present a simple new statistical approach that overcomes some of these problems.     

Certification of cabbage and carnation samples and their use in an international proficiency study

Summary The preparation of carnation straw (Dianthus) and white cabbage (Brassica oleracea) as reference plant materials for chemical analysis and the testing of their homogeneity is described. The elemental content has been determined and evaluated by the Comité Inter-Instituts (CII) using different analytical procedures. The CII is an organisation grouping about 30 selected European laboratories which prepares, on a regular basis, several, very different reference plant materials. At the moment about 24 different plant samples are in stock. Recommended values for the two samples used in this study, are given for ash content, N, P, K, Ca, Mg, Na, Al, Fe and Mn. For 3 years these materials have been used as home references in the International Plant-analysis Exchange (IPE), a continuous proficiency testing scheme, organized by the Wageningen Agricultural University (The Netherlands), in which 230 laboratories worldwide are participating. The values found by the IPE laboratories are compared with the values recommended by CII and are mostly in good agreement with each other.     

Preparation and characterization of a proficiency test material “Polish mushrooms” supported by the International Atomic Energy Agency (IAEA), Vienna

Mushroom reference material has been prepared and characterized for use in proficiency test exercises within the frame of an IAEA Interregional Technical Cooperation Project. Laboratories from 14 countries provided results for homogeneity testing and the assignment of property values. The contents of 11 elements have been assigned. The material was used for conducting a proficiency test in Poland and the results obtained by Polish laboratories are presented and discussed.     

Biological and environmental reference materials in CENAM

Since 1994, when the NIST/NOAA Quality Assurance Program in Chemical Measurements was discussed in Queretaro, CENAM, the National Measurement Institute (NMI) of Mexico, has become involved in the development of reference materials. In the field of biological and environmental reference materials, in particular, the NORAMET collaboration program with NIST and NRC, and the North-American Environmental Cooperation signed among three free-trade treaty organizations, have greatly helped the development of the materials metrology program in the newly established CENAM. This paper describes some particularly significant efforts of CENAM in the development of biological and environmental reference materials, on the basis of inter-comparison studies organized with local and governmental environmental agencies of Mexico. In the field of water pollution CENAM has developed a practical proficiency testing (PT) scheme for field laboratories, as a part of registration by local government in the metropolitan area, according to the Mexican Ecological Regulation. The results from these eight PTs in the last 5 years have demonstrated that this scheme has helped ensure the reliability of analytical capability of more than 50 field laboratories in three states, Mexico, D.F., and the States of Mexico and Queretaro. Similar experience has been obtained for more than 70 service units of stack emission measurements in the three states in 1998 and 1999, as a result of the design of a PT scheme for reference gas mixtures. This PT scheme has been accomplished successfully by 30 analytical laboratories who provide monitoring services and perform research on toxic substances (Hg, methylmercury, PCB, etc.) in Mexico. To support these activities, reference samples have been produced through the NIST SRMs, and efforts have been made to increase CENAM's capability in the preparation of primary reference materials in spectrometric solutions and gas mixtures. Collaboration among NMIs has also successfully overcome the inability of CENAM to prepare biological tissue for mercury assessment and marine sediments for analysis of trace metals. The importance of international collaboration is stressed not only in the NORAMET region but also in the SIM, to provide help for each other and achieve mutual recognition among member countries of the region.     

Bias analysis of proficiency testing programme results

A proficiency testing programme might involve a great number of participating laboratories coming from different countries or regions, and normally they analysed the same test materials using their own routine analytical methods. Hence, the results of a proficiency testing programme may contain valuable information which could serve purposes other than just performance evaluation. This study attempted to extract information from the results of a proficiency testing programme for the purposes of educating the participating laboratories as suggested by ISO/IEC 17043. The “bias analysis” approach introduced in this study was based on the statistical model of measurement and the nature of bias in chemical analysis. With this approach, the participating laboratories could estimate the bias associated with different settings of experimental conditions according to the statistics of subset distribution of the reported results from the participating laboratories. This would be useful for them to review the analytical procedures they used and modify their methods if needed. The approach was applied to the analysis of data obtained from a number of past proficiency testing programmes, and the findings were discussed in this paper.     

Fit-for-purpose shellfish reference materials for internal and external quality control in the analysis of phycotoxins

The need for reference materials for quality control of analysis of foodstuffs has been stressed frequently. This has been particularly true in the phycotoxins field, where there is a great shortage of both pure calibration standards and reference materials. Worldwide there are very few independent bodies that produce certified reference materials for phycotoxins, the main producers currently being the National Research Council Canada and the Japanese Food Research Laboratory. Limited availability of contaminated shellfish and algae, as well as the time and knowledge necessary for the production of adequate reference materials, continuously lead to limited editions of certified reference materials and even more limited production of in-house reference materials. The restricted availability of in-house quality control materials promotes the rapid use of the limited certified reference materials, which in turn hampers the production of the suite of materials required globally for complete protection of public health. This paper outlines the various options that analysts can pursue in the use of reference materials for internal and external quality control, with a view to optimising the efforts of both reference materials users and reference materials producers. For this purpose, the logical sequence is reviewed from the discovery of a new bioactive compound in shellfish, through initial method development up to regulation for food safety purposes including accepted reference methods. Subsequently, the requirements for and efforts typically spent in the production and characterisation of laboratory reference materials, certified reference materials and other test materials used in inter-laboratory studies or proficiency testing, in the area of marine biotoxins are evaluated. Particular emphasis is put on practical advice for the preparation of in-house reference materials. The intricate link between reference material characterisation and method performance is outlined to give guidance on the appropriate in-house method validation in the rapidly developing field of phycotoxins.      

Matrix effects in biological reference materials used in the standardization of cholesterol measurements

Summary The precise and accurate laboratory measurement of blood cholesterol has become a national public health priority in the diagnosis and management of patients at risk for coronary heart disease. Unreliable measurements can hamper the national program to control heart disease. The National Cholesterol Education Program (NCEP) recommends that manufacturers and clinical laboratories achieve traceability to the National Reference System for Cholesterol in order to reliably classify patients according to the NCEP guidelines for assessing coronary heart disease risk. Documenting the accuracy of certain clinical analytical systems for the measurement of cholesterol has been complicated by the occurrence of fluid matrix effects. The major difficulty is that some processed materials (including calibrators, controls, proficiency survey samples, and reference materials) may not be reliable and may result in inaccurate measurement of patient specimens. Similarly, use of such material in accuracy assessment or proficiency testing may yield erroneous conclusions regarding system accuracy. Here, we will review the problem of matrix effects in cholesterol materials and present the results of several studies evaluating sources of matrix error. An alternate approach to documenting accuracy, to be used until commutable materials free of matrix effects are available, will also be discussed.     

The NATA scheme for accreditation of certifiers of reference materials

 Certified reference materials are widely used for the calibration of measuring equipment and for the evaluation or validation of measurement procedures. The use of reference materials makes possible the transfer of the values of measured or assigned quantities between testing, analytical and measurement laboratories, both nationally and internationally. There is an increasing number of reference materials producers in other countries, and a demonstration of their scientific and technical competence is now more widely considered to be a basic requirement for ensuring the quality of reference materials. This article outlines recent activities by international bodies and their culmination in a scheme of accreditation of certifiers of reference materials which has been developed by the National Association of Testing Authorities, Australia (NATA).     

Advances for proficiency testing for genetic laboratory science

Nucleic acid based clinical genetic testing has undergone explosive growth in recent years due in large part to the human genome project. Characterization of the human genome has led to a molecular understanding of the pathogenesis of many human diseases, and ultimately to clinical molecular tests becoming routinely used to diagnose a wide diversity of diseases. This rapid growth in clinical molecular genetic testing coupled with the complexity of the analytical procedures underscores the necessity for proficiency testing (i.e. external quality assessment) to allow laboratories offering such services the ability to evaluate their analytical procedures via inter-laboratory comparisons. The American College of Medical Genetics (ACMG) in partnership with the College of American Pathologists (CAP) have been offering proficiency testing for clinical molecular genetics laboratories since 1995, and presently have more than 230 laboratories from 11 countries enrolled in this program. This paper describes the evolution of this program and several challenges encountered in the delivery of a proficiency testing program for laboratories offering clinical molecular genetic services. Received: 13 April 2002 Accepted: 18 July 2002     

Reference materials and certified reference materials for water and food microbiology

Summary The concept of Certified Reference Materials (CRMs) for the verification of the accuracy of analytical methods and the traceability of the results to a CRM, is well accepted in chemistry. The use of Reference Materials (RMs) for intra-laboratory quality control schemes or for round-robin and proficiency testing is well established and follows from certain norms (ISO 9000 and EN 45000 series). For microbiology such concepts have not been fully defined and RMs are only rarely used. CRMs do not exist. To fill this gap the Commission of the European Community, through the BCR programme, has launched projects in collaboration with the RIVM (National Institute of Public Health and Environmental Protection) in Bilthoven (NL). Following fundamental considerations and feasibility studies, several intercomparisons have been held using selected laboratories working with food or water microbiology. Various microbiological strains have been subject of studies: Salmonella typhimurium, Listeria monocytogenes, Bacillus cereus, Staphylococcus aureus for food, Escherichia coli, Enterococcus faecium, Enterobacter cloacae and Staphylococcus warneri for water. To produce materials for interlaboratory studies, a set of milk powders was prepared by spray-drying. Separate portions were contaminated with one of the strains mentioned. The materials were then encapsuled in gelatine. It has been demonstrated that if protected in milk powder matrices, bacteria maintain the ability to be revived, but do not multiply. The modes of evaluation of the results for homogeneity and stability differ from those commonly used in chemistry.     

A review of proficiency testing scheme in Republic of Korea: in the field of water analysis

For regulatory purposes, it is often required to check the quality of environmental chemical analyses by routine proficiency testing (PT). In this study, the PT scheme of environmental laboratories in Republic of Korea has been reviewed. Especially, real water-based reference materials (RMs) were prepared and distributed for PT schemes. The consensus values from the PT were calculated by robust statistics with its standard uncertainties. The relative bias between the reference values and the consensus values was used as one of the indicators for the determination of the assigned values. The relationship between the performances of the laboratories, expressed by Z scores, and the concentration levels of the RMs were also revealed.     

Quality control procedures for chloride and nitrate ions analysis in plant samples by ion chromatography

This paper describes useful procedures to monitor quality of chloride and nitrate ions analysis in plant samples by ion chromatography. The use of certified reference materials (CRMs) provided an efficient way to verify the accuracy of the method. Data generated by the method of analysis for chloride compared favourably with certified values. The quality system included also the systematic analysis of an internal reference sample in each batch of samples routinely analysed. The performance of the method, including extraction and measurement, over a period of 3 years was reported with control charts. The yearly variation coefficients were less than 6.5% for chloride and nitrate ions. Finally, the analytical method was evaluated through the participation of laboratory to an international proficiency testing scheme. Found results were not significantly different from published medians.     

Analytical validation of quality control materials for Huntington’s disease examination

The expansion of molecular diagnostics using nucleic acid technologies in clinical and public health practice has increased the need for appropriate reference materials and verified quality-control materials for quality assurance, test validation, proficiency testing and the development of new examination procedures. Good laboratory practice requires the use of reference materials to establish an examination procedure and assess the variability of the results. Reference materials are also required to assess the assay on a daily basis and to normalize results collected among different laboratories. Despite the growing volume, the rapidly increasing number of tests being offered, and the necessary routine use, certified reference materials are often not available. There is a wide range of human genetic bio-assays for which there are no available traceable certified reference materials. Several initiatives have been organized to provide well-characterized quality control specimens (e.g., cell lines) with known DNA mutations for use in diagnostics. Mutations are confirmed with bi-directional DNA sequence analysis, which is considered the reference examination procedure. In the field of personalized medicine, NIST has created and validated Standard Reference Material^® 2399 for fragile X examinations. Herein we describe our characterization of candidate reference materials for Huntington’s disease genetic examination. Bi-directional DNA sequencing confirmed the size of the CAG repeat contained on each allele from patient derived materials. Amplification and capillary electrophoresis of the CAG repeats had an uncertainty ranging from 2.06%CV to 7.83%CV.     

New reference material for analysis of elements in glutinous rice produced at the National Institute of Metrology (Thailand)

Reference materials play an important role for evaluating the accuracy of analytical results, and are essential parts of good laboratory practice. They represent a key tool for quality control of chemical analyses. In Thailand, the demand of food and environmental reference materials is constantly increasing, and the National Institute of Metrology (NIMT, Thailand) is responding to the urgent needs for affordable materials, which require collaborative efforts at the national level. This paper describes the preparation of a new glutinous rice reference material, along with homogeneity and stability studies and the analytical work carried out for the certification of the contents of inorganic elements. The incurred material was collected from an actual rice paddy field. Material preparation along with homogeneity and stability testing were carried out at the Environmental Research Training Centre (ERTC). The homogeneity study was designed to have three experimental conditions; (A) 10 bottles of candidate materials being analyzed each with 2 replicates, (B) 20 bottles with 2 replicates, (C) 10 bottles with 7 replicates, in order to study the suitable treatments for homogeneity testing in the reference material production. It was shown that a minimum number of 10 bottles with duplicate analyses are enough to demonstrate the homogeneity of candidate reference material. Certification of a candidate reference material in a single laboratory using reference method was confirmed with an interlaboratory comparison participated by a certain number of well recognized testing laboratories in Thailand. Further elaborative results will be discussed.     

Electrothermal atomization atomic absorption spectrometry for the determination of lead in urine: results of an interlaboratory study

Results of an interlaboratory study are reported for the determination of lead in urine. Two levels of a lyophilized material containing biologically-bound lead were prepared using pooled urine obtained from lead-poisoned children undergoing the CaNa₂EDTA mobilization test. The materials were circulated to a group of reference laboratories that participate in the `New York State Proficiency Testing Program for Blood Lead'. Results of the initial round-robin gave all-method consensus target values of 145±22 μg/l (S.D.) for lot 17 and 449±43 μg/l (S.D.) for lot 20. The interlaboratory exercise was repeated some 5 years later and consensus target values were re-calculated using the grand mean (excluding outliers) of results reported by laboratories using electrothermal atomization atomic absorption spectrometry (ETAAS). The re-calculated target values were 139±10 μg/l (S.D.) and 433±12 μg/l (S.D.). The urine reference materials were also analyzed for lead by several laboratories using other instrumental techniques including isotope dilution (ID), inductively coupled plasma (ICP) mass spectrometry (MS), flame atomic absorption with extraction, ICP-atomic emission spectrometry, ID-gas chromatography MS and flow injection-hydride generation AAS, thus providing a rich source of analytical data with which to characterize them. The materials were also used in a long-term validation study of an ETAAS method developed originally for blood lead determinations that has since been used unmodified for the determination of lead in urine also. Recently, urine lead method performance has been tracked in a proficiency testing program specifically for this analysis. In addition, a number of commercial control materials have been analyzed and evaluated.     

Proficiency testing in occupational and environmental health – Current practice and international initiatives for harmonisation

An increasing number of proficiency testing schemes (PT schemes) related to occupational and environmental health have been organised. Most schemes emphasise the importance of the validation of analytical results. With regards to harmonisation of the schemes, there are many differences between the schemes at many levels. These include factors concerning their relationship with legislation, national status, type and quality of proficiency testing material, analytical range and priorities for future development. Since differences between PT schemes have been recognised at the European level by organisers of PT schemes and external quality assessment schemes (EQASs) it seems appropriate to reinforce collaboration between scheme organisers in order to improve the quality of analytical performance in occupational and environmental health.