Traceable reference values for routine drinking water proficiency testing: first experiences

Proficiency testing (PT) results have been used to improve traceability in chemical drinking water analysis. With a generalized least-square regression the mass concentrations of As and Sb were calculated in a drinking water that had been used to prepare proficiency testing samples by a spiking procedure. From the mass concentrations in the matrix and the spiked amounts, reference values with an uncertainty budget could be calculated without the need for reference measurements. The degree to which these reference values can be regarded as traceable is discussed. The results showed slight deviations in some samples between reference values and consensus means.     

A statistical strategy for discouraging collusion in split-level proficiency testing schemes

A statistical strategy for discouraging collusion in split-level proficiency testing schemes was developed. When the samples are randomly labeled, the difference in the analyte levels in the two samples can be designed to maximize the probability of detecting collusion when it occurs, so that participants who colluded cannot easily receive satisfactory assessments. This favors providing convictive assessments of participants proficiency and giving the participants a level playing field.     

Changes to proficiency testing in developing countries over the last 10 years

Accreditation and Quality Assurance - Participation in proficiency testing schemes is necessary and beneficial for all testing laboratories across the world. Laboratories in developing countries...     

The proof of analytical chemical education lies in proficiency testing: A proficiency testing programme in polytechnic academia and vocational colleges in The Netherlands

Participation in proficiency testing schemes (PT-schemes) is an important way to prove and to improve the skills of analytical chemical students. It gives valuable information on the professional capabilities of the students and is thus an important step in the training of laboratory engineers and technicians. In the programme described three types of samples are offered to the students: chemical, environmental and clinical samples. A guiding protocol presents instructions to the participating student groups. Standard operating procedures are available, but the students are also free to select their own method. The results are methodologically and statistically judged by professional PT-organisers and are presented in the customary way: the dataset, the mean (consensus) value of all participants and the Z-scores. The final presentation of the results takes place in an annual symposium where awards are presented to the best performing student groups, and a lecture programme is presented with subjects in the area of quality assurance and quality control. A selection of results from the KILO/PT/1998–1999 and the KILO/PT/1999–2000 programme is presented.     

The proof of analytical chemical education lies in proficiency testing: a proficiency testing programme in polytechnic academia and vocational colleges in The Netherlands

Participation in proficiency testing schemes (PT-schemes) is an important way to prove and to improve the skills of analytical chemical students. It gives valuable information on the professional capabilities of the students and is thus an important step in the training of laboratory engineers and technicians. In the programme described three types of samples are offered to the students: chemical, environmental and clinical samples. A guiding protocol presents instructions to the participating student groups. Standard operating procedures are available, but the students are also free to select their own method. The results are methodologically and statistically judged by professional PT-organisers and are presented in the customary way: the dataset, the mean (consensus) value of all participants and the Z-scores. The final presentation of the results takes place in an annual symposium where awards are presented to the best performing student groups, and a lecture programme is presented with subjects in the area of quality assurance and quality control. A selection of results from the KILO/PT/1998-1999 and the KILO/PT/1999-2000 programme is presented.     

Analytical performance is improved by regular participation in proficiency testing: an analysis of data from the Aquacheck proficiency testing scheme

Analysis of historical data from the Aquacheck proficiency testing scheme demonstrates improvement in the performance of participants correlated to the frequency of participation. Analysis of the spread of results returned by all participants, defined by the percentage relative standard deviation (RSD) and the performance (Z) scores awarded to the individual participants, indicates that the overall performance for the group of participants is consistent. However, when the frequency of participation is analysed, it can be clearly seen that those laboratories who participated in the majority of the distributions available reported 10–15% more acceptable (Z-scores between +2 and ?2) results than those labs who took part with a greatly reduced frequency. When ‘more difficult’ analytes are considered, those laboratories who participated in greater than 75% of available rounds reported up to 30% more acceptable results than those laboratories who participated in 25% or fewer, of the available rounds.     

Analytical chemistry in Balkan and East Mediterranean countries during 1994-2001

Research activity in the Balkan and East Mediterranean countries was evaluated on the basis of publications appearing in Analytical Abstracts (AA) during the cumulative 8-year period of 1994-2001. This was accomplished by assessing the scientific publication productivity in analytical chemistry as the number of publications from each country and the number of publications per population unit. To assess the impact in the scientific community, the mean impact factor for each country was calculated. The publication productivity trend was recorded for the 7-year period 1994-2000. Moreover, the preference to publish in specific journals per country was appraised. According to the total number of publications, Egypt (765 publications) and Greece (717 publications) are the most productive countries, while Slovenia shows the highest number of publications per million of population (140). Scientists from Israel published their work in the highest impact analytical journals with a mean impact factor of 2.02, followed by Slovenia (mean impact factor of 1.67) and Greece (mean impact factor of 1.53). Studies of scientists from different countries do not show any obvious preference to a single specific journal. It is interesting to note that preference for journals reveals the research interests of scientists from each country for sub-fields of analytical chemistry.     

Uncertainty evaluation in proficiency testing: state-of-the-art, challenges, and perspectives

The evaluation of measurement uncertainty, and that of uncertainty statements of participating laboratories will be a challenge to be met in the coming years. The publication of ISO 17025 has led to the situation that testing laboratories should, to a certain extent, meet the same requirements regarding measurement uncertainty and traceability. As a consequence, proficiency test organizers should deal with the issues measurement uncertainty and traceability as well. Two common statistical models used in proficiency testing are revisited to explore the options to include the evaluation of the measurement uncertainty of the PTRV (proficiency test reference value). Furthermore, the use of this PTRV and its uncertainty estimate for assessing the uncertainty statements of the participants for the two models will be discussed. It is concluded that in analogy to Key Comparisons it is feasible to implement proficiency tests in such a way, that the new requirements can be met. Received: 29 September 2000 Accepted: 3 December 2000     

Metrology in service of society: the role of proficiency testing

A sound system of competent measurements, underpinned by standards and accreditation, is an essential component of the infrastructure of any modern society. Proficiency Testing is an indispensible tool for developing and maintaining this infrastructure. It is used to verify compliance with standards, for ongoing monitoring of laboratory performance, for demonstration of competence, and for evaluating the performance of measurement procedures; it is used to indicate performance problems that might not be detected otherwise; and it is used as a tool for education and self-improvement. The new International Standard, ISO/IEC 17043, contains requirements and recommendations to make optimal use of this important tool.     

Food irradiation: Technology transfer in Asia, practical experiences

Nordion International Inc., in cooperation with the Thai Office of Atomic Energy for Peace (OAEP) and the Canadian International Development Agency (CIDA) recently completed a unique food irradiation technology transfer project in Thailand. This complete food irradiation technology transfer project included the design and construction of an automatic multipurpose irradiation facility as well as the services of construction and installation management and experts in facility operation, maintenance and training.

This paper provides an insight into the many events that led to the succesful conclusion of the world's first complete food irradiation technology transfer project.     

Requirements vs acceptability in proficiency testing schemes and other interlaboratory comparisons

Many laboratories take part in proficiency testing schemes, external quality assessment programmes and other interlaboratory comparisons. These have many similarities but also important differences in their modus operandi and evaluation of performance of participating laboratories. This paper attempts to highlight both the similarities and differences. It also puts particular emphasis on requirements called ”target values for uncertainty” and their meaning. Received: 24 January 2001 Accepted: 25 January 2001     

Measurement of organochlorine pesticides in drinking water: laboratory technical proficiency testing in Mexico

Accreditation and Quality Assurance - An interlaboratory comparison exercise was performed to assess the technical proficiency of laboratories in measuring the organochlorine pesticides in drinking...     

Enumeration of lactic acid bacteria: lacuna and improvement areas highlighted by proficiency testing

Accreditation and Quality Assurance - During the 2011 to 2018 food microbiology proficiency testing (PT) schemes organized by REQUASUD, a systematic analytical issue was detected. For the...     

Approaching target uncertainty in proficiency testing schemes: experience in the field of water measurement

Good correspondence between evaluations of the proficiency testing data for water measurements according to different scoring schemes was found as a result of implementation of the measurement quality according to the target uncertainty defined in the Drinking Water Directive. The accuracy of the evaluation is determined by the uncertainty of the assigned value, and this uncertainty should be in correspondence with the target uncertainty. Modification of the zeta-score by the thorough application of the target uncertainty is presented. It is convenient for generalised presentation of the proficiency testing data. The allowed bias is included as a linear term on the measured value scale, as it is treated in uncertainty analysis. The importance of implementation of the target measurement uncertainty in other fields of the routine measurements is indicated.     

Policies, requirements and surveys concerning frequency for participation in proficiency testing schemes

This paper focuses on policies and requirements concerning the frequency for participation in proficiency testing (PT) and provides an overview of the frequency for which PT activities are offered in 25 testing fields. Recent international surveys are summarised.     

Environmental analysis in the Czech Republic: organisation of proficiency testing and its use in laboratory assessment

The history, origin, and development of a system for monitoring and assessing water and other environmental laboratories in the Czech Republic is described. The system started in 1991 and has matured to its present complexity with similarities to the accreditation systems found in other countries. Differences from internationally recognized procedures are being corrected step by step. During the first year of its existence ASLAB, as part of its brief, organised proficiency testing (PT) programs for fifty laboratories. Today the total number of regularly participating laboratories exceeds 700 from the Czech Republic, the Slovak Republic, and Germany. This paper describes the ASLAB PT system, discusses some experiences with its use, and describes the use of PT results in assessment of the competence of laboratories. Received: 12 October 2000 Accepted: 7 January 2001     

The establishment of quality systems in veterinary diagnostic testing laboratories in developing countries: experiences with the FAO/IAEA External Quality Assurance Programme

Quality systems, established to internationally accepted standards, are one mechanism that can assist in evaluations of the sustainability of technology transfer, the proficiency of the user, and the reliability and comparability of data generated, resulting in potential enhancement of laboratory credibility. The means of interpreting existing standards and implementing quality systems in developing country veterinary diagnostic laboratories has become a significant adjunct to the technology transfer element within the Food and Agriculture/ International Atomic Energy Agency, FAO/IAEA programme. The FAO/IAEA External Quality Assurance Programme (EQAP) is given as an example for an initial step towards enhancing the “quality” culture in developing country veterinary laboratories. In 1995 the EQAP began as an effort to assure that test results emanating from laboratories using FAO/IAEA ELISA kits for animal disease diagnosis are valid. For this purpose 15 international external quality-assurance rounds have been performed to date for a variety of animal diseases e.g. Rinderpest, brucellosis, trypanosomosis, and foot-and-mouth disease (FMD). Results indicate that the EQAP is a valuable tool in the assessment of both the results provided by, and use of the ELISA kits provided through, the joint FAO/IAEA programme. Furthermore EQAP can assist laboratory diagnosticians to enhance quality control/quality assurance (QC/QA) procedures for conducting FAO/IAEA ELISAs and to advise on the implementation of similar QC/QA procedures in other laboratory activities. Based on the experiences made during the implementation of the EQAP a proposal for establishing a quality system standard was ratified through the World Organization for Animal Health (OIE) general conference in May 2000. The OIE Standard On Management And Technical Requirements For Laboratories Conducting Tests For Infectious Animal Diseases is based on ISO 17025 and provides a clear formula for establishing quality systems in veterinary diagnostic laboratories world-wide.     

Harmonization and transferability of performance assessment: experience from four serum aluminum proficiency testing schemes

Proficiency testing schemes monitor laboratory performance and provide a stimulus for improvement in accuracy. Where several schemes operate in the same analytical sector, there are risks that assessments of performance may be in conflict. Performance assessment for the determination of trace elements such as aluminum in serum is particularly important due to the high risk of contamination and therefore erroneous results. The objectives of this work were (1) to compare several mathematical models to establish a predefined standard deviation for proficiency assessment and (2) to evaluate the influence of instrumental methods and proficiency testing scheme on the assessment of performance for serum aluminum measurements. For this purpose, three samples were sent to the participants of four proficiency testing schemes. Assigned values were calculated according to algorithm A according to ISO 13528 and standard deviation for proficiency assessment according to three methods based on individual variability, state of the art or previous proficiency testing results. The method based on individual variability produced a more stringent standard deviation compared to analytical imprecision based on the state of the art. The instrumental methods gave similar results, whereas significant differences were observed between the four proficiency testing schemes indicating that harmonization of the standard deviation for proficiency assessment fails to allow transferability from one proficiency testing scheme to another and that additional factor(s) contribute to variability in performance assessment.     

Local comparability of proficiency testing results: determination of concrete slump and compressive strength values

A proficiency testing (PT) scheme is developed for comparability assessment of results of concrete slump and compressive strength determination. The scheme is based on preparing of a test portion/sample of a concrete in-house reference material (IHRM) at a reference laboratory (RL) in the same conditions for every PT participant. Therefore, in this scheme IHRM instability is not relevant as a source of measurement/test uncertainty, while intra- and between-samples inhomogeneity parameters are evaluated using the results of RL testing of the samples taken at the beginning, the middle and the end of the PT experiment. The IHRM assigned slump and compressive strength values are calculated as averaged RL results. Their uncertainties include the measurement/test uncertainty components and the components arising from the material inhomogeneity. The test results of 25 PT participants were compared with the IHRM assigned values taking into account both the uncertainties of the assigned values and the measurement/test uncertainties of the participants. Since traceability of the IHRM assigned values to the international measurement standards and SI units cannot be stated, local comparability of the results is assessed. It is shown, that comparability of the slump and compressive strength determination results is satisfactory, while uncertainty evaluation for slump results requires additional efforts.