Detection of genetic modification in cured tobacco leaf: proficiency testing using polymerase chain reaction-based methods

The Cooperation Centre for Scientific Research Relative to Tobacco (CORESTA; Paris, France) "Task Force Genetically Modified Tobacco-Detection Methods" investigated the performance of qualitative and quantitative methods based on the polymerase chain reaction (PCR) for the detection and quantitation of genetically modified (GM) tobacco. In the 4 successful rounds of proficiency testing, the cauliflower mosaic virus 35S RNA promoter (CaMV 35S) and the Agrobacterium tumefaciens nopaline synthase terminator (NOS) were selected as target sequences. Blind-coded reference materials containing from 0.1 to 5.0% and from 0.15 to 4% GM tobacco were used in 2 rounds of qualitative and quantitative PCR, respectively. Eighteen laboratories from 10 countries participated in this study. Considering all methods and 2 rounds, the different laboratories were able to detect GM tobacco at the 0.1% level in 46 out of 58 tests in qualitative assays. The results of the proficiency test indicate that both end point screening and real-time quantitative methods are suitable for the detection of genetically modified organisms in tobacco leaf samples having a GM content of 0.1% or higher. The CORESTA proficiency study represents a first step towards the interlaboratory evaluation of accuracy and precision of PCR-based GM tobacco detection, which may lead to the harmonization of analytical procedures and to the enhancement of comparability of testing results produced by different laboratories.     

Bias analysis of proficiency testing programme results

A proficiency testing programme might involve a great number of participating laboratories coming from different countries or regions, and normally they analysed the same test materials using their own routine analytical methods. Hence, the results of a proficiency testing programme may contain valuable information which could serve purposes other than just performance evaluation. This study attempted to extract information from the results of a proficiency testing programme for the purposes of educating the participating laboratories as suggested by ISO/IEC 17043. The “bias analysis” approach introduced in this study was based on the statistical model of measurement and the nature of bias in chemical analysis. With this approach, the participating laboratories could estimate the bias associated with different settings of experimental conditions according to the statistics of subset distribution of the reported results from the participating laboratories. This would be useful for them to review the analytical procedures they used and modify their methods if needed. The approach was applied to the analysis of data obtained from a number of past proficiency testing programmes, and the findings were discussed in this paper.     

An uncertainty evaluation for multiple measurements by GUM

An approach for uncertainty evaluation is proposed to determine the overall uncertainty by combining the uncertainties of the individual results from multiple measurements. It is accomplished by the separate combinations of the individual random and systematic components of the uncertainties of the individual results. The approach is useful when the individual results are not statistically different. It is recognized that, owing to the correlation, the uncertainty resulting from systematic effects is not reduced by multiple measurements. On the contrary, the uncertainty resulting from random effects can be reduced. Received: 3 May 2002 Accepted: 16 July 2002     

Analytical performance is improved by regular participation in proficiency testing: an analysis of data from the Aquacheck proficiency testing scheme

Analysis of historical data from the Aquacheck proficiency testing scheme demonstrates improvement in the performance of participants correlated to the frequency of participation. Analysis of the spread of results returned by all participants, defined by the percentage relative standard deviation (RSD) and the performance (Z) scores awarded to the individual participants, indicates that the overall performance for the group of participants is consistent. However, when the frequency of participation is analysed, it can be clearly seen that those laboratories who participated in the majority of the distributions available reported 10–15% more acceptable (Z-scores between +2 and ?2) results than those labs who took part with a greatly reduced frequency. When ‘more difficult’ analytes are considered, those laboratories who participated in greater than 75% of available rounds reported up to 30% more acceptable results than those laboratories who participated in 25% or fewer, of the available rounds.     

The current status and future of medical laboratory quality regulation and accreditation in Ghana

High-quality and reliable laboratory services are important components of effective and well-functioning health systems. Accurate, reliable and timely medical laboratory testing is crucial to patient care and disease surveillance. Unfortunately, in many sub-Saharan African countries, medical laboratory systems are adversely affected by the unavailability of medical laboratories, poor laboratory infrastructure and lack of well-trained personnel [1]. Quality in the laboratory is only achieved in a systematic way through the implementation of a quality management system. The results of the study showed that approximately 60?% of the 78 respondents were unaware of the requirements of ISO 15189:2007. A trial of proficiency testing, termed ??blind proficiency testing??, was carried out in which 19 laboratories determined the concentrations of urea and cholesterol in a proficiency testing material. Of the 19 laboratories that determined the concentration of urea, 63?% produced satisfactory results with scores between ?2 and +2. Similarly, 63?% of the participating laboratories obtained satisfactory z scores for cholesterol determination. Some of the laboratories that obtained satisfactory scores for urea determination had unsatisfactory scores for cholesterol determination and vice versa. It is recommended that the Ghanaian government pass a law and establish a standard to regulate medical laboratories in Ghana in order to improve quality in a significant way.     

Regular participation in proficiency testing provides long term improvements in laboratory performance: an assessment of data over time

Data from various proficiency testing schemes, operated by LGC Standards, was collated and reviewed to determine whether regular involvement within third party, proficiency testing, either over a prolonged period of time or via multiple participation, had improved the performance of those laboratories taking part. Three statistical evaluations were applied to historical PT results, a review of improvements over time, demonstrated by the evaluation of satisfactory performance scores achieved, a review of the relative robust standard deviations obtained from multiple methods and a focused review of one analyst participating in proficiency testing over a prolonged period of time. In each case the data indicated that long term participation and evaluation via proficiency testing had resulted in consistent and sustained improvements in laboratory performance.     

Reliability of food measurements: the application of proficiency testing to GMO analysis

This paper reviews the experience of the Food Analysis Performance Assessment Scheme (FAPAS^®) in operating a proficiency testing scheme for the analysis of genetically modified (GM) food. Initial rounds of proficiency testing have shown a tendency for laboratories to over-estimate GM levels, results obtained by polymerase chain reaction (PCR) and enzyme-linked immunosorbent assay (ELISA) detection methods to be significantly different and that data are skewed and not normally distributed until log-transformed. During the initial rounds, it was found that for analysis and quantification of GM material, it was not possible to assign a target value for standard deviation external to the round data, from which performance could be assessed. However, when working in a log scale, the internally derived, robust standard deviation (^σ) was found to be constant and could be used directly to predict a target value (σ) for performance assessment. Results from the first four rounds have provided valuable information and a general overview of laboratory ability. Choosing a target value for standard deviation which reflects current best practice has enabled laboratory performance to be assessed. Issues surrounding the assessment of performance are discussed which highlight some of the implications raised as a result of this initial assessment, regarding the enforcement of European labelling legislation.     

Comparison of different statistical methods for evaluation of proficiency test data

In analytical chemistry, proficiency testing usually consists in tests that laboratories conduct under routine conditions and report the result to the PT provider who then converts the result to a score which helps the participant to assess the accuracy of the result. The aim of this work is to show PT providers, accreditations bodies, and participating laboratories that different scoring results can be achieved depending on the evaluation system selected. The influence of different evaluation techniques on the results of an interlaboratory comparison for determination of gold in precious metals alloys was investigated. Results from 19 participating laboratories were evaluated by means of the three procedures: (1) classical statistical approach—outliers detection; (2) robust methods—(2A) robust procedure and (2B) ISO 13528; and (3) fitness for purpose. Evaluation of the same PT data revealed very interesting issues depending on the different scoring systems that were used and the robustness of the statistical methods used for detecting outliers. As a general rule, laboratories with scoring Z > 2 offered clearly poorer performance in robust approaches than classical ones. In order to support this first evidence, we evaluated a second data set with results from 24 laboratories (mercury from soil samples) by means of the four mentioned approaches. Selection and comparison of different scoring systems must be done very carefully, because sometimes they are not the best approach for studying the data population or the more appropriate one for evaluating the distribution of the data. Finally it should be taken into account that sometimes the robust scoring systems are not always suitable for evaluating the results of some PT schemes.     

Quantification of total petrol hydrocarbons (TPH) in soil by IR-spectrometry and gas chromatography – conclusions from three proficiency testing rounds

Due to the utilisation of 1,1,2-trichlorotrifluoroethane (CFE) as extraction solvent the IR-spectrometric determination of total petrol hydrocarbon (TPH) in soil according to ISO/TR 11046 has been replaced by gas chromatography/flame ionisation detection (GC/FID) after extraction with a halogen-free solvent according to ISO/DIS 16703:2001. The results obtained with both methods by field laboratories in three proficiency testing (PT) rounds are compared. The consensus means obtained with GC/FID are typically 10%–20% (ranging between 0% and 25%) higher than those found with IR-spectroscopy. On the contrary, coefficients of variation (CV) are roughly double in case of GC/FID and are briefly discussed against the background of the Horwitz equation. Received: 19 November 2001 Accepted: 17 March 2002     

Quality issues in proficiency testing

 Proficiency testing is a means of assessing the ability of laboratories to competently perform specific tests and/or measurements. It supplements a laboratory's own internal quality control procedure by providing an additional external audit of their testing capability and provides laboratories with a sound basis for continuous improvement. It is also a means towards achieving comparability of measurement between laboratories. Participation is one of the few ways in which a laboratory can compare its performance with that of other laboratories. Good performance in proficiency testing schemes provides independent evidence and hence reassurance to the laboratory and its clients that its procedures, test methods and other laboratory operations are under control. For test results to have any credibility, they must be traceable to a standard of measurement, preferably in terms of SI units, and must be accompanied by a statement of uncertainty. Analytical chemists are coming to realise that this is just as true in their field as it is for physical measurements, and applies equally to proficiency testing results and laboratory test reports. Recent approaches toward ensuring the quality and comparability of proficiency testing schemes and the means of evaluating proficiency test results are described. These have led to the drafting of guidelines and subsequently to the development of international requirements for the competence of scheme providers. Received: 2 January 1999 · Accepted: 7 April 1999     

Uncertainty evaluation in proficiency testing: state-of-the-art, challenges, and perspectives

The evaluation of measurement uncertainty, and that of uncertainty statements of participating laboratories will be a challenge to be met in the coming years. The publication of ISO 17025 has led to the situation that testing laboratories should, to a certain extent, meet the same requirements regarding measurement uncertainty and traceability. As a consequence, proficiency test organizers should deal with the issues measurement uncertainty and traceability as well. Two common statistical models used in proficiency testing are revisited to explore the options to include the evaluation of the measurement uncertainty of the PTRV (proficiency test reference value). Furthermore, the use of this PTRV and its uncertainty estimate for assessing the uncertainty statements of the participants for the two models will be discussed. It is concluded that in analogy to Key Comparisons it is feasible to implement proficiency tests in such a way, that the new requirements can be met. Received: 29 September 2000 Accepted: 3 December 2000     

Assessment of performance of laboratories in determining acrylamide in crispbread

A proficiency testing round was undertaken to assess the performance of laboratories to measure acrylamide in a sample of crispbread. Retail samples of crispbread were ground to a fine powder and after thorough mixing were packed in 40 g units for distribution. Ten samples were selected at random and analyzed in duplicate for acrylamide by liquid chromatography/mass spectrometry (LC/MS). Standard statistical tests showed that the material was homogeneous for the purposes of proficiency testing. Test samples were distributed to 55 laboratories in 16 countries in Europe, North America, Australia, and the Middle East. The results were analyzed by standard proficiency testing statistical procedures, and laboratories were awarded z-scores on the basis of their reported results. Based on a target standard deviation (sigmap value) taken from the Horwitz equation, for a robust mean value of 1.2 mg/kg acrylamide, satisfactory results (z-score within +/- 2 for those between 0.8 and 1.6 mg/kg) were obtained by 86% of the 37 laboratories that returned results. Only 1 laboratory was unsatisfactory and 4 had questionable results. About equal numbers of laboratories used gas chromatography (GC)/MS and LC/MS procedures with about 25% using MS/MS and one using GC with electron capture detection. There was no evident trend in performance or bias in results. GC/MS and LC/MS data were evenly distributed across the population of laboratories reporting results.     

Achieving traceability in chemical measurement—a metrological approach to proficiency testing

ISO/IEC 17025 requires that testing laboratories establish the traceability of their measurements, preferably to the SI units of measurement. The responsibility for establishing traceability lies with each individual laboratory and must be achieved by following a metrological approach.The results of measurements made in such a way are traceable to the standards used in method validation and to the calibration standards used during the measurement process. If these standards are traceable to SI then the measurements will also be traceable to SI.Participation in appropriate proficiency studies (an ISO/IEC 17025 requirement) enables laboratories to demonstrate the comparability of their measurements. If the materials used for the studies have traceable assigned values, then proficiency testing also provides information about measurement accuracy and confirms, or otherwise, that appropriate traceability has been established. This paper will report on a new approach for the establishment of traceable assigned values for chemical testing proficiency studies. The work is conducted at a "fit for purpose" level of measurement uncertainty, with costs contained at a level similar to previous "consensus" based proficiency studies. By establishing traceable assigned values in a cost effective way, NARL aims to demonstrate the added value of the metrological approach to participant laboratories.     

Proficiency tests to evaluate commercially available IVD kits for glucose and cholesterol measurements

The first proficiency testing round 630-IL-1002, was carried out with a Reference Material DMR-180a with reference values obtained by using gas chromatography isotope dilution mass spectrometry methods, in which glucose, cholesterol and creatinine were measured. The serum pool was obtained from blood donors and all the analytes were at the normal concentration in Mexican population. The laboratories participants used different field methods to measure the analytes. The Mexican compulsory standard NOM-064-SSA1-1993 “specifications for equipments in vitro diagnostic (IVD)” requests 5% precision and 5% maximum bias of the IVD equipments in the measurements of analytes like glucose and cholesterol. The results obtained by field laboratories in the proficiency testing round are compared to the reference value and uncertainty provided by the National Metrology Institute (CENAM). The quality of measurements is dependent not only on the laboratory competence but also on the methods used by those commercially available IVD kits. It is concluded that quality assessment of measurements in clinical laboratories should be critically evaluated by using stable and certified reference materials. Presented at MEFNM 2008, September 2008, Budapest, Hungary.     

Comparison of multianalyte proficiency test results by sum of ranking differences, principal component analysis, and hierarchical cluster analysis

Sum of ranking differences (SRD) was applied for comparing multianalyte results obtained by several analytical methods used in one or in different laboratories, i.e., for ranking the overall performances of the methods (or laboratories) in simultaneous determination of the same set of analytes. The data sets for testing of the SRD applicability contained the results reported during one of the proficiency tests (PTs) organized by EU Reference Laboratory for Polycyclic Aromatic Hydrocarbons (EU-RL-PAH). In this way, the SRD was also tested as a discriminant method alternative to existing average performance scores used to compare mutlianalyte PT results. SRD should be used along with the z scores—the most commonly used PT performance statistics. SRD was further developed to handle the same rankings (ties) among laboratories. Two benchmark concentration series were selected as reference: (a) the assigned PAH concentrations (determined precisely beforehand by the EU-RL-PAH) and (b) the averages of all individual PAH concentrations determined by each laboratory. Ranking relative to the assigned values and also to the average (or median) values pointed to the laboratories with the most extreme results, as well as revealed groups of laboratories with similar overall performances. SRD reveals differences between methods or laboratories even if classical test(s) cannot. The ranking was validated using comparison of ranks by random numbers (a randomization test) and using seven folds cross-validation, which highlighted the similarities among the (methods used in) laboratories. Principal component analysis and hierarchical cluster analysis justified the findings based on SRD ranking/grouping. If the PAH-concentrations are row-scaled, (i.e., z scores are analyzed as input for ranking) SRD can still be used for checking the normality of errors. Moreover, cross-validation of SRD on z scores groups the laboratories similarly. The SRD technique is general in nature, i.e., it can be applied to any experimental problem in which multianalyte results obtained either by several analytical procedures, analysts, instruments, or laboratories need to be compared.

Estimates of uncertainty of measurement from proficiency testing data: a case study

The results obtained by a laboratory over a number of proficiency testing/external quality assessment schemes (PT/EQAS) rounds can give information on the uncertainty of its measurements for a given test, provided that conditions such as full coverage of the routine analytical range, traceability, and small uncertainty of the assigned values (compared to the spread of the results) are met and provided that systematic deviations and any other sources of uncertainty are considered. As organisers of the Italian EQAS (ITEQAS) in occupational and environmental laboratory medicine, we tested this hypothesis using as model data from well-performing laboratories taking part in ITEQAS for lead in blood over the last 2 years. We also investigated how different PT/EQAS features (frequency of trials and number of samples) would affect a laboratory estimate of its uncertainty. Such information can be helpful in improving PT/EQAS organisation and define, for a given test: (a) the state of the art of the uncertainty of current measurement procedures, (b) identify needs for improvement of analytical methodologies and (c) set targets for acceptable uncertainty values.Presented at the Eurachem PT Workshop September 2005, Portorož, Slovenia.Papers published in this section do not necessarily reflect the opinion of the Editors, the Editorial Board and the Publisher.     

Proficiency testing of chloride content in different types of Portland cement

The accurate determination of chloride content in cement is a prerequisite for the production of high-quality concrete due to the damaging influence of free chloride ions on durability and safety of concrete constructions. The results for total chloride content in four different types of Portland cement provided by testing laboratories participating in an inter-laboratory comparison are presented. The data sets were evaluated by using different statistical methods. The laboratories exceeding critical values were signaled and sources of error were investigated. The precision parameters of the method were determined and the variance of the entire data set was apportioned among the sources of variation. The systematic differences between participating laboratories and heterogeneity of the cement samples were identified as major sources of variability of results. The ANOVA determined the intermediate precision parameters, which showed a low value for random errors resulting in good repeatability and high impact of sample and inter-laboratory difference on reproducibility of the method.Presented at the Eurachem PT Workshop September 2005, Portorož, Slovenia     

Determination of Assigned Values for Cadmium,Cobalt and Manganese in Drinking Water Proficiency Testing

In proficiency tests the selection of an appropriate assigned value is one of the most critical points. Determination of the assigned value for proficiency test can be done in 2 ways: based on reference value and consensus value. The use of such a consensus value as an assigned value is a commonplace in proficiency testing, because there is seldom at present a cost effective alternative. However, the consensus value has a weakness in that it could be significantly different from the true value due largely inexperienced laboratories. Therefore in this work, the reference values were used as the assigned values for all analytes of interest. The reference values in spiked drinking water samples were produced by the Metrology in Chemistry Laboratory of Research Center for Chemistry - Indonesian Institute of Sciences (RCChem-LIPI) with traceable to SI units through standard solutions from the National Institute Standard and Technology, USA. The reference values of cobalt and manganese were obtained by measurement using two from three comparable methods of Graphite Furnace-Atomic Absorption Spectrometry (GF-AAS), Inductively Coupled Plasma-Optical Emission Spectrometry (ICP-OES) and Inductively Coupled Plasma-Mass Spectrometry (ICP-MS) while that for cadmium was obtained by a primary method of ICP-Isotope Dilution Mass Spectrometry (ICP-IDMS).The obtained reference values were used to evaluate the laboratory performance result in a proficiency testing scheme of cadmium, cobalt and manganese in drinking water which was provided in 2014. All fifty nine laboratories reported cadmium and cobalt at low concentration levels which were about more than 82% showed satisfactory performance results. Similarly, the results of manganese were also comparable at high level concentrations.     

水中易释放氰化物能力验证样品的研制及应用

根据国家地表水环境质量监测网监测任务要求和环境监测的实际需要,制备了水中易释放氰化物能力验证样品。通过均匀性、稳定性检验以及量值一致性评价,研制的样品均匀性良好,在3℃~6℃冷藏避光保存条件下1年内稳定,样品配制值与多家实验室协作测定结果一致。探讨了样品在能力验证活动中的应用,共有来自全国11个省的32家实验室参加了水中易释放氰化物的能力验证计划,实验室满意率在80%以上,实验室结果出现有问题或不满意主要是由于样品前处理以及检测过程质量控制不当导致的。经检测及实验室反馈的数据验证,该能力验证样品能够应用于能力验证活动。