Proficiency testing programmes as a tool in food quality assurance: Overview of Italian experiences

Proficiency testing involves the performance of test procedures on routine samples by a number of laboratories. Interlaboratory proficiency testings provide multiple benefits to participants since they play a key-role in the total quality control of laboratory activities. They serve as a means of self-improving, as a mechanism of continuing education and as a source of information for accreditation agencies. This review highlights basic principles, benefits, criteria and capabilities of a proficiency testing programme for food analysis laboratories as well as their role in the implementation of rapidly developing food control legislation.     

Proficiency testing schemes: solutions for homogeneity control

The organisation of the homogeneity control of samples prepared for proficiency testing schemes (PTS) is a challenge for the PTS organisers and engenders logistical and financial problems. Samples used in PTS need to be homogeneous in order to be sure that if a laboratory has a result different from the other laboratories, its error can be attributed to its analysis method and not to its sample. The present paper describes the solutions found by the Bureau Interprofessionnel dEtudes Analytiques (Bipea) in order to answer the homogeneity control requirement. The methodologies of homogeneity control are adapted to specific characteristics of the products proposed in Bipeas PTS. The first methodology of control, the preparation approach, concerns specific PTS where the samples are formulated and where the assigned values are known and chosen. The second methodology, the target approach, concerns mainly the field of the environment and implies the choice of homogeneity targets. The third methodology, the global approach, concerns the agricultural and agro-food fields and involves comparison of near-IR spectra samples. Each methodology of control has its advantages and disadvantage and is suited to specific products prepared with specific preparation procedures. It has to be stressed that the solutions developed answer quality requirements but are not a substitute for the use of adapted and detailed preparation procedures with validated and regularly checked devices and for the a posteriori control of the results of the laboratories.     

Aptamer-targeted magnetic nanospheres as a solid-phase extraction sorbent for determination of ochratoxin A in food samples

A sorbent based on the aptamer for ochratoxin A was immobilized onto magnetic nanospheres (MNS) and used to develop a magnetic solid-phase extraction procedure to clean up food samples in conjunction with high-performance liquid chromatography separation and fluorescence detection. Specific retention of ochratoxin A by the sorbent was demonstrated, and the capacity of the MNS-aptamer sorbent was determined. The efficacy of this new approach was successfully evaluated through comparison with solid-phase extraction on commercial C18 cartridge. Several different food samples fortified in the range of with 2.5-50 μg/kg yielded mean recoveries from 67% to 90%, respectively. Finally, this oligosorbent was applied to the selective extraction of ochratoxin A from unfortified food samples.     

Proficiency testing for quality assurance of allergens methods

Proficiency testing is an external quality control check, whereby the quality of an analytical result is checked against criteria that are set independently of the laboratory carrying out the analysis. Participants in a proficiency test are encouraged to use the method of their choice to determine the analyte in question. The collated results submitted by the participants are used to derive the best estimate of the ‘true’ level, or assigned value, of the analyte, as a consensus value of the whole data set. Generally, the data submitted will be normally distributed and from a single population, but if a data set is found to be multimodal, then the selection of one of the modes as the assigned value is possible where there is supporting data, typically methodology information. Unless there are independent grounds for preferring one mode over another, it is not possible to set an assigned value or calculate z-scores. However, the analysis of allergens has presented proficiency testers with a new challenge, since it has become apparent that quantitative results may be dependent on the brand of enzyme-linked immunosorbent assay kit used, the specific analyte targeted (e.g. total content or allergen protein content) and the limit of detection achievable. FAPAS® has run more than 40 proficiency tests for allergen analysis over the past 7 years, during which time methods have been developed and improved and the requirements for determination of food ingredient allergens has increased. Two case studies are presented which highlight some of the issues around the use of allergen measurement methods.

Open image in new window

Figure A selection of food items which might cause allergenic or intolerance reactions

     

Inter-comparison exercises as a tool for teaching quality assessment: an experience in Spanish universities

Since the academic year 2001–2002, inter-laboratory trials for students of Analytical Chemistry in Spanish Universities have been organised by the Department of Analytical Chemistry at the University of Barcelona in collaboration with the Complutense University of Madrid, the University of Cordoba and the University of Huelva. The aim of these exercises is to train students in the use of tools for the assessment and improvement of quality in analytical laboratories.Representative samples of environmental and food analysis, agricultural soils and a type of beer were selected. The ethanol content of the beer and the pH, conductivity, and extractable phosphorus and potassium content in the soil were the chosen analytical parameters.Sample preparation, homogeneity and stability studies, as well as the statistical treatment of data from participants, were carried out by the laboratory Mat Control of the Department of Analytical Chemistry of the University of Barcelona.The paper presented heregives the results obtained after two years of experience.Presented at BERM-9—Ninth International Symposium on Biological and Environmental Reference Materials, June 15–19, 2003, Berlin, Germany.     

Proficiency testing as tool for ISO 17025 implementation in National Public Health Laboratory: a mean for improving efficiency

Public Health Laboratories (PHL) as part of Public Health Services are involved in law enforcement and ensuring food and water quality. The laboratories had to go through an organizational and monetary change imposed by the growing and changing needs of the state of Israel. The laboratories had to become more modern and to implement new and more sophisticated testing methods. Another requirement was to perform a steadily increasing number of tests and to be more flexible towards customers’ demands. Yet, the budget was not changed accordingly, as the Public Service to which the laboratories belong to do not respond to changing needs. Management realization was that the accreditation process could be used as a tool to achieve organizational and cultural change. Understanding and transformation were required throughout the organization, including management. Proficiency testing is performed for all testing methods in all areas even for non-accredited tests such as clinical tests. Proficiency testing was used as a tool for organizational culture change. It is a great index with game elements, that gives employees and managers the possibility for comparison, fixing problems and corrective action. The demands of ISO 17025 made it necessary to change peoples’ attitudes and views on both professional and communication levels. Laboratory quality consists now on the four main principles, described in the 5M&E model which is typical to small organizations and which ensures a constantly improving system: ”Policy statement”, ”Machine”, ”Material”, ”Measurement”, ”Method”, ”Manpower”, and ”Environment” targeted to achieve ”Quality upgrade”. Slowly we succeeded in providing better and more reliable services and have increased our income on what would hopefully become our way to financial independence. We hope this process would provide the Ministry of Health with a better chance to public health using the same financial sources. Received: 25 October 2000 Accepted: 12 December 2000     

Proficiency evaluation as a traceability link in chemical metrology

Traceability implies comparison of the results of measurements, or comparison to national or international measurement standards. One of several approaches that have been used in chemistry to provide for such comparisons is distribution of proficiency evaluation materials which have been measured by a reference laboratory. A newer approach is based on receipt and measurement at a reference laboratory of materials that have been produced and analyzed by other laboratories. Traceability concepts and approaches to realization will be described together with discussion of the relative merits of various approaches. Extension into metrological fields other than chemistry will also be explored. Received: 14 November 2000 Accepted: 11 December 2000     

Quantification of ochratoxin A in foods by a stable isotope dilution assay using high-performance liquid chromatography-tandem mass spectrometry

A stable isotope dilution assay (SIDA) was developed for quantification of the mycotoxin ochratoxin A (OTA) by using [2H5]-OTA as internal standard. The synthesis of labelled OTA was accomplished by acid hydrolysis of unlabelled OTA and subsequent coupling one of the products, ochratoxin alpha, to [2H5]-L-phenylalanine. The mycotoxin was quantified in foods by LC-tandem MS after extraction with buffers containing [2H5]-OTA and clean-up by immuno affinity chromatography or by solid phase extraction on silica. The method showed a sufficient sensitivity with a low detection and quantification limit of 0.5 and 1.4 microg/kg, respectively, and good precision in inter-assay studies showing a CV (n = 3) of 3.6%. The analysis of certified reference materials resulted in a low bias of 2.1% from the certified values and revealed excellent accuracy of the new method. To prove the suitability of SIDA. OTA was quantified in a number of food samples and resulted mainly in not detectable OTA contents. However, three samples of raisins exceeded the legal limit of 10 microg/kg and highlighted the need for further controlling the contamination with the mycotoxin.     

Practical uses of proficiency testing as valuable tools for validation and performance assessment in environmental analysis

Besides their role as an external quality control tool, PT results or samples could be used as an alternative to fulfil some of the quality assurance requirements such as analytical precision, uncertainty assessment, and internal quality control. This additional use of proficiency testing could help laboratories to reduce the financial impact of their quality assurance process. The purpose of this paper is to highlight some practical uses of PT results or samples in the environmental analytical field, which have been implemented at ISSeP (Institut Scientifique de Service Public), either for method validation or for internal quality control.Presented at the Eurachem PT Workshop September 2005, Portorož, Slovenia     

Proficiency testing on the analytical control of precious metal production

Our experience of executing proficiency testing programs on the analysis of precious metals and precious metal bearing materials is summarized. Six proficiency testing programs of the ”distributed sample testing” type were carried out using samples essentially distinct from each other: (I) certified samples of fine gold and fine silver, and (II) recoverable raw (scrap and catalyst waste) containing precious metals of unknown contents. The test results were assessed using the London Bullion Market Association (LBMA) rules and by Z-criteria using the ISO/IEC Guide 43 scale. Satisfactory results were presented by all participants for the analysis of certified samples of fine gold and fine silver. The results of catalyst waste analysis agreed rather well, whereas the scrap analysis revealed an essential discrepancy in the data for some samples. The reasons for such discrepancies are discussed. Received: 9 June 2000 Accepted: 21 November 2000     

The establishment of quality systems in veterinary diagnostic testing laboratories in developing countries: experiences with the FAO/IAEA External Quality Assurance Programme

Quality systems, established to internationally accepted standards, are one mechanism that can assist in evaluations of the sustainability of technology transfer, the proficiency of the user, and the reliability and comparability of data generated, resulting in potential enhancement of laboratory credibility. The means of interpreting existing standards and implementing quality systems in developing country veterinary diagnostic laboratories has become a significant adjunct to the technology transfer element within the Food and Agriculture/ International Atomic Energy Agency, FAO/IAEA programme. The FAO/IAEA External Quality Assurance Programme (EQAP) is given as an example for an initial step towards enhancing the “quality” culture in developing country veterinary laboratories. In 1995 the EQAP began as an effort to assure that test results emanating from laboratories using FAO/IAEA ELISA kits for animal disease diagnosis are valid. For this purpose 15 international external quality-assurance rounds have been performed to date for a variety of animal diseases e.g. Rinderpest, brucellosis, trypanosomosis, and foot-and-mouth disease (FMD). Results indicate that the EQAP is a valuable tool in the assessment of both the results provided by, and use of the ELISA kits provided through, the joint FAO/IAEA programme. Furthermore EQAP can assist laboratory diagnosticians to enhance quality control/quality assurance (QC/QA) procedures for conducting FAO/IAEA ELISAs and to advise on the implementation of similar QC/QA procedures in other laboratory activities. Based on the experiences made during the implementation of the EQAP a proposal for establishing a quality system standard was ratified through the World Organization for Animal Health (OIE) general conference in May 2000. The OIE Standard On Management And Technical Requirements For Laboratories Conducting Tests For Infectious Animal Diseases is based on ISO 17025 and provides a clear formula for establishing quality systems in veterinary diagnostic laboratories world-wide.     

Determination of ochratoxin A in Portuguese rice samples by high performance liquid chromatography with fluorescence detection

A sensitive and accurate analytical method for the determination of ochratoxin A (OTA) in rice, based on extraction with phosphate-buffered saline/methanol, an immunoaffinity column (IAC) for clean-up, and high performance liquid chromatography with fluorescence detection (HPLC-FD), is described. The limit of quantification of the proposed method was 0.05 g kg^–1. Recovery of OTA from rice samples spiked at 0.05 g kg^–1 was 92%, with a within-day RSD of 5.4%. The proposed method was applied to 42 rice samples from Portugal and the presence of OTA was found in six samples at concentrations ranging from 0.09 to 3.52 g kg^–1. The identification of OTA was confirmed by methyl ester derivatization and then HPLC analysis. The daily intake of OTA by the Portuguese population was also estimated.     

The correlation of laboratory performance in proficiency testing with other QA characteristics

Although it seems self-evident that proficiency testing (PT) and accreditation can be expected to improve quality, their relative benefits remain uncertain as does their efficacy. The study reported here examines the following issues: (a) Why do laboratories take part in PT schemes? (b) How does participation in PT fit in with a laboratory's overall quality assurance (QA) system? (c) Is there a link between a laboratory's performance in specific PT and it's QA system? (d) How does PT performance change with time and how do laboratories respond to poor performance? The overall conclusion is that there is no evidence from the present study that laboratories with third-party assessment (accreditation and certification) perform any better in PT than laboratories without. The validity of this conclusion and its significance for the future design and operation of such schemes requires further investigation. In particular, study is required of the degree to which good performance in open PT correlates with blind PT performance, where laboratories are not aware that the samples being analysed are part of a quality assessment exercise.     

Novel gel-based rapid test for non-instrumental detection of ochratoxin A in beer

A rapid easy-to-use immunoassay was optimised for the non-instrumental detection of ochratoxin A (OTA) in beer. The analytical method involves preconcentration on the immunoaffinity layer inside a column followed by direct competitive ELISA detection in the same layer. The visual cut-off value, i.e. the lowest OTA concentration resulting in no colour development, was 0.2 μg L^-1. Assay validation was performed using samples spiked with OTA. Thirty-seven naturally contaminated samples were screened with the gel-based method developed and no false-negative results were obtained. The method described offers a simple, rapid and cost-effective screening tool, thus contributing to better health protection of consumers. Figure Gel-based immunoassay of spiked beer samples.     

Front face synchronous fluorescence as a tool for the quality assurance of Greek milk

This research focuses on implementing the low cost and rapid front face synchronous fluorescence (SyFS) in order to ensure the quality assurance of Greek milk. Specifically, samples originated from the Greek domestic production of goat, sheep, cow, as well as foreign cow milk samples and adulterated cow milk samples. SyFS spectra were acquired in the excitation area of 250–500 nm with (Δλ)= 100 nm. Greek and foreign cow milk samples were differentiated based on intensity variations at wavelengths 350–515 nm, 540–579 nm, and 580–600 nm. The emissions at these wavelength positions correspond to tryptophan, vitamin A, and riboflavin. The supervised model with 94 samples exhibited p-value = 7,98E-11, RMSEE= 0,29171, RMSEcv= 0,29284 and RMSEP= 0,98013, AUROC for Greek samples= 0,61 and AUROC for foreign= 0,85. We differentiated milk samples according to the animal type with PCA and OPLS-DA models of 107 samples exhibiting RMSEE= 0,225842, RMSEcv= 0,228054 and RMSEP= 0,518635, AUROC for sheep samples= 0,99, AUROC for goat samples= 0,98 and AUROC for cow samples= 0,96. In fact, the emission band 350–591 nm characterized sheep milk and corresponds to aminoacids and fatty acids, cow milk was related to the 350–600 nm emission band related to the b-carotene and to the goat milk the emission bands 350–505 nm and 520–600 nm were attributed to tryptophan, NADH and Rivoflabin. Finally, we investigated whether SyFS coupled with chemometrics may provide preliminary evidence on adulterated cow milk samples. All models were validated with permutation testing, p-values and ROC curves.     

A high-performance liquid-chromatographic method for the determination of ochratoxin a in human plasma

Summary A high-performance liquid-chromatographic method is described for the quantitative determination of the mycotoxin ochratoxin A (OTA) in human plasma. The assay involves extraction with chloroform and sodium bicarbonate then HPLC with fluorescence detection. The method was validated in terms of selectivity, recovery, linearity, precision (within-day and between-day variability), accuracy, detection and quantification limits, and the stability of OTA in plasma and treated samples. The limit of detection was 0.4 ng mL⁻¹ of OTA in methanol, corresponding to 0.52 ng ml⁻¹ OTA in plasma. This assay was successfully applied for the determination of OTA levels in human plasma.     

Validation of a liquid chromatography method for the simultaneous quantification of ochratoxin A and its analogues in red wines

A validated high-performance liquid chromatography (HPLC) method with fluorescence detection for the simultaneous quantification of ochratoxin A (OTA) and its analogues (ochratoxin B (OTB), ochratoxin C (OTC) and methyl ochratoxin A (MeOTA)) in red wine at trace levels is described. Before their analysis by HPLC-FLD, ochratoxins were extracted and purified with immunoaffinity columns from 50 mL of red wine at pH 7.2. Validation of the analytical method was based on the following parameters: selectivity, linearity, robustness, limits of detection and quantification, precision (within-day and between-day variability), recovery and stability. The limits of detection (LOD) in red wine were established at 0.16, 0.32, 0.27 and 0.17 ng L(-1) for OTA, OTB, MeOTA and OTC, respectively. The limit of quantification (LOQ) was established as 0.50 ng L(-1) for all of the ochratoxins. The LOD and LOQ obtained are the lowest found for OTA in the reference literature up to now. Recovery values were 93.5, 81.7, 76.0 and 73.4% for OTA, OTB, MeOTA and OTC, respectively. For the first time, this validated method permits the investigation of the co-occurrence of ochratoxins A, B, C and methyl ochratoxin A in 20 red wine samples from Spain.     

A quality systems approach for identifying and controlling sources of error with point of care testing devices

Historically, due to the size and nature of the instrumentation, highly skilled laboratory professionals performed clinical testing in centralized laboratories. Today’s clinicians demand realtime test data at the point of care. This has led to a new generation of compact, portable instruments permitting ”laboratory” testing to be performed at or near the patient’s bedside by nonlaboratory workers who are unfamiliar with testing practices. Poorly controlled testing processes leading to poor quality test results are an insidious problem facing point of care testing today. Manufacturers are addressing this issue through instrument design. Providers of clinical test results, regardless of location, working with manufacturers and regulators must create and manage complete test systems that eliminate or minimize sources of error. The National Committee for Clinical Laboratory Standards (NCCLS) in its EP18 guideline, ”Quality management for unit-use testing,” has developed a quality management system approach specifically for test devices used for point of care testing (POCT). Simply stated, EP18 utilizes a ”sources of error” matrix to identify and address potential errors that can impact the test result. The key is the quality systems approach where all stakeholders – professionals, manufacturers and regulators – collaboratively seek ways to manage errors and ensure quality. We illustrate the use of one quality systems approach, EP18, as a means to advance the quality of test results at point of care. Received: 26 June, 2002 Accepted: 17 July 2002 Presented at the European Conference on Quality in the Spotlight in Medical Laboratories, 7–9 October 2001, Antwerp, Belgium Abbreviations NCCLS National Committee for Clinical Laboratory Standards (formerly) · POCT point of care testing · QC quality control · HACCP hazard analysis critical control points · CLIA clinical laboratory improvement amendments (of 1988) Correspondence to S. S. Ehrmeyer     

Standardization of BSE rapid test performances and experiences gathered during the implementation of large-scale testing

The accumulation of pathological prion protein is used as a diagnostic marker for transmissible spongiform encephalopathies. According to European Union (EU) regulations cattle older than 30 months of age (Germany, France, Italy, and Spain by national law >24 months) and slaughtered for human consumption must be tested by using rapid tests for bovine spongiform encephalopathy (BSE). Likewise fallen stock and clinically affected animals must be tested. This article gives a short overview of the incidence of BSE in Europe. The diagnostic hierarchy, i.e., the officially approved methodology for the confirmation of suspect rapid test cases, and the organization of the numerous laboratories involved in this large-scale testing for BSE are described. Special emphasis is given to necessary quality control measures currently in place for BSE rapid testing laboratories and to measures intended to assure a consistent performance of the commercially available rapid test kits.Presented at BERM-9—Ninth International Symposium on Biological and Environmental Reference Materials, 15–19 June 2003, Berlin, Germany.     

The WADA Proficiency Testing Program as an integral part of the fight against doping in sport

This article provides a brief perspective of the World Anti-Doping Agency (WADA) in the context of the fight against doping in sport and of the WADA Proficiency Testing Program as an essential element of the World Anti-Doping Program. The WADA Proficiency Testing Program exists within the framework of the WADA-accredited laboratories and is aimed at improving the effectiveness of the fight against doping by testing the ability of the laboratories to reliably identify and measure the substances and methods defined in the WADA Prohibited List. The paper provides an overview of the WADA Proficiency Testing scheme with respect to organization, test composition and evaluation of anti-doping methods and techniques. Scientific research is mentioned in the context of WADA’s involvement in generating reference materials for improvement of analytical activities of the WADA-accredited laboratories. WADA’s funding of a reference material for 19-norandrosterone in human urine is illustrated as an example.