Part A: Performance Evaluation & Performance Studies
Performance Evaluation
- Performance Evaluation Plan
- Scientific Validity, analytical performance, and clinical performance
– Key evidence for the Performance Evaluation Report (PER)
- Clinical Evidence and PER
Clinical Performance Studies:
- Purpose of clinical performance studies
- Ethical considerations for clinical performance studies
- Methods for clinical performance studies (design, plan, report)
A Performance Evaluation Report documenting scientific validity data, analytical performance data, and clinical performance data, as well as their assessment and the clinical evidence derived from them, is required.
Further instructions for performance evaluation in Chapter VI Article 56 (3) states that manufacturers must follow a defined and methodologically sound procedure for the demonstrations of the following in accordance with Article 56 and Part A of Annex XIII:
(a) Scientific validity
(b) Analytical performance
(c) Clinical performance
Annex XIII Part A 1.2 provides the general principles by which manufacturers must demonstrate scientific validity and analytical and clinical performance.
- Identify through a systematic scientific literature review the available data relevant to the device and its intended purpose and identify any remaining unaddressed issues or gaps in the data;
- Appraise all relevant data by evaluating their suitability for establishing the safety and performance of the device;
- Generate any new or additional data necessary to address outstanding issues.
Scientific Validity
In order to demonstrate scientific validity, the manufacturer must use one or a combination of the following criteria, and this must be demonstrated and documented in the scientific validity report. Annex XIII Part A, 1.2.1
- relevant information on the scientific validity of devices measuring the same analyte or marker;
- scientific (peer-reviewed) literature;
- consensus expert opinions/positions from relevant professional associations;
- results from proof of concept studies;
- results from clinical performance studies.
See our white paper on how to perform a ‘state of the art’ literature review or contact us directly to see how we can help demonstrate scientific validity.
Analytical Performance
Analytical performance, as defined in Annex XIII Part A, 1.2.2, must be demonstrated on the basis of analytical performance studies and must be demonstrated and documented in the analytical performance report.
Clinical Performance
The clinical performance study plan (CPSP) provides the basis for clinical performance studies. Annex XIII Part A, 2.3.3 outlines the particular information that needs to be addressed in the CPSP, which is outlined in the clinical performance study:
- rational
- objectives
- design and proposed analysis
- methodology
- monitoring
- conduct
- record keeping
Clinical performance studies are required to obtain data and the subsequent assessments and conclusions that provide clinical evidence. The performance evaluation reports for class C and D devices must be updated annually, or earlier as necessary. There is a dramatic increase in clinical performance studies requirements for IVDs, and meeting these criteria will take time.
Furthermore, the quality of the clinical evidence will be more heavily scrutinized by NBs. The IVDR clearly states that the clinical evidence must support the intended purpose of the device as stated by the manufacturer. Note, this is based on a continuous process of performance evaluation.
The IVDR 2017/746 Corrigendum published in May 2019 amends IVDR 2017/746 replacing the international standard ISO 14155:2011 with ISO 20916:2019 In vitro diagnostic medical devices – Clinical performance studies using specimens from human subjects – Good study practice.
- (66) The rules on performance studies should be in line with well-established international guidance in this field, such as the international standard ISO 2019 on clinical performance studies using specimens from human subjects, currently under development, so as to make it easier for the results of performance studies…’.
Part B: Post-Market Performance Follow-up (PMPF)
PMPF is a continuous process to update the performance evaluation and addresses the post-market surveillance plan.
Post-market Surveillance
Post-market Surveillance requirements are detailed in Annex XIII and Article 78. The Post-Market Performance Follow-Up (PMPF) needs to be designed as a continuous process that updates the performance evaluation and specifically address the manufacturer’s post-market surveillance plan. This plan needs to proactively collect and evaluate data on device performance, as well as other relevant scientific data.
Labeling
The IVDR requires that every device have a Unique Device Identifier (UDI) on the label.
This is Big – Every Label Will Change!
Major changes to labels will be needed to accommodate UDI. The UDI system applies to all devices placed on the market, with devices used for performance studies being the exception.
The use of the UDI is intended by the EU to provide traceability of IVDs, and thus “significantly enhance the effectiveness of the post-market safety-related activities of the devices, which is owing to improved incident reporting, targeted field safety corrective actions and better monitoring by competent authorities. It should also help to reduce medical errors and to fight against falsified devices.”
The European database on medical devices (EUDAMED) will use the UDI to track devices. The EUDAMED provides a secure, web-based portal that EU competent authorities use to enter information from NBs and manufacturers to exchange information with the European Commission.
As with many aspects of the new regulations on medical devices, information continues to evolve. The Medical Device Coordination Group (MDCG) released 2 new documents in April of 2019 to clarify the inconsistencies in the timelines. These considerations apply mutatis mutandis to the IVDR”.
MDCG 2019-4 Timelines for registration of device data elements in EUDAMED
MDCG 2019-5 Registration of legacy devices in EUDAMED
Keep these documents in mind when considering your transition game plan.
Quality Management System (QMS)
The biggest change to the QMS it the need for a life cycle approach. Article 9 (4) states that “Manufacturers shall draw up and keep up to date the technical documentation for those devices. The technical documentation shall be such as to allow the conformity of the device with the requirements of this Regulation to be assessed. The technical documentation shall include the elements set out in Annexes II and III.”
For example:
The PMPF is an integral part of the manufacturer’s quality management system and is active for the life of the IVD. Technical documents need to update accordingly.
The GSPR is integrated into the QMS. The GSPR must be taken into account in the QMS such that the GSPR must be identified and guide the process.
The QMS must demonstrate that it is responsible for the Vigilance process, with the manufacturer doing its due diligence in reporting serious incidents and field safety corrective actions “with deadlines, responsibilities and reconciliation management.” This may be challenging in supply lines that use importers and distributors.
CONCLUSION:
The implementation of IVDR 2017/746 regulation is in full swing and it will significantly affect the manufacturers of IVDS by forcing them to focus on clinical proof and the maintenance of a robust QMS.