![]() ![]() |
|
Revised Human Factors Guidance Points to Pre-Market Approval Needs
|
Assurance Case Modeling Relationship to Human Factors for Infusion Pumps |
The Center for Devices and Radiological Health (CDRH) has issued a revision to their Human Factors guidance, Medical Device Use-Safety: Incorporating Human Factors Engineering into Risk Management (Issued July 18, 2000). The revised guidance is focused on the process recommended for pre-market approval of certain devices and presents a process of applying human factors methods during device design and development leading to a validation of use. There are specific suggestions for organizing a complete human factors submission including a report format that details all human factors work in development. The elements in this draft guidance reflect the Office of Device Evaluation's (ODE) current thinking and to make the work of reviewing and understanding a sponsor's efforts much easier, and thus, quicker to approve. Public comments can be offered through the FDA's website. How is this guidance different from the 2000 guidance? One difference is the emphasis in this guidance on preliminary analyses (user profiles, environment analysis, use error risk analysis), and formative testing as expected aspects of pre-market submissions. Also, this guidance provides a set of criteria that reviewers look for when reviewing the validation of use data you provide. Risk not in the title? The 2000 guidance was monumental, because it tied human factors to risk management . Although it was necessary then to explicitly connect risk to HF since this was not done previously in the medical device industry, the field has evolved and the connection between HF and risk is generally understood (for instance, see risk emphasis in IEC 62366). The new guidance draft talks of "optimization" of the user interface implying focus on eliminating use related hazards and also improving the overall efficacy of interaction. Removing risk for safety is still the main interest of the agency, however. Expectations made clear. This version of the guidance is more direct about what the human factors team at FDA expects. This is a huge advantage in outreach to industry because the new expectations for validation studies had not been communicated in this manner to industry in the 2000 guidance. It was not the authors' intention to provide a structure for human factors in the device approval process. We look forward to industry comments now that they are finally in black and white. Use the Draft Guidance Today! We recommend using the templates in this draft now, even before official approval, because it is the best window on the group's current thinking about human factors for pre-market approval. Our hope is that it cuts the number of iterations with your reviewer down significantly! |
The public meeting on infusion pumps held by CDRH in May 2010 highlighted the need for device manufacurers to present their case for safety and efficacy in the form of the assurance case model developed by Carnegie Mellon University and others. The elements of the assurance case are threefold--(1) the "claim, (2) the "evidence", and (3) the "argument." What does this mean for human factors work as it relates to the expectation that manufacturers conduct a simulated use validation study (SUSV) and/or a clinical evaluation as part of their pre-market clearance submission? Use validation testing is intended to show that the design of the user interface has been optimized with respect to safety and effectiveness - not only for high-risk tasks but overall safety and effectiveness - when used by the intended users performing the intended users and under the expected conditions of use. . In this way, the use validations can be a critical part of the "evidence" leg of the assurance case model. This data can form the basis of your "argument", which should present the logic leading to the conclusion that use safety is acceptable. if failures or unexpected user behaviors point to residual problems in the UI, then mitigating actions and retesting of those mitigations may be necessary. For more information on the assurance case model and AAMI's involvement, visit reports from AAMI's standards meeting in March 2011 where this topic was covered. |
|
Need for Human Factors Validation Increases for Injectors and Combination Product Approvals
|
||
Human Factors simulated use validation studies have become part of the review for approval of many new New Drug Approvals (NDAs) by the FDA, just as they have been for devices. The Office of Combination Products facilitates the review of these combination devices that administer drugs through syringes, injectors, or inhalers. In working CDRH HF team, CDER has been requesting human factors/usability validation study to demonstrate safety and efficacy with a minimum of 15 representative participants per distinct user group. That is, in your preliminary analysis, if you identify certain demographic or disability related distinctions in your user population, they need to be tested separately. The focus is on finding any residual risks regarding patient safety and explaining and mitigating failures observed that are attributable to the instructions for use or the design of the device itself. As CDRH works more closely with CDER, their review teams will include increased human factors submission scrutiny. We suggest asking your CDER submission project manager and review team who will be (or has been) identified as the CDRH HF representative and to call them about specific questions regarding study plans and submissions. |
||
Common Problems with Pre-Market Human Factors Submissions |
||
Avoiding critical omissions and lack of clarity limits time-consuming questions and additional information requests |
||
Human Centered Strategies has helped a number of recent clients resolve requests through letters from ODE regarding inadequacies in their Human Factors pre-market submissions. These requests for additional information or clarifications can mean valuable time lost in the process of clearing the device for market. The following list of inadequcies in sponsor submissions has been summarized based on feedback from ODE human factors evaluators over the past two years. No Use Error History Provided: Sponsor has omitted a historical analysis of use error risks with the predicate device or similar devices. Insufficient Detail of Device User Interface: Screen shots, sequences of operation, task analyses, and other data describing the user interface should be provided to allow the evaluator to become familiar with what the user is required to do with your device. Lack of User-Device Interaction Risk Analysis: A comprehensive risk analysis of the user's tasks has not been provided. This includes lack of prioritization of the risks based on potential harm to the user or patient. No Description of Formative Testing Work: If formative usability tests and evaluations have been performed by the sponsor, they are not summarized in the submission. In particular, the agency needs to know what risks the sponsor removed from each iteration of testing. Omission of a Simulated Use Validation Study: Sponsor has submitted a pre-market document with no identified simulated use validation study. This study is necessary for reviewers to determine safe and efficient use of the device. Insufficient Rationale for Validation Study Tasks: The sponsor has not provided reasoning for the choice of the study tasks, with respect to anticipated risks. The agency needs to understand that the extent of the tasks represent the full range of possible use error events as delineated in the sponsor's hazard analysis and risk assessments. Validation Study Tasking Unclear or Missing: Sponsor reports did not discuss how the device system was used during the evaluations to simulate use conditions. Please describe how the device was used by study participants and particularly the use scenarios involving critically important tasks. |
Insufficient Detail Regarding Validation Study Participants: Description of the user populations participating in the study are of insufficient detail regarding their training, knowledge, experience, recruitment proceedure, etc. Insufficient Definition of User Performance Criteria: It was not clear to the reviewer in the sponsor's submission what kind of user performance evaluation was done, what was considered to be adequate task performance or what was considered to be a failure. Lack of focusing data analysis on task failures. Analysis of performance and subjective data should be directed toward understanding user performance and particularly task failures. The analysis should determine the consequnce and severity of failures regarding user/patient safety based on subjective and objective evaluation data. Please clearly state criteria for determining user performance acceptability. If failures or use errors occur in usability validation, they should be discussed and the sponsor must make the determination based on the nature of the errors (severity, patterns, consistent with known use error scenarios that have resulted in MDRs/recalls), whether the current design is acceptable or not. Lack of Description of Failure Solution Stategy: The results of the evaluation should describe the method the sponsor will use to eliminate or mitigate serious use errors in the study through design enhancement or whether such enhancement is needed. It is insufficient to assert that "all failures/errors have been recorded, reviewed and determined to be acceptable" with criteria that allow for a XX% failure rate. Insufficient Pre-test Training Description and Realism of Training: Sponsor has not described how training was involved in the validation study or the extent to which it is necessary for users of your device in the use environments stated. Explain how your training prior to performance represents the anticipated real-world situation. Concentration on Pass/Fail Success Rates Instead of Failures: The agency could not determine if adequate use safety has been met based on pre-set performance criteria by the sponsor that allow failure rates of XX%. Use-safety implies the ability of the intended users to operate the device without unintended use errors that could cause harm to patients or to the users themselves. The rationale and intent of validation testing is to determine whether such errors occur, and whether they are due to the design of the device, including its labeling and instructions for use. |
|
|
Home | The Process | Products | Team Background | Experience | Resources | Contact Information © 2006 Human Centered Strategies, LLC |
||