Home  |  About us  |  Editorial board  |  Ahead of print  | Current issue  |  Archives  |  Submit article  |  Instructions |  Search  |   Subscribe  |  Advertise  |  Contacts  |  Login 
  Users Online: 1916Home Print this page Email this page Small font sizeDefault font sizeIncrease font size  

 Table of Contents      
ORIGINAL ARTICLE
Year : 2016  |  Volume : 7  |  Issue : 3  |  Page : 132-136

Assessment and classification of protocol deviations


Jehangir Clinical Development Centre, Jehangir Hospital, Pune, Maharashtra, India

Date of Web Publication28-Jun-2016

Correspondence Address:
Ravindra Bhaskar Ghooi
Ethics Committee-Jehangir Clinical Development Centre, Jehangir Hospital, Sassoon Road, Pune - 400 001, Maharashtra
India
Login to access the Email id

Source of Support: None, Conflict of Interest: None


DOI: 10.4103/2229-3485.184817

Rights and Permissions
   Abstract 

Introduction: Deviations from the approved trial protocol are common during clinical trials. They have been conventionally classified as deviations or violations, depending on their impact on the trial. Methods: A new method has been proposed by which deviations are classified in five grades from 1 to 5. A deviation of Grade 1 has no impact on the subjects' well-being or on the quality of data. At the maximum, a deviation Grade 5 leads to the death of the subject. This method of classification was applied to deviations noted in the center over the last 3 years. Results: It was observed that most deviations were of Grades 1 and 2, with fewer falling in Grades 3 and 4. There were no deviations that led to the death of the subject (Grade 5). Discussion: This method of classification would help trial managers decide on the action to be taken on the occurrence of deviations, which would be based on their impact.

Keywords: Data quality, deviations, noncompliance, subject protection


How to cite this article:
Ghooi RB, Bhosale N, Wadhwani R, Divate P, Divate U. Assessment and classification of protocol deviations. Perspect Clin Res 2016;7:132-6

How to cite this URL:
Ghooi RB, Bhosale N, Wadhwani R, Divate P, Divate U. Assessment and classification of protocol deviations. Perspect Clin Res [serial online] 2016 [cited 2019 Sep 23];7:132-6. Available from: http://www.picronline.org/text.asp?2016/7/3/132/184817


   Introduction Top


A protocol is one of the essential documents in clinical research and often standard treatment guidelines (STG) are also known as protocols. In either case, these are developed after due consideration of the evidence-based practice and represent the best method of use of therapeutic regimes. The guideline for Good Clinical Practice of the International Council on Harmonization (ICH GCP) defines the protocol as "A document that describes the objective (s), design, methodology, statistical considerations, and organization of a trial." The protocol usually also gives the background and rationale for the trial, but these could be provided in other protocol referenced documents. Throughout the ICH GCP guideline the term protocol refers to protocol and protocol amendments. [1] This definition remains unchanged in the draft of the guidelines revision, reiterating ICH's faith in the protocol. [2] Of late interest in protocols is steadily rising as evidenced by increasing publications on the Medline [Figure 1].
Figure 1: Publications concerning protocols on the Medline

Click here to view


With the increased focus on safety and efficacy, the complexity of the protocol is on the rise, a factor that is hampering recruitment and delaying completion of trials. [3],[4] This has also affected the economics of drug development and trial performance. [5] In addition, regulation, governance, and management of biomedical research have also become increasingly complex. [6] Since clinical research is an activity conducted by a team of the personnel, their workload is rising proportionally. Studies show that the workload depends on the complexity of the protocol, as determined by the Ontario Protocol Assessment Level. [7] With the increase in complexity, there is an expected rise in deviations from the protocol [8] and a rise in Type I errors, or an incorrect rejection of the null hypothesis. [9]

The protocol is the document that the research team must follow religiously if the clinical trial is to be compliant with all regulations. Trial protocols are reviewed and approved both by the regulatory authorities and Institutional Ethics Committees (ECs) before they are implemented. Deviations from the approved protocol should only be made with the consent of the regulators and the ECs, as they may reduce the benefit to the subject or increase the risk, and could also compromise the data obtained. Therapeutic procedures in protocols closely follow STG, if there are serious deviations from the same, the trial becomes nonscientific and hence unethical.

Deviations from the approved protocol are common and have been noted both in routine management [10] and in research, [11] at differing frequency. These deviations in a study could be due to the subject, the sponsor, or the investigational team. Compliance by a subject to advised medication regime is also known as medication adherence and is dependent on a large variety of factors including the disease, efficacy of medicine, age, and mental attitude of the patient. [12] Some of the deviations could be avoided by proper counseling of the subjects whereas some are not avoidable. Deviations caused by investigational staff are often due to poor training, and can be prevented.

A lot of work has gone into identifying causes of protocol deviations. Globalization of clinical research has led to differences in the quality of data emanating from different countries, and this has global implications on drug discovery and development. [13] Economics of drug development demands faster recruitment and completion of studies, this could cause protocol deviations, [14] additionally, the need to publish, unreasonable expectations and greed have been identified as other causes. [15]

It is accepted that deviations vary in their incidence and impact and have also been classified accordingly. Minor divergence of a study from the approved protocol is classified as a deviation while one that which affects the quality of data or impacts subjects' safety is classified as a protocol violation. [16] Deviations are further classified as noncompliance, misconduct, or fraud. A single instance of a deviation could be classified as a noncompliance while repeated and systematic noncompliances (usually despite warnings) are considered as misconduct. Whenever there is a financial motive behind the noncompliance, it may be classified as a fraud.

Misconduct is defined as "fabrication, falsification, or plagiarism in proposing, performing, or reviewing research, or in reporting research results." [17] Polanin-Huk define fraud as "Fraud is an intentional deception made for personal gain or to damage another individual, for instance, intentionally falsifying and/or fabricating research data, and misleading reporting of the results." [18] Trial managers need to take action against noncompliance depending on which of the above classes they fall in.

Thus, the noncompliance continuum has protocol deviation on one end and fraud on the other. Each of these may occur independently of each other; nonetheless they lie in a logical continuum. Detection of noncompliance, misconduct and fraud may require progressively greater effort and often sophisticated techniques including advanced statistics. [19] Missing deviations or ignoring them, could possibly lead to the occurrence of higher impact incidents such as misconduct and even fraud.

There is a subtle difference between a protocol deviation and a waiver. It may be mentioned here that waivers for informed consent may be granted in some cases, but a failure to take consent in the absence of a waiver is a serious omission. [20] When trial managers are aware that a deviation is likely to take place, they may take a prior approval of the sponsor in the form of a waiver for the deviation, but when the deviation is discovered after it has taken place, and then the incident is a deviation and not a waiver. The medical monitor may grant waivers for deviations that are not likely to impact either the data quality or safety of the subject. Since waivers are preapproved deviations, no action is necessary to be taken.

The role of the EC in the detection and analyses of protocol deviations is of utmost importance. There is fear that ECs, though good at initial review of trials, are notoriously lax in ongoing study reviews. [21] Deviations by their very nature do not occur when a study comes to the ECs for approval but occur after the study has begun and hence can be detected only during ongoing reviews. The detection of deviations therefore rests solely on the shoulders of the ECs, and the trial staff that voluntarily reports the same. If incidences of deviations are detected only during monitoring or audits, it speaks poorly of the performance of the trial staff and the ethical review process.

When the deviations from the protocol are discovered, then there is need to analyze their impact. In general, instances of noncompliance are many, but the impact of each individual instance on the study is minor. Conversely, the incidence of fraud is relatively low [22] but its impact may be very serious [Figure 2]. Misconduct is the gray area between these two extremes. Management of protocol deviation and action to be taken is dependent on the impact of the specific instance.
Figure 2: Relation between incidence and impact of deviations

Click here to view


Despite the variety of causes and types of misconduct and fraud, they damage the value of clinical trials and must be dealt with severely. [23] Those deviations, which are one off and classified as noncompliances, could have varying degree of impact. [24] The impact ranges from none to most severe leading to the death of a subject or subjects. In addition, the impact of deviations on data quality needs to be analyzed, because data is one of the most important outcomes of trials. [25] Deviations need to be analyzed and their impact assessed when it lies between these two extremes. We have classified deviations in five grades as follows:

  • Grade 1: No impact on data quality or patient safety
  • Grade 2: Minor impact on data quality
  • Grade 3: Minor impact on patient safety
  • Grade 4: Major impact on data quality or patient safety
  • Grade 5: Leading to patient/(s) death.
Our theoretical gradation was put to test on protocol deviations observed in trials at the Jehangir Hospital, Pune, over the last 3 years.


   Methods Top


All protocol deviations that have occurred in the last 3 years (from January 2013 to September 2015) in clinical trials (both regulatory and nonregulatory) were examined. The data collected for each deviation were as follows:

  • Study code
  • Trial and principal investigator
  • Assessment of deviation by the ECs.
The entire data were tabulated in excel and analyzed.


   Results Top


In the past, deviations were classified in two groups minor and major. Overall, there were a large number of deviations, and the number of major deviations has shown a reducing trend. A year-wise breakup is shown in [Table 1].
Table 1: Classification of deviations during the observation period


Click here to view


All these deviations were classified by two methods, as follows:

  • The Stakeholder responsible for the deviation, i.e., the subject or the investigational team as shown in [Table 2]
  • The grade of the deviation as suggested above.
On analyzing the deviations on the basis of grades, it was observed that most deviations were of Grades 1 and 2 and as the grade rose further; the number of deviations fell as shown in [Table 3].
Table 2: Protocol deviations by source


Click here to view
Table 3: Grade - wise distribution of deviations


Click here to view


Over the last 3 years, there has been no reduction in the occurrence of protocol deviations; in fact there has been an increase. Since data from 2015 are for only 9 months, the increase in deviations could be due to the improved reporting system. However when the deviations were analyzed on the basis of their impact, it is noted that the relation between impact and incidence of deviations was inverse (deviations with minimum impact had high incidence, whereas those with maximum impact were very few) as shown in [Figure 3].
Figure 3: Grade-wise occurrence of protocol deviations

Click here to view



   Discussion Top


One of the basic principles of research ethics is to offer maximum benefits and minimum risks uniformly to all subjects within a treatment arm in a clinical trial. All trial documents are prepared with the principles of ethics in mind, and a deviation from the laid down procedures may cause a decrease in the benefit or an increase in the risk to the concerned patient. By changing the treatment or by altering observations, it may affect the data quality in the trial. As the incidence and seriousness of deviations increases, the compliance of the trial to regulatory requirements and ethical guidelines goes down.

As noted at our site, protocol deviations do take place. Though a majority are of minor nature and do not have significant impact, each deviation must be identified, reported, and analyzed for its impact. Only then would one know if the deviations may be condoned or not. It is true that the ECs is charged with the role of protecting subjects in the trials, it cannot do so unless it is supported by the entire clinical research unit (CRU) and the investigators. As much as the EC, the CRU needs to be sensitive to protocol deviations and overall compliance of the trial. [26]

The earlier system of classification of deviation does not fully take into consideration the impact of the deviations. We have focused on the impact, both on subject safety and quality of data, since these are two most important aspects of clinical trials. There also needs to be some level of objectivity in classifying deviations, which we hope to have achieved to some degree. Hopefully, regulators will find this classification acceptable and superior to the existing one.

The present study threw up some deficiencies of the original method of classification. Some of the deviations originally classified as major were often procedural and had no impact either on data quality or subject safety. An example of this is the failure of the subject to date the signature on the informed consent form, this is a major procedural lapse but can hardly impact data quality or subject safety. Some deviations classified as minor in fact had an impact on data quality and subject safety. What is satisfying is that no deviation led to fatal consequences.

In our analysis and gradation of deviations, their effect on data was considered of lesser importance than that on the subject, since the rights and well-being of subjects take precedence over everything else in clinical research. Considering the large number of protocol deviations which are in fact noncompliances, there is always the risk that EC members become complacent about them. Such an attitude will be deleterious to the functioning of the EC and expose the subjects to needless harm.

Most deviations in this study were found to be of Grades 1 and 2, deviations of Grades 3 and 4 were progressively lower. There was no deviation of Grade 5, i.e., one which led to the death of a subject. This pattern agrees with the known distribution of deviations. It shows that the largest number of deviations have minor impact and those having major impact are rarer, as suggested by George (2015). [22]

In this study, focus is on protocol deviations and their impact, the impact of waivers either for procedures or for informed consent has not been studied. Waivers involve a different set of stakeholders and since a waiver cannot be granted without the consent of the sponsor, greater responsibility rests with the sponsor. Waivers also should be scientifically justifiable, else they will damage the quality of data obtained and even put the subjects to risk. Hence, oversight of waivers by the ECs is essential for the protection of subjects.

Scientists and physicians are often critical of the objections raised by ECs. It is their contention that ECs must inquire in the ethics of the studies, but should not delve deep into the science of the trials. None of the international guidelines provide any advice on the depth to which the ECs may probe the science of the trials. It is however undeniable that science and ethics are intertwined, and a clear-cut separation between the two is not feasible. The standard operating procedures of the ECs may provide some guidance, but individual members of the ECs will remain free to probe into the science of the trials to their own satisfaction.

Protection of subjects is the primary function of the ECs, all other functions being secondary to this. To fulfill this, the ECs must do a comprehensive preliminary review, ongoing review and also provide oversight for many other activities during a trial. The ECs must review a variety of documents including the clinical trial agreement and insurance certificate since defective agreements or insurance policies lead to the subjects' reimbursements or compensation being delayed or denied. EC members should also be proactive, viewing subjects as their charges, since they owe their existence to subjects.

Protocol deviations, intentional or otherwise may produce data that are not accurate, reliable, or credible. Care should be taken to identify them and avoid them as seriously as possible. These could lead to research of poor integrity that has serious impact on subjects, physicians, hospitals, and scientific journals. The subject is most vulnerable since protocol deviations are associated with increased risks of treatment failure and overall mortality. [27]

Financial support and sponsorship

Nil.

Conflicts of interest

There are no conflicts of interest.

 
   References Top

1.
ICH E6. Available from: http://www.ich.org/fileadmin/Public_Web_Site/ICH_Products/Guidelines/Efficacy/E6/E6_R1_Guideline.pdf. [Last accessed on 2016 Jan 29].  Back to cited text no. 1
    
2.
ICH E6 Integrated Addendum. Available from: http://www.ich.org/fileadmin/Public_Web_Site/ICH_Products/Guidelines/Efficacy/E6/E6_R2__Addendum_Step2.pdf. [Last accessed on 2016 Jan 29].  Back to cited text no. 2
    
3.
Dampier CD, Smith WR, Wager CG, Kim HY, Bell MC, Miller ST, et al. IMPROVE trial: A randomized controlled trial of patient-controlled analgesia for sickle cell painful episodes: Rationale, design challenges, initial experience, and recommendations for future studies. Clin Trials 2013;10:319-31.  Back to cited text no. 3
    
4.
Bhattacharya S, Cantor MN. Analysis of eligibility criteria representation in industry-standard clinical trial protocols. J Biomed Inform 2013;46:805-13.  Back to cited text no. 4
    
5.
Getz K. Improving protocol design feasibility to drive drug development economics and performance. Int J Environ Res Public Health 2014;11:5069-80.  Back to cited text no. 5
    
6.
Al-Shahi Salman R, Beller E, Kagan J, Hemminki E, Phillips RS, Savulescu J, et al. Increasing value and reducing waste in biomedical research regulation and management. Lancet 2014;383:176-85.  Back to cited text no. 6
    
7.
Smuck B, Bettello P, Berghout K, Hanna T, Kowaleski B, Phippard L, et al. Ontario protocol assessment level: Clinical trial complexity rating tool for workload planning in oncology clinical trials. J Oncol Pract 2011;7:80-4.  Back to cited text no. 7
    
8.
Ermete R. Clinical trials and communicating safely. Clin J Oncol Nurs 2012;16:25-7.  Back to cited text no. 8
    
9.
Moyé LA. P value interpretation and alpha allocation in clinical trials. Ann Epidemiol 1998;8:351-7.  Back to cited text no. 9
    
10.
Salerno SM, Wrenn KD, Slovis CM. Monitoring EMS protocol deviations: A useful quality assurance tool. Ann Emerg Med 1991;20:1319-24.  Back to cited text no. 10
    
11.
Théroux P, Ouimet H, McCans J, Latour JG, Joly P, Lévy G, et al. Aspirin, heparin, or both to treat acute unstable angina. N Engl J Med 1988;319:1105-11.  Back to cited text no. 11
    
12.
Weinstein AG. Improving adherence to asthma therapies. Curr Opin Pulm Med 2015;21:86-94.  Back to cited text no. 12
[PUBMED]    
13.
Glickman SW, McHutchison JG, Peterson ED, Cairns CB, Harrington RA, Califf RM, et al. Ethical and scientific implications of the globalization of clinical research. N Engl J Med 2009;360:816-23.  Back to cited text no. 13
    
14.
Bhatt A. Indian clinical trials: Paradigm shift from speed to quality? Perspect Clin Res 2012;3:1-3.  Back to cited text no. 14
[PUBMED]  Medknow Journal  
15.
Al-Marzouki SM. A Statistical Investigation of Fraud and Misconduct in Clinical Trials. Thesis for Ph. D., Submitted to the London School of Hygiene and Tropical Medicine. Available from: http://www.researchonline.lshtm.ac.uk/1386836/1/439435.pdf. [Last accessed on 2016 Jan 29].  Back to cited text no. 15
    
16.
Bhatt A. Protocol deviation and violation. Perspect Clin Res 2012;3:117.  Back to cited text no. 16
[PUBMED]  Medknow Journal  
17.
Office of Science and Technology Policy, Executive office of the President. Federal Policy on Research Misconduct. Federal Register; 2000. p. 76260-4. Available from: http://www.frwebgate.access.gpo.gov/cgibin/getdoc.cgi?dbname=2000_register and docid=00-30852-filed. [Last accessed on 2016 Jan 29].  Back to cited text no. 17
    
18.
Polanin-Huk J, Huk J, Filip R. Fraud and misconduct in clinical research. J Pre Clin Clin Res 2010;4:158-60.  Back to cited text no. 18
    
19.
Pogue JM, Devereaux PJ, Thorlund K, Yusuf S. Central statistical monitoring: Detecting fraud in clinical trials. Clin Trials 2013;10:225-35.  Back to cited text no. 19
    
20.
Schreiner MS, Feltman D, Wiswell T, Wootton S, Arnold C, Tyson J, et al. When is waiver of consent appropriate in a neonatal clinical trial? Pediatrics 2014;134:1006-12.  Back to cited text no. 20
    
21.
Shetty YC, Jadhav KS, Saiyed AA, Desai AU. Are institutional review boards prepared for active continuing review? Perspect Clin Res 2014;5:11-5.  Back to cited text no. 21
[PUBMED]  Medknow Journal  
22.
George SL. Research misconduct and data fraud in clinical trials: Prevalence and causal factors. Int J Clin Oncol 2015. [Epub ahead of print].  Back to cited text no. 22
    
23.
Gupta A. Fraud and misconduct in clinical research: A concern. Perspect Clin Res 2013;4:144-7.  Back to cited text no. 23
[PUBMED]  Medknow Journal  
24.
Mehra M, Kurpanek K, Petrizzo M, Brenner S, McCracken Y, Katz T, et al. The life cycle and management of protocol deviations. Ther Innov Regul Sci 2014.  Back to cited text no. 24
    
25.
Hajos AK, Kamble SK. Strategies for ensuring quality data from Indian investigational sites. Perspect Clin Res 2011;2:54-8.  Back to cited text no. 25
[PUBMED]  Medknow Journal  
26.
Divate U, Das S, Bhosale N, Divate P. Best practices sharing: Setting up a professional clinical research unit in India. Perspect Clin Res 2014;5:37-40.  Back to cited text no. 26
[PUBMED]  Medknow Journal  
27.
Ohri N, Shen X, Dicker AP, Doyle LA, Harrison AS, Showalter TN. Radiotherapy protocol deviations and clinical outcomes: A meta-analysis of cooperative group clinical trials. J Natl Cancer Inst 2013;105:387-93.  Back to cited text no. 27
    


    Figures

  [Figure 1], [Figure 2], [Figure 3]
 
 
    Tables

  [Table 1], [Table 2], [Table 3]


This article has been cited by
1 Investigation of the Study Characteristics Affecting Clinical Trial Quality Using the Protocol Deviations Leading to Exclusion of Subjects From the Per Protocol Set Data in Studies for New Drug Application: A Retrospective Analysis
Norihito Kohara,Masayuki Kaneko,Mamoru Narukawa
Therapeutic Innovation & Regulatory Science. 2019; 53(1): 45
[Pubmed] | [DOI]
2 Clinical Trial Amendments: Development of a Process for Consistent Implementation?
Gretchen McNally,Amanda Hrnicek,Hallie Barr
Clinical Journal of Oncology Nursing. 2017; 21(5): 627
[Pubmed] | [DOI]



 

Top
  
 
  Search
 
    Similar in PUBMED
   Search Pubmed for
   Search in Google Scholar for
 Related articles
    Access Statistics
    Email Alert *
    Add to My List *
* Registration required (free)  

 
  In this article
    Abstract
   Introduction
   Methods
   Results
   Discussion
    References
    Article Figures
    Article Tables

 Article Access Statistics
    Viewed2327    
    Printed30    
    Emailed0    
    PDF Downloaded415    
    Comments [Add]    
    Cited by others 2    

Recommend this journal