|Ahead of print publication
Compliance of Mumbai-based clinical trial sites with the Quality Council of India guidelines and evaluation of the challenges faced by the investigators
Brinal Figer, Nithya Jaideep Gogtay, Urmila Mukund Thatte
Department of Clinical Pharmacology, Seth GS Medical College and KEM Hospital, Mumbai, Maharashtra, India
|Date of Submission||28-Jan-2020|
|Date of Acceptance||08-Apr-2020|
|Date of Web Publication||15-Jan-2021|
Urmila Mukund Thatte,
Department of Clinical Pharmacology Seth GS Medical College and KEM Hospital, Parel, Mumbai, Maharashtra
Source of Support: None, Conflict of Interest: None
| Abstract|| |
Purpose: A committee chaired by Dr. Ranjit Roy Chaudhary suggested accreditation of investigators, sites and ethics committees to improve the quality of trial conduct in the country. Prior to accreditation, understanding the challenges faced at the sites by investigators could help define the extent of the problem and identify potential solutions. Hence, we conducted the present study.
Methods: Institutional Ethics Committee approval and written informed consent was obtained prior to enrolment. A checklist and a questionnaire was used to assess compliance to Quality Council of India (QCI) standards and the challenges faced by the sites and investigators respectively. Mumbai based investigators listed in the Clinical Trial Registry of India (CTRI) were enrolled. The responses obtained were analysed descriptively. The responses to each question in the checklist were calculated as a proportion and response to each item in the questionnaire was calculated in frequency and percent frequency. All the analysis was done using Microsoft Excel version 2013.
Results: A total of 30 investigators from 69 clinical trial sites agreed to participate. We found that over 80% of the sites complied with standards recommended by the QCI guideline. The most frequently reported issues at the site were lack of space for archival (25%), no System to evaluate adequacy of training (31.81%) and lack of understanding of the technical language of the informed consent form (39.02%).
Conclusion: There is a need of coordinated effort between all the stakeholders to improve the clinical trial conduct at the site.
Keywords: Accreditation, clinical trial site, investigators, Quality Council of India
|How to cite this URL:|
Figer B, Gogtay NJ, Thatte UM. Compliance of Mumbai-based clinical trial sites with the Quality Council of India guidelines and evaluation of the challenges faced by the investigators. Perspect Clin Res [Epub ahead of print] [cited 2021 Feb 27]. Available from: https://www.picronline.org/preprintarticle.asp?id=306679
| Introduction|| |
In July 2013, a committee chaired by Dr. Ranjit Roy Chaudhury developed recommendations to help formulate policies for the approval of drugs, clinical trials, and banning of drugs. This committee suggested that the accreditation of investigators, sites, and ethics committees should be performed to improve the quality of clinical trial conduct in the country. The Ministry of Health and Family Welfare, in response, assigned the job of accreditation of Ethics committees, Clinical Trial Sites and Investigators to the Quality Council of India (QCI). The QCI-a statutory body under the aegis of the National Accreditation Board for Hospitals and Healthcare providers (NABH) has laid down the minimum essential criteria for accreditation in 2013. Until the time of allocating the task of accreditation of the site to QCI, there were no guidelines regarding the minimum essential requirements for the sites in the country to conduct clinical trials with sponsors selecting sites/investigators based on previous experience and/or information available in the Clinical Trials Registry of India.
As multiple factors contribute to the success of any clinical trial, understanding challenges faced at sites by investigators will help understand the extent of the problem and identify potential solutions. This formed the objective of the present study.
| Methods|| |
Ethics, study design
The cross-sectional study was approved by the Institutional Ethics Committee (EC/0A-131/15), and the participants gave written informed consent.
Study duration and study site
The study was conducted between June 2016 and October 2017 in Mumbai.
A checklist (binary responses only) and a questionnaire (multiple choice answers with free text options) were used. The former was used to assess compliance to QCI standards while the latter was used to assess the challenges faced by the investigator.
Development of the study instruments: Checklist:
- The checklist was developed by the authors based on the QCI recommendations (http://www.cdsco.nic.in/writereaddata/finalAccreditation%20Standards.pdf). The following themes were addressed-site management, qualifications, experience and training of the staff, site SOPs and documentation practices, protection of participant rights, safety and well-being, clinical trial material, oversight and inputs received during the key informant interview with four clinical research professionals
- Questionnaire: Clinical Research experts with at least 10 years' experience were approached to identify the themes/issues for the questionnaire content development. The views expressed by the experts were written down by a study team member and these were subsequently analyzed by a qualitative research expert (who also had more than 10 years' experience). The following themes related to clinical trial issues emerged and were built into the questionnaire: Space, equipment, staff (infrastructure), training, protection of clinical research participants, standard operating procedures (SOPs), study documentation and storage, serious adverse event (SAE) related issues, ethics committee-related issue, issues related to funds and sponsor-related issues. Based on these themes, a study instrument comprising of 23 items was developed
- Validity and Reliability assessment of the questionnaire: This was assessed for content validity by eight subject experts, and the content validity ratio (CVR) calculated. Items with a CVR above 0.5 were retained. Reliability assessment was done using test-retest reliability and the internal consistency and measured using Cronbach's alpha (preset at 0.7).
Postvalidation, a 40-item checklist, and a 25-item questionnaire were developed.
All the Mumbai based Clinical trial investigators listed in the Clinical Trial Registry of India for regulatory clinical trials till December 2016 and who consented to participate formed the study sample.
A study team member interviewed investigators who gave consent and administered the checklist and questionnaire to them.
- The proportion of sites compliant with the QCI recommendations
- The most frequent challenges faced by investigators during clinical trial conduct.
Descriptive statistics was used. The responses to each question in the checklist were analyzed, and the compliance was calculated as a proportion. As the number of respondents varied for each question, and answers were descriptive in nature, the percent frequency was calculated as given below:
Percentage frequency = (Frequency/total responses) × 100.
For example: For space-related issues, “lack of space for archival” was found to be the most frequent issue reported by 19 sites and a total of 26 investigators have answered the question, the percent frequency was calculated as 19/26 × 100 = 73.07%
The compliance was rated by us-, 60% - average, 60%–75% - Good, 75% and above - Very Good.
All the analysis was done using Microsoft Excel version 2013 (Publisher: Microsoft Corporation, Redmund, Washington, USA, 2016).
| Results|| |
A total of n = 69 clinical trial sites with 97 investigators were identified. twenty three (75.3%) out of 30 of them had at least 10 years and/or conducted at least five regulatory studies. A total of sixteen (53%) were from public hospitals/institutes while 14 (47%) were from private hospitals/institutes. A total of 12 (40%) were male investigators whereas 18 (60%) were female investigators. Most investigators (28/30, 93.33%) were from clinical medicine specialties, whereas only 02/30 (6.66%) were from para clinical specialties.
Responses to the checklist
A total of 25/30 (83.33%) investigators had adequate space and equipment, 24/30 (70%) had adequate staff., 21/30 had their own SOPs, and regularly conducted educational and training programs for the staff. All sites said they used recently approved version of the ICD, while over 50% (16/30) stated that they informed participants about the risks and benefits in the study during the consent process. The measures taken to ensure protection of participants are summarized in [Figure 1].
|Figure 1: Measures taken at the site for the protection of research participants|
Click here to view
A majority (21/30, 70%) of the study participants were recruited by sites from the outpatient department [Figure 2], and more than 80% of the sites had a safety management plan for the participants. Most sites (14/30, 46.67%) said they reported SAEs within 24 h [Figure 3]. The responses to the some of the major subitems in the checklist are summarized in [Table 1].
|Figure 3: Duration of reporting of serious adverse events seen at the site|
Click here to view
Response to the questionnaire
The clinical trial sites were riddled with several administrative issues in addition to site facilities and infrastructure. Most frequent among these were the lack of timely approvals for studies from IEC (20.68%) and lack of pharmacist at the trial sites (44.11%) and lack of speakers to conduct training sessions for the staff (11.36%). Many sites stated that they could not verify the adequacy of their training (31.81%). Several concerns pertaining to communication with the sponsor were also observed. These were, constant pressure from the sponsor for recruitment (23.52%), and many were of the opinion that CRAs were not appropriately trained (26.47%). The issues pertaining to infrastructure, ethics, and site facilities were common across the majority of the sites and are summarized in [Table 2]. Majority of the investigators (n=14) reported SAEs within 24 hours however, at some sites the duration was variable [Figure 3].
| Discussion|| |
Our study assessed compliance of trial sites (including Investigators/staff) with QCI recommendations and found that most sites showed good compliance with the recommendations.
Give that 80% of sites complied in terms of infrastructure (space, equipment, and staff), it is likely that this has been built by the investigator with help from the pharmaceutical industry and institution over a period given that the city is a hub for regulatory research. The lack of archival space is reflective of the city where space crunch is a known challenge. The high attrition rates may be related to the past downturn as well as inadequate remuneration in academia relative to the pharmaceutical industry and an ill-defined career path. As staff is an important aspect in the capacity building, at the site, defining career paths and adequate remuneration at hospitals/Institutions and creation of clinical research secretariats would help retain them in academia.
SOPs remain a key challenge with inadequate updation and lack of training. The main reasons for nonconduct of training stated were nonavailability of time and lack of experts/faculty for training. Most of the sites were tertiary referral hospitals/centers attached to medical colleges with investigators handling several studies at the same time along with routine patient care. Administrative difficulties such as nonavailability of funds and timely approvals for the study, as seen for the study, were also key issues. Introduction in the academia of “dedicated/protected research time” could be a possible solution.
The delayed reporting of the SAEs to the site by the participants/relatives was another issue that has been now addressed by the sixth amendment to the drugs and cosmetics rules which states that “the investigator should report all SAEs to the drug regulatory body of India (DCGI), sponsor of the trial, and the concerned EC that approved the trial protocol within 24 h of occurrence of the SAE.”
Many investigators and sites did not have a database of participants and faced difficulties during recruitment. In regulatory studies, in addition to these difficulties, investigators mentioned that the recruitment procedure is made difficult by the “technical language” of the Informed Consent forms. This makes recruitment of participants especially those with poor literacy challenging.,, A study conducted by Michael Pascha et al. recommended that the informed consent must have the readability of 4th grade to ensure that participants understand it and autonomy is maintained and use of lucid language for drafting the ICDs should be encouraged. There is a need for investigators to work with the pharmaceutical industry to develop consent forms that are comprehensible. The ethics committees also play a key role here. However, complex study protocols (oncology, for example) in multinational studies could still prove to be a challenge.,,
We found that investigators stated an increased reliance on physician by the participants to take decision regarding participation. Our observation is similar to a study conducted by Doshi et al., where the majority of the patient participants stated that the reason for participation was because “my doctor asked me to.” Another important operational issue highlighted was the “lack of a dedicated pharmacist at the site.” A pharmacist apart from investigational product management can play a crucial role in convincing the participants about adherence to the protocol and medication compliance during trials. We also found issues such as nondocumentation of the photocopy of the ICD to the patients, lack of data backup, and internal monitoring which could compromise the quality of documentation and data integrity. Previously published Inspection and audit findings have often cited documentation deficiencies and adequate steps must be taken to address them.
The study is limited by the fact that no physical verification of the sites was done, the study time frame was short and the systems were only assessed through the checklist and questionnaire. Also, the study observations are restricted to only Mumbai and other regions/cities of the country were not studied. The study has been carried over a limited period of over 2 years (2016 and 2017), and the data generated through this research represents the scenario of that time.
In summary, the investigator has numerous responsibilities during the conduct of clinical trials and is on the “frontline” while ensuring that the rights, safety, and well-being of study participants are protected. However, the discharge of these responsibilities requires a coordinated effort between all the stakeholders, including sponsors, to further improve clinical trial conduct.
| Conclusion|| |
The existing systems at the sites are in compliance with the QCI recommendations however, there are several deficiencies within these systems which could be addressed by developing site-specific guidelines. Such an initiative could be taken at the institute level.
We are grateful to Dr V Singh for the assistance in analysis for the qualitative data. We are also grateful to all the participants in the study for taking time out and filling the questionnaire. Thanks are also due to the Dean, Seth GS Medical College and KEM Hospital for giving the facilities to carry out the work.
Financial support and sponsorship
Conflicts of interest
There are no conflicts of interest.
| References|| |
Pereira P. Quality in Clinical research activities. Role of instituition/clinical trial site. J. Nat Accred Board Hosp Healthcare Providers 2015;2:4-8.
Ayre C, Scally A. Critical values for Lawshe's content validity ratio: Revisiting the original methods of calculation. Meas Eval Couns Develop 2014;47:79-86.
Tavakol M, Dennick R. Making sense of Cronbach's alpha. Int J Med Educ 2011;2:53-5.
Thatte UM, Bavdekar SB. Clinical research in India: Great expectations? J Postgrad Med 2008;54:318-23.
] [Full text]
Fredman SJ, Baucom DH, Gremore TM, Castellani AM, Kallman TA, Porter LS, et al
. Quantifying the recruitment challenges with couple-based interventions for cancer: Applications to early-stage breast cancer. Psychooncology 2009;18:667-73.
Kern SE. Challenges in conducting clinical trials in children: Approaches for improving performance. Expert Rev Clin Pharmacol 2009;2:609-17.
Frank G. Current challenges in clinical trial patient recruitment and enrollment. SOCRA Source. 2004:30-8. [Google Scholar].
Kadam RA, Borde SU, Madas SA, Salvi SS, Limaye SS. Challenges in recruitment and retention of clinical trial subjects. Perspect Clin Res 2016;7:137-43.
] [Full text]
Paasche-Orlow MK, Taylor HA, Brancati FL. Readability standards for informed-consent forms as compared with actual readability. N Engl J Med 2003;348:721-6.
Doshi MS, Kulkarni SP, Ghia CJ, Gogtay NJ, Thatte UM. Evaluation of factors that motivate participants to consent for non-therapeutic trials in India. J Med Ethics 2013;39:391-6.
Fogel DB. Factors associated with clinical trials that fail and opportunities for improving the likelihood of success: A review. Contemp Clin Trials Commun 2018;11:156-64.
Marwah R, Van de Voorde K, Parchman J. Good clinical practice regulatory inspections: Lessons for Indian investigator sites. Perspect Clin Res 2010;1:151-5.
] [Full text]
[Figure 1], [Figure 2], [Figure 3]
[Table 1], [Table 2]