

STATISTICS 

Year : 2016  Volume
: 7
 Issue : 4  Page : 187190 

Common pitfalls in statistical analysis: The use of correlation techniques
Rakesh Aggarwal^{1}, Priya Ranganathan^{2}
^{1} Department of Gastroenterology, Sanjay Gandhi Postgraduate Institute of Medical Sciences, Lucknow, Uttar Pradesh, India ^{2} Department of Anaesthesiology, Tata Memorial Centre, Mumbai, Maharashtra, India
Date of Web Publication  12Oct2016 
Correspondence Address: Priya Ranganathan Department of Anaesthesiology, Tata Memorial Centre, Ernest Borges Road, Parel, Mumbai  400 012, Maharashtra India
Source of Support: None, Conflict of Interest: None  Check 
DOI: 10.4103/22293485.192046
Abstract   
Correlation is a statistical technique which shows whether and how strongly two continuous variables are related. In this article, which is the eighth part in a series on 'Common pitfalls in Statistical Analysis', we look at the interpretation of the correlation coefficient and examine various situations in which the use of technique of correlation may be inappropriate.
Keywords: Biostatistics, correlation, "data interpretation, statistical"
How to cite this article: Aggarwal R, Ranganathan P. Common pitfalls in statistical analysis: The use of correlation techniques. Perspect Clin Res 2016;7:18790 
Introduction   
We often have information on two numeric characteristics for each member of a group and are interested in finding the degree of association between these characteristics. For instance, an obstetrician may decide to look up the records of women who delivered in her hospital in the previous year to find out whether there is a relationship between their family incomes and the birth weights of their babies. The relationship here means whether the two variables fluctuate together, i.e., does the birth weight increase (or decrease) as the income increases. "Correlation" is a statistical tool used to assess the degree of association of two quantitative variables measured in each member of a group. Although it is a very commonly used tool in medical literature, it is also often misunderstood. This piece describes what "correlation" implies and the situations in which it may be used, as also its pitfalls and the situations where it should not be used. To illustrate various concepts, we use scatter plots, a graphical method of showing values of two variables for each individual in a group.
Measurement of correlation: Correlation coefficient   
The degree of correlation between any two variables on a continuous scale is mathematically expressed as the correlation coefficient (also known as Pearson's correlation coefficient or "r0"), a number whose values can vary between −1.0 and +1.0. Thus, it has a sign (+ or −) and a magnitude.
Direction
Two variables are said to be "positively" correlated [Figure 1]ac when their values change in tandem, i.e., increasing values of one are associated with increasing values of the other. By contrast, a "negative" correlation [Figure 1]df exists when increasing values of one variable are associated with a decrease in the values of the other. Variables with no or little discernible relationship [Figure 1]g are said to have "no correlation."  Figure 1: Scatter plots of relationship between values of two quantitative variables and their corresponding correlation coefficient (r) values. "r " can vary between − 1.0 and + 1.0. If as the values of one variable (say on Xaxis) increase, those of the other variable (on Yaxis) increase, "r " is positive (ac); however, if the latter decrease, "r " is negative (df). When the values of two variables have no clear relation, "r " is zero (g). The absolute values of "r " are higher when the individual data points are closer to a line showing the linear trend (a > b > c; d > e > f)
Click here to view 
Magnitude
The absolute value of r represents the strength of association. A value of 1.0 implies a perfect linear relationship between the two variables, i.e., all observations lie on a straight line [Figure 1]a and d, whereas 0 indicates the absence of any linear relationship [Figure 1]g. Higher values (closer to 1.0) imply that individual observations lie close to an imaginary line describing the relationship between the two variables [Figure 1]b and e, and lower values imply that the observations are more spread out [Figure 1]c and f.
Interpretation of value of correlation coefficient   
Square of correlation coefficient (r^{2} ), known as coefficient of determination, represents the proportion of variation in one variable that is accounted for by the variation in the other variable. For example, if height and weight of a group of persons have a correlation coefficient of 0.80, one can estimate that 64% (0.80 × 0.80 = 0.64) of variation in their weights is accounted for by the variation in their heights.
It is possible to calculate P value for an observed correlation coefficient to determine whether a significant linear relationship exists between the two variables of interest or not. However, with medium to largesized samples, these methods show even small correlation coefficients to be highly significant and hence their use is generally eschewed.
When should correlation not be used?   
 The correlation coefficient looks for a linear relationship. Hence, it can be fallacious in situations where two variables do have a relationship, but it is nonlinear. For instance, handgrip strength initially increases with age (through childhood and adolescence) and then declines (e.g., [Figure 2]a). In such cases, "r" could be low ( r = 0 for the data in [Figure 2]a), even though there is a clear relationship.
 Figure 2: Situations in which linear correlation should not be used: (a) two variables have a relationship which is nonlinear (analysis of data points in this figure shows r = 0, thus failing to detect the relationship), (b) the data have one or a few outliers (one outlier at right upper end resulted in a false relationship with r = 0.71; exclusion of this point reduces r to near zero), (c) when the data have two subgroups, within each of which there is no correlation, and (d) when variability in values on Yaxis changes with values on Xaxis. Each situation is described further in the text
Click here to view 
 Correlation analysis assumes that all the observations are independent of each other. Thus, it should not be used if the data include more than one observation on any individual. For instance, in the above example, if handgrip strength had been measured twice in some subjects that would be an additional reason not to use correlation analysis.
 If one (or a few) individual observation in the sample is an outlier, i.e., located far away from the others, it may introduce a false sense of relationship [Figure 2]b. Please note that the data points in this figure are identical to those in [Figure 1]g, except for the addition of one outlier. On excluding this outlier, the value of r would drop from 0.71 to 0!
 If the dataset has two subgroups of individuals whose values for one or both variables differ from each other [Figure 2]c, this can lead to a false sense of relationship overall, even when none exists within each subgroup. For instance, let us consider a group of 20 men and 20 women. If one plots their heights (on Xaxis) and hemoglobin levels (on Yaxis), most women may end up in the left lower corner (shorter and lower hemoglobin) and most men in the right upper corner (taller and higher hemoglobin), suggesting a false relationship (a positive "r" value) between height and hemoglobin levels.
 With very small sample size (say 36 observations), a relationship may appear to be present even though none exists.
 Linear correlation analysis applies only to data on a continuous scale. It should not be used when one or both variables have been measured using an ordinal scale, for example, patients' assessment of pain severity on a scale of 010, where higher number means worse pain but similar differences (say from 1 to 3 and from 6 to 8) do not necessarily imply similar change in pain. In these cases, a Spearman's rank correlation method should be used.
 Relationship between a variable and one of its components (e.g., aggregate marks vs. marks in one subject). For instance, it would be fallacious to use correlation to assess the relationship of height of a group of persons with the lengths of their body's lower segments since the lower segment forms a part of the overall height.
 Heteroscedasticity or a situation in which the one variable has unequal variability across the range of values of a second variable. For instance, if one looks at the relationship of annual health expenditure versus the annual income of a family, the former is likely to vary more for richer persons than for poor persons [Figure 2]d.
Many of the above pitfalls are easily avoided if one first makes a scatter plot for the data and visually inspects it for nonlinear relationships, outliers, or presence of obvious subgroups.
In addition, correlation analysis is also often inappropriately used to measure agreement between two methods of measuring the same thing (e.g., tumor volume measured using ultrasound and computed tomography). This will be discussed in the next article in this series.
A final caution: Correlation does not mean causation   
A relationship between two variables is sometimes taken as evidence that one causes the other. This is, however, often not true, and hence the popular statistical adage: "Correlation does not imply causation." You may wish to visit https://en.wikipedia.org/wiki/Correlation_does_not_imply_causation for some interesting insights into how correlation can arise without any causative link.
Examples of such noncausative correlation include (i) countries' annual per capita chocolate consumption and the number of Nobel laureates per 10 million population; ^{[1]} (ii) weekly icecream consumption and a number of drowning incidents in swimming pools. These are due to the association of both the variables being studied to national income ^{[2]} and hot weather, respectively.
Endpiece   
Correlation analysis is a very powerful tool to explore relationships in data. However, one must be careful to use it only when it is applicable. Many of these problems can be avoided by a careful thought about the data, plotting the raw data (to look for nonlinear relationships, outliers, and heteroscedasticity of data), and by thinking in terms of coefficient of determination in preference to the correlation coefficient.
Financial support and sponsorship
Nil.
Conflicts of interest
There are no conflicts of interest.
References   
1.  Messerli FH. Chocolate consumption, cognitive function, and Nobel laureates. N Engl J Med 2012;367:15624. [ PUBMED] 
2.  Maurage P, Heeren A, Pesenti M. Does chocolate consumption really boost Nobel Award chances? The peril of overinterpreting correlations in health studies. J Nutr 2013;143:9313. [ PUBMED] 
[Figure 1], [Figure 2]
This article has been cited by  1 
Disparities in depression among Chinese older adults with neurodegenerative diseases 

 Zhichao Hao,Nicole Ruggiano,Qingyi Li,Yuqi Guo,Xiaofu Pan   Aging & Mental Health. 2021; : 1   [Pubmed]  [DOI]   2 
Red cell distribution width and erythrocyte osmotic stability in type 2 diabetes mellitus 

 Maria Aparecida Knychala,Mario da Silva GarroteFilho,Breno Batista da Silva,Samantha Neves de Oliveira,Sarah Yasminy Luz,Manuela Ortega Marques Rodrigues,Nilson PenhaSilva   Journal of Cellular and Molecular Medicine. 2021;   [Pubmed]  [DOI]   3 
Minimal Clinically Important Differences for Measures of Pain, Lung Function, Fatigue, and Functionality in Spinal Cord Injury 

 Margarida Sobreira,Miguel P Almeida,Ana Gomes,Marlene Lucas,Ana Oliveira,Alda Marques   Physical Therapy. 2021; 101(2)   [Pubmed]  [DOI]   4 
Fos expression in the medial preoptic area and nucleus accumbens of female Japanese quail (Coturnix japonica) after maternal induction and interaction with chicks 

 Joseph S. Lonstein,Thierry D. Charlier,Jodi L. Pawluski,Nadege Aigueperse,Maryse Meurisse,Frédéric Lévy,Sophie Lumineau   Physiology & Behavior. 2021; : 113357   [Pubmed]  [DOI]   5 
Intoxication Effects on Impulsive Alcohol Choice in Heavy Drinkers: Correlation With Sensation Seeking and Differential Effects by Commodity 

 Brandon G. Oberlin,Claire R. Carron,Nolan E. Ramer,Martin H. Plawecki,Sean J. O’Connor,David A. Kareken   Alcoholism: Clinical and Experimental Research. 2020;   [Pubmed]  [DOI]   6 
The role of selfcontrol, hope and information in technology adoption by smallholder farmers – A moderation model 

 Shira Bukchin,Dorit Kerret   Journal of Rural Studies. 2020;   [Pubmed]  [DOI]   7 
LINSPECTOR: Multilingual Probing Tasks for Word Representations 

 Gözde Gül Sahin,Clara Vania,Ilia Kuznetsov,Iryna Gurevych   Computational Linguistics. 2020; : 1   [Pubmed]  [DOI]   8 
Agroview: Cloudbased application to process, analyze and visualize UAVcollected data for precision agriculture applications utilizing artificial intelligence 

 Yiannis Ampatzidis,Victor Partel,Lucas Costa   Computers and Electronics in Agriculture. 2020; 174: 105457   [Pubmed]  [DOI]   9 
An empirical analysis of source code metrics and smart contract resource consumption 

 Nemitari Ajienka,Peter Vangorp,Andrea Capiluppi   Journal of Software: Evolution and Process. 2020;   [Pubmed]  [DOI]   10 
Studying internet addiction profile of university students with latent class analysis 

 Irshad Hussain,Ozlem Cakir,Burhanettin Ozdemir   Education and Information Technologies. 2020;   [Pubmed]  [DOI]   11 
Respiratory Function and Upper Extremity Functional Activity Performance in People With Dementia: A Shout for Attention 

 Cátia Paixão,Ana Tavares,Alda Marques   Journal of Aging and Physical Activity. 2020; : 1   [Pubmed]  [DOI]   12 
Cuestionario HoneyAlonso de Estilos de Aprendizaje: Nuevas evidencias psicométricas en población argentina 

 Agustín Freiberg Hoffmann,Facundo Abal,Mercedes Fernández Liporace   Acta Colombiana de Psicología. 2020; 23(2): 328   [Pubmed]  [DOI]   13 
Species delimitation, environmental cline and phylogeny for a new Neotropical genus of Cryptinae (Ichneumonidae) 

 Fernanda A. Supeleto,Bernardo F. Santos,Leandro A. Basilio,Alexandre P. Aguiar,Michael Schubert   PLOS ONE. 2020; 15(10): e0237233   [Pubmed]  [DOI]   14 
Cuestionario HoneyAlonso de Estilos de Aprendizaje: Nuevas evidencias psicométricas en población argentina 

 Agustín Freiberg Hoffmann,Facundo Abal,Mercedes Fernández Liporace   Acta Colombiana de Psicología. 2020; 23(2): 328   [Pubmed]  [DOI]   15 
Minimal Clinically Important Differences for PatientReported Outcome Measures of Fatigue in Patients With COPD Following Pulmonary Rehabilitation 

 Patrícia Rebelo,Ana Oliveira,Lília Andrade,Carla Valente,Alda Marques   Chest. 2020;   [Pubmed]  [DOI]   16 
Comparison between DiffusionWeighted Sequences with Selective and NonSelective Fat Suppression in the Evaluation of Crohn’s Disease Activity: Are They Equally Useful? 

 Ilze Apine,Reinis Pitura,Ivanda Franckevica,Juris Pokrotnieks,Gaida Krumina   Diagnostics. 2020; 10(6): 347   [Pubmed]  [DOI]   17 
Agedependent changes in bone mineral density for males and females aged 1080 years 

 Hamzah M. Hamid,Khalid Gh. Majeed,Saeed H. Saeed   IOP Conference Series: Materials Science and Engineering. 2020; 928: 072052   [Pubmed]  [DOI]   18 
Alchemical Hydration FreeEnergy Calculations Using Molecular Dynamics with Explicit Polarization and Induced Polarity Decoupling: An On–the–Fly Polarization Approach 

 Braden D. Kelly,William R. Smith   Journal of Chemical Theory and Computation. 2020;   [Pubmed]  [DOI]   19 
Behavioral Health at School: Do Three Competences in Road Safety Education Impact the Protective Road Behaviors of Spanish Children? 

 Francisco Alonso,Adela GonzalezMarin,Cristina Esteban,Sergio A. Useche   International Journal of Environmental Research and Public Health. 2020; 17(3): 935   [Pubmed]  [DOI]   20 
Selfreported campus alcohol policy and college alcohol consumption: a multilevel analysis of 4592 Korean students from 82 colleges 

 Sarah Soyeon Oh,Yeong Jun Ju,Sungin Jang,EunCheol Park   Substance Abuse Treatment, Prevention, and Policy. 2020; 15(1)   [Pubmed]  [DOI]   21 
A Simple Method for Including Polarization Effects in Solvation Free Energy Calculations When Using FixedCharge Force Fields: Alchemically Polarized Charges 

 Braden D. Kelly,William R. Smith   ACS Omega. 2020;   [Pubmed]  [DOI]   22 
Review of noninvasive intracranial pressure measurement techniques for ophthalmology applications 

 David Andrew Price,Andrzej Grzybowski,Jennifer Eikenberry,Ingrida Januleviciene,Alice Chandra Verticchio Vercellin,Sunu Mathew,Brent Siesky,Alon Harris   British Journal of Ophthalmology. 2020; 104(7): 887   [Pubmed]  [DOI]   23 
Optical Quality Assessment in Patients with Macular Diseases Using Optical Quality Analysis System 

 Joon Hee Cho,So Hyun Bae,Ha Kyoung Kim,Young Joo Shin   Journal of Clinical Medicine. 2019; 8(6): 892   [Pubmed]  [DOI]   24 
Correlation of surgical trainee performance on laparoscopic versus endoscopic simulation 

 Jennifer Koichopolos,Jeffrey Hawel,Eran Shlomovitz,Ilay Habaz,Ahmad Elnahas,Nawar A. Alkhamesi,Christopher M. Schlachta   Surgical Endoscopy. 2019;   [Pubmed]  [DOI]   25 
The effect of test modality on dynamic exercise biomarkers in children, adolescents, and young adults 

 Ronen BarYoseph,Janos Porszasz,Shlomit RadomAizik,Annamarie Stehli,Pearl Law,Dan M. Cooper   Physiological Reports. 2019; 7(14)   [Pubmed]  [DOI]   26 
Prediction of Alkanolamine pKa Values by Combined Molecular Dynamics Free Energy Simulations and ab Initio Calculations 

 Javad Noroozi,William R. Smith   Journal of Chemical & Engineering Data. 2019;   [Pubmed]  [DOI]   27 
A new approach to estimate aerobic fitness using the NHANES dataset 

 Kim D. Lu,Ronen BarYoseph,Shlomit RadomAizik,Dan M. Cooper   Scandinavian Journal of Medicine & Science in Sports. 2019;   [Pubmed]  [DOI]   28 
Minimal Important and Detectable Differences of Respiratory Measures in Outpatients with AECOPD† 

 Ana Oliveira,Ana Machado,Alda Marques   COPD: Journal of Chronic Obstructive Pulmonary Disease. 2018; : 1   [Pubmed]  [DOI]   29 
Decreased waterborne pathogenic bacteria in an urban aquifer related to intense shallow geothermal exploitation 

 Alejandro GarcíaGil,Samanta GascoCavero,Eduardo Garrido,Miguel Mejías,Jannis Epting,Mercedes NavarroElipe,Carmen Alejandre,Elena SevillaAlcaine   Science of The Total Environment. 2018; 633: 765   [Pubmed]  [DOI]  



