<p><div><div><div><div data-width="100" data-show-faces="false" data-send="true" data-layout="button_count" data-height="21" data-href="https://www.r-bloggers.com/data-science-for-doctors-inferential-statistics-exercisespart-5/"></div></div><div></div></div><div></div></div>
<div>
(This article was first published on <strong><a href="http://www.r-exercises.com/2017/04/16/data-science-for-doctors-inferential-statistics-exercisespart-5/?utm_source=rss&utm_medium=rss&utm_campaign=data-science-for-doctors-inferential-statistics-exercisespart-5"> R-exercises</a></strong>, and kindly contributed to <a rel="nofollow" href="https://www.r-bloggers.com/">R-bloggers)</a> </div>
<p><a target="_blank" rel="nofollow" href="https://i2.wp.com/r-exercises.com/wp-content/uploads/2017/01/Selection_047.png"><img sizes="(max-width: 150px) 100vw, 150px" alt="" class="wp-image-4312" src="https://i1.wp.com/r-exercises.com/wp-content/uploads/2017/01/Selection_047-150x150.png?resize=150%2C150" data-recalc-dims="1"></a><br>
Data science enhances people’s decision making. Doctors and researchers are making critical decisions every day. Therefore, it is absolutely necessary for those people to have some basic knowledge of data science. This series aims to help people that are around medical field to enhance their data science skills.</p>
<p>We will work with a health related database the famous “Pima Indians Diabetes Database”. It was generously donated by Vincent Sigillito from Johns Hopkins University. Please find further information regarding the dataset <a target="_blank" rel="nofollow" href="https://archive.ics.uci.edu/ml/machine-learning-databases/pima-indians-diabetes/pima-indians-diabetes.names">here</a>.</p>
<p>This is the eighth part of the series and it aims to cover partially the subject of Inferential statistics.<br>
Researchers rarely have the capability of testing many patients,or experimenting a new treatment to many patients, therefore making inferences out of a sample is a necessary skill to have. This is where inferential statistics comes into play.<br>
In more detail, in this part we will go through the hypothesis testing for testing the normality of distributions(<a target="_blank" rel="nofollow" href="https://en.wikipedia.org/wiki/Shapiro%E2%80%93Wilk_test">Shapiro–Wilk test</a>, <a target="_blank" rel="nofollow" href="https://en.wikipedia.org/wiki/Anderson%E2%80%93Darling_test">Anderson–Darling test</a>.), the existence of outliers(<a target="_blank" rel="nofollow" href="https://en.wikipedia.org/wiki/Grubbs%27_test_for_outliers">Grubbs’ test for outliers</a>). We will also cover the case that normality assumption doesn’t hold and how to deal with it(&lt;a href=&quot;https://en.wikipedia.org/wiki/Rank_test&quot; Rank tests). Finally we will do a brief recap of the previous exercises on inferential statistics.</p>
<p>Before proceeding, it might be helpful to look over the help pages for the <code>hist</code>, <code>qqnorm</code>, <code>qqline</code>, <code>shapiro.test</code>, <code>ad.test</code>, <code>grubbs.test</code>, <code>wilcox.test</code>.</p>
<p>Moreover please load the following libraries.<br>
<code>install.packages(&quot;ggplot2&quot;)</code><br>
<code>library(ggplot2)</code><br>
<code>install.packages(&quot;nortest&quot;)</code><br>
<code>library(nortest)</code><br>
<code>install.packages(&quot;outliers&quot;)</code><br>
<code>library(outliers)</code></p>
<p>Please run the code below in order to load the data set and transform it into a proper data frame format:</p>
<p><code>url &lt;- &quot;https://archive.ics.uci.edu/ml/machine-learning-databases/pima-indians-diabetes/pima-indians-diabetes.data&quot;</code><br>
<code>data &lt;- read.table(url, fileEncoding=&quot;UTF-8&quot;, sep=&quot;,&quot;)</code><br>
<code>names &lt;- c('preg', 'plas', 'pres', 'skin', 'test', 'mass', 'pedi', 'age', 'class')</code><br>
<code>colnames(data) &lt;- names</code><br>
<code>data &lt;- data[-which(data$mass ==0),]</code></p>
<p>Moreover run the chunk below in order to generate the samples that we will test on this set of exercises.<br>
<code>f_1 &lt;- rnorm(28,29,3)</code><br>
<code>f_2 &lt;- rnorm(23,29,6)</code></p>
<p>Answers to the exercises are available <a target="_blank" rel="nofollow" href="http://r-exercises.com/2017/04/16/data-science-for-doctors-inferential-statistics-exercisespart-5-solutions">here</a>.</p>
<p>If you obtained a different (correct) answer than those listed on the solutions page, please feel free to post your answer as a comment on that page.</p>
<p>Exercise 1</p>
<p>Plot an histogram of the variable <code>pres</code>.</p>
<p>Exercise 2</p>
<p>Plot the QQ-plot with a QQ-line for the variable <code>pres</code>.</p>
<p>Exercise 3</p>
<p>Apply a Shapiro-Wilk normality test for the variable <code>pres</code>.</p>
<p>Exercise 4</p>
<p>Apply a Anderson-Darling normality test for the variable <code>pres</code>.</p>
<p>Exercise 5</p>
<p>What is the percentage of <code>data</code> that passes a normality test?<br>
This might be a bit challenging, consider using the apply function.</p>
<div>
<aside><img src="http://www.r-exercises.com/2017/04/16/data-science-for-doctors-inferential-statistics-exercisespart-5/?utm_source=rss&utm_medium=rss&utm_campaign=data-science-for-doctors-inferential-statistics-exercisespart-5"></aside>
<div><strong>Learn more</strong> about Inferential Statistics in the online course <a target="_blank" rel="nofollow" href="http://www.r-exercises.com/product/learn-by-example-statistics-and-data-science-in-r/">Learn By Example: Statistics and Data Science in R</a>. This course includes:
<ul>
<li>6 different case-studies on inferential statistics</li>
<li>Extensive coverage of techniques for inference</li>
<li>And much more</li>
</ul>
</div>
</div>
<p>Exercise 6</p>
<p>Construct a boxplot of <code>pres</code> and see whether there are outliers or not. </p>
<p>Exercise 7</p>
<p>Apply a Grubb’s test on the <code>pres</code> to see whether the variable contains outlier values.</p>
<p>Exercise 8</p>
<p>Apply a two-sided Grubb’s test on the <code>pres</code> to see whether the variable contains outlier values.</p>
<p>Exercise 9</p>
<p>Suppose we test a new diet on a sample of 14 people from the candidates (take a random sample from the set) and after the diet the average mass was 29 with standard deviation of 4 (generate 14 normal distributed samples with the properties mentioned before). Apply Wilcoxon signed rank test for the <code>mass</code> variable before and after the diet.</p>
<p>Exercise 10</p>
<p>Check whether the positive and negative candidates have the same distribution for the <code>pres</code> variable. In order to check that, apply a Wilcoxon rank sum test for the <code>pres</code> variable in respect to the <code>class.fac</code> variable. </p>
<div>
<h3>Related exercise sets:</h3>
<ol>
<li><a title="Data science for Doctors: Inferential Statistics Exercises(Part-4)" target="_blank" rel="nofollow" href="http://www.r-exercises.com/2017/04/02/data-science-for-doctors-inferential-statistics-part4/">Data science for Doctors: Inferential Statistics Exercises(Part-4) </a></li>
<li><a title="Data science for Doctors: Inferential Statistics Exercises (part-2)" target="_blank" rel="nofollow" href="http://www.r-exercises.com/2017/03/19/data-science-for-doctors-inferential-statistics-exercises-part-2/">Data science for Doctors: Inferential Statistics Exercises (part-2) </a></li>
<li><a title="Data science for Doctors: Inferential Statistics Exercises (part-3)" target="_blank" rel="nofollow" href="http://www.r-exercises.com/2017/03/27/data-science-for-doctors-inferential-statistics-exercises-part-3/">Data science for Doctors: Inferential Statistics Exercises (part-3) </a></li>
<li><a target="_blank" rel="nofollow" href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li>
<li><a target="_blank" rel="nofollow" href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li>
</ol>
</div>
<p>
<div>
<div>To <strong>leave a comment</strong> for the author, please follow the link and comment on their blog: <strong><a href="http://www.r-exercises.com/2017/04/16/data-science-for-doctors-inferential-statistics-exercisespart-5/?utm_source=rss&utm_medium=rss&utm_campaign=data-science-for-doctors-inferential-statistics-exercisespart-5"> R-exercises</a></strong>.</div>
<hr>
<a rel="nofollow" href="https://www.r-bloggers.com/">R-bloggers.com</a> offers <strong><a rel="nofollow" href="https://feedburner.google.com/fb/a/mailverify?uri=RBloggers">daily e-mail updates</a></strong> about <a title="The R Project for Statistical Computing" rel="nofollow" href="https://www.r-project.org/">R</a> news and <a title="R tutorials" rel="nofollow" href="https://www.r-bloggers.com/search/tutorial">tutorials</a> on topics such as: <a title="Data science" rel="nofollow" href="https://www.r-bloggers.com/search/data%20science">Data science</a>, <a title="Big Data" rel="nofollow" href="https://www.r-bloggers.com/search/Big%20Data">Big Data, <a title="R jobs" rel="nofollow" href="https://www.r-users.com/">R jobs</a>, visualization (<a title="ggplot and ggplot2 tutorials" rel="nofollow" href="https://www.r-bloggers.com/search/ggplot2">ggplot2</a>, <a title="Boxplots using lattice and ggplot2 tutorials" rel="nofollow" href="https://www.r-bloggers.com/search/boxplot">Boxplots</a>, <a title="Maps and gis" rel="nofollow" href="https://www.r-bloggers.com/search/map">maps</a>, <a title="Animation in R" rel="nofollow" href="https://www.r-bloggers.com/search/animation">animation</a>), programming (<a title="RStudio IDE for R" rel="nofollow" href="https://www.r-bloggers.com/search/RStudio">RStudio</a>, <a title="Sweave and literate programming" rel="nofollow" href="https://www.r-bloggers.com/search/sweave">Sweave</a>, <a title="LaTeX in R" rel="nofollow" href="https://www.r-bloggers.com/search/LaTeX">LaTeX</a>, <a title="SQL and databases" rel="nofollow" href="https://www.r-bloggers.com/search/SQL">SQL</a>, <a title="Eclipse IDE for R" rel="nofollow" href="https://www.r-bloggers.com/search/eclipse">Eclipse</a>, <a title="git and github, Version Control System" rel="nofollow" href="https://www.r-bloggers.com/search/git">git</a>, <a title="Large data in R using Hadoop" rel="nofollow" href="https://www.r-bloggers.com/search/hadoop">hadoop</a>, <a title="Web Scraping of google, facebook, yahoo, twitter and more using R" rel="nofollow" href="https://www.r-bloggers.com/search/Web+Scraping">Web Scraping</a>) statistics (<a title="Regressions and ANOVA analysis tutorials" rel="nofollow" href="https://www.r-bloggers.com/search/regression">regression</a>, <a title="principal component analysis tutorial" rel="nofollow" href="https://www.r-bloggers.com/search/PCA">PCA</a>, <a title="Time series" rel="nofollow" href="https://www.r-bloggers.com/search/time+series">time series</a>, <a title="finance trading" rel="nofollow" href="https://www.r-bloggers.com/search/trading">trading</a>) and more...
<img height="1" alt="" width="1" src="http://feeds.feedburner.com/~r/RBloggers/~4/nWIQSIhMipU"></a></div>