<p><div><div><div><div data-width="100" data-show-faces="false" data-send="true" data-layout="button_count" data-height="21" data-href="https://www.r-bloggers.com/data-science-for-doctors-inferential-statistics-exercisespart-4/"></div></div><div></div></div><div></div></div>
<div>
(This article was first published on <strong><a href="http://r-exercises.com/2017/04/02/data-science-for-doctors-inferential-statistics-part4/?utm_source=rss&utm_medium=rss&utm_campaign=data-science-for-doctors-inferential-statistics-part4"> R-exercises</a></strong>, and kindly contributed to <a rel="nofollow" href="https://www.r-bloggers.com/">R-bloggers)</a> </div>
<p><a target="_blank" rel="nofollow" href="http://r-exercises.com/wp-content/uploads/2017/01/Selection_047.png?x61433"><img sizes="(max-width: 150px) 100vw, 150px" alt="" class="wp-image-4312" src="https://i1.wp.com/r-exercises.com/wp-content/uploads/2017/01/Selection_047-150x150.png?resize=150%2C150" data-recalc-dims="1"></a><br>
Data science enhances people’s decision making. Doctors and researchers are making critical decisions every day. Therefore, it is absolutely necessary for those people to have some basic knowledge of data science. This series aims to help people that are around medical field to enhance their data science skills.</p>
<p>We will work with a health related database the famous “Pima Indians Diabetes Database”. It was generously donated by Vincent Sigillito from Johns Hopkins University. Please find further information regarding the dataset <a target="_blank" rel="nofollow" href="https://archive.ics.uci.edu/ml/machine-learning-databases/pima-indians-diabetes/pima-indians-diabetes.names">here</a>.</p>
<p>This is the seventh part of the series and it aims to cover partially the subject of Inferential statistics.<br>
Researchers rarely have the capability of testing many patients,or experimenting a new treatment to many patients, therefore making inferences out of a sample is a necessary skill to have. This is where inferential statistics comes into play.<br>
In more detail, in this part we will go through the hypothesis testing for F-distribution (<a target="_blank" rel="nofollow" href="https://en.wikipedia.org/wiki/F-test">F-test</a>), and Chi-squared distribution (<a target="_blank" rel="nofollow" href="https://en.wikipedia.org/wiki/Chi-squared_test">Chi-squared test</a>). If you are not aware of what are the mentioned distributions please go <a target="_blank" rel="nofollow" href="http://r-exercises.com/2017/02/12/data-science-for-doctors-part-3-distributions/">here</a> to acquire the necessary background. The assumption of the t-test (we covered it last time <a target="_blank" rel="nofollow" href="http://r-exercises.com/2017/03/27/data-science-for-doctors-inferential-statistics-exercises-part-3">here</a>) is that the two population variances are equal. Such an assumption can serve as a null hypothesis for F-test. Moreover sometimes it happens that we want to test a hypothesis with respect to more than one probability, here is where Chi-Squared test comes into play.</p>
<p>Before proceeding, it might be helpful to look over the help pages for the <code>sd</code>, <code>var</code>, <code>var.test</code>, <code>chisq.test</code>. </p>
<p>Please run the code below in order to load the data set and transform it into a proper data frame format:</p>
<p><code>url &lt;- &quot;https://archive.ics.uci.edu/ml/machine-learning-databases/pima-indians-diabetes/pima-indians-diabetes.data&quot;</code><br>
<code>data &lt;- read.table(url, fileEncoding=&quot;UTF-8&quot;, sep=&quot;,&quot;)</code><br>
<code>names &lt;- c('preg', 'plas', 'pres', 'skin', 'test', 'mass', 'pedi', 'age', 'class')</code><br>
<code>colnames(data) &lt;- names</code><br>
<code>data &lt;- data[-which(data$mass ==0),]</code></p>
<p>Moreover run the chunk below in order to generate the samples that we will test on this set of exercises.<br>
<code>f_1 &lt;- rnorm(28,29,3)</code><br>
<code>f_2 &lt;- rnorm(23,29,6)</code></p>
<p>Answers to the exercises are available <a target="_blank" rel="nofollow" href="http://r-exercises.com/2017/04/02/data-science-for-doctors-inferential-statistics-solutionspart-4">here</a>.</p>
<p>If you obtained a different (correct) answer than those listed on the solutions page, please feel free to post your answer as a comment on that page.</p>
<p>Exercise 1</p>
<p>Compute the F-statistic. (test statistic for F-test)</p>
<p>Exercise 2</p>
<p>Compute the degrees of freedom for the numerator and denominator.</p>
<p>Exercise 3</p>
<p>Apply a two-sided F-test for the two samples</p>
<p>Exercise 4</p>
<p>Apply a one-sided F-test for the two samples with the alternative hypothesis to be that the standard deviation of the first sample is smaller than the second.</p>
<p>Exercise 5</p>
<p>Retrieve the p-value and the ratio of variances for both tests.</p>
<p>Exercise 6</p>
<p>Find the number of patients who show signs of diabetes and those who don’t.</p>
<p>Exercise 7</p>
<p>Assume that the hypothesis we made is that 10% of people show signs of diabetes. Is that a valid claim to make? Test it using the chi-squared test.</p>
<p>Exercise 8</p>
<p>Suppose that the <code>mass</code> index affects whether the patients show signs of diabetes and we assume that the people who weight more than the average are more likely to have diabetes signs. Make a matrix that contains the true-positives, false-positives, true-negatives, and false-negatives of our hypothesis.<br>
hint: True-positive: <code>data$class==1 &amp; data$mass >= mean(data$mass)</code></p>
<p>Exercise 9</p>
<p>Test the hypothesis we made at exercise 8 using chi-squared test. </p>
<p>Exercise 10</p>
<p>The hypothesis we made at exercise 8 cannot be validated, however we have noticed that the dataset contains outliers which affect the average. Therefore we make another assumption that patients who are heavier than the 25% lightest of the patients are more likely to have signs of diabetes. Test that hypothesis.<br>
hint: it is similar to the process we did at exercises 8 and 9 but with different criteria.</p>
<div>
<h3>Related exercise sets:</h3>
<ol>
<li><a title="Data Science for Doctors – Part 1 : Data Display" target="_blank" rel="nofollow" href="http://r-exercises.com/2017/01/29/data-science-for-doctors-part-1-data-display/">Data Science for Doctors – Part 1 : Data Display </a></li>
<li><a title="Data science for Doctors: Inferential Statistics Exercises (part-2)" target="_blank" rel="nofollow" href="http://r-exercises.com/2017/03/19/data-science-for-doctors-inferential-statistics-exercises-part-2/">Data science for Doctors: Inferential Statistics Exercises (part-2) </a></li>
<li><a title="Data science for Doctors: Inferential Statistics Exercises (part-3)" target="_blank" rel="nofollow" href="http://r-exercises.com/2017/03/27/data-science-for-doctors-inferential-statistics-exercises-part-3/">Data science for Doctors: Inferential Statistics Exercises (part-3) </a></li>
<li><a target="_blank" rel="nofollow" href="http://r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li>
<li><a target="_blank" rel="nofollow" href="http://r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li>
</ol>
</div>
<p>
<div>
<div>To <strong>leave a comment</strong> for the author, please follow the link and comment on their blog: <strong><a href="http://r-exercises.com/2017/04/02/data-science-for-doctors-inferential-statistics-part4/?utm_source=rss&utm_medium=rss&utm_campaign=data-science-for-doctors-inferential-statistics-part4"> R-exercises</a></strong>.</div>
<hr>
<a rel="nofollow" href="https://www.r-bloggers.com/">R-bloggers.com</a> offers <strong><a rel="nofollow" href="https://feedburner.google.com/fb/a/mailverify?uri=RBloggers">daily e-mail updates</a></strong> about <a title="The R Project for Statistical Computing" rel="nofollow" href="https://www.r-project.org/">R</a> news and <a title="R tutorials" rel="nofollow" href="https://www.r-bloggers.com/search/tutorial">tutorials</a> on topics such as: <a title="Data science" rel="nofollow" href="https://www.r-bloggers.com/search/data%20science">Data science</a>, <a title="Big Data" rel="nofollow" href="https://www.r-bloggers.com/search/Big%20Data">Big Data, <a title="R jobs" rel="nofollow" href="https://www.r-users.com/">R jobs</a>, visualization (<a title="ggplot and ggplot2 tutorials" rel="nofollow" href="https://www.r-bloggers.com/search/ggplot2">ggplot2</a>, <a title="Boxplots using lattice and ggplot2 tutorials" rel="nofollow" href="https://www.r-bloggers.com/search/boxplot">Boxplots</a>, <a title="Maps and gis" rel="nofollow" href="https://www.r-bloggers.com/search/map">maps</a>, <a title="Animation in R" rel="nofollow" href="https://www.r-bloggers.com/search/animation">animation</a>), programming (<a title="RStudio IDE for R" rel="nofollow" href="https://www.r-bloggers.com/search/RStudio">RStudio</a>, <a title="Sweave and literate programming" rel="nofollow" href="https://www.r-bloggers.com/search/sweave">Sweave</a>, <a title="LaTeX in R" rel="nofollow" href="https://www.r-bloggers.com/search/LaTeX">LaTeX</a>, <a title="SQL and databases" rel="nofollow" href="https://www.r-bloggers.com/search/SQL">SQL</a>, <a title="Eclipse IDE for R" rel="nofollow" href="https://www.r-bloggers.com/search/eclipse">Eclipse</a>, <a title="git and github, Version Control System" rel="nofollow" href="https://www.r-bloggers.com/search/git">git</a>, <a title="Large data in R using Hadoop" rel="nofollow" href="https://www.r-bloggers.com/search/hadoop">hadoop</a>, <a title="Web Scraping of google, facebook, yahoo, twitter and more using R" rel="nofollow" href="https://www.r-bloggers.com/search/Web+Scraping">Web Scraping</a>) statistics (<a title="Regressions and ANOVA analysis tutorials" rel="nofollow" href="https://www.r-bloggers.com/search/regression">regression</a>, <a title="principal component analysis tutorial" rel="nofollow" href="https://www.r-bloggers.com/search/PCA">PCA</a>, <a title="Time series" rel="nofollow" href="https://www.r-bloggers.com/search/time+series">time series</a>, <a title="finance trading" rel="nofollow" href="https://www.r-bloggers.com/search/trading">trading</a>) and more...
<img height="1" alt="" width="1" src="http://feeds.feedburner.com/~r/RBloggers/~4/_FTa1XcixXM"></a></div>