<p><div><div><div><div data-show-faces="false" data-height="21" data-width="100" data-layout="button_count" data-send="true" data-href="https://www.r-bloggers.com/can-we-believe-in-the-imputations/"></div></div><div></div></div><div></div></div>
<div>
(This article was first published on <strong><a href="https://francoishusson.wordpress.com/2017/08/05/can-we-believe-in-the-imputations/"> François Husson</a></strong>, and kindly contributed to <a rel="nofollow" href="https://www.r-bloggers.com/">R-bloggers)</a> </div>
<p>A popular approach to deal with missing values is to impute the data to get a complete dataset on which any statistical method can be applied. Many imputation methods are available and provide a completed dataset in any cases, whatever the number of individuals and/or variables, the percentage of missing values, the pattern of missing values, the relationships between variables, etc.</p>
<p>However, can we believe in these imputations and in the analyses performed on these imputed datasets?</p>
<p>Multiple imputation generates several imputed datasets and the variance between-imputations reflects the uncertainty of the predictions of the missing entries (using an imputation model). In the <strong>missMDA</strong> package we propose a way to visualize the uncertainty associated to the predictions. The rough idea is to project all the multiple imputed datasets on the PCA graphical representations obtained from the “mean” imputed dataset.</p>
<p>For instance, for the incomplete orange data, the two following graphs read as follows: observation 6 has no uncertainty (there is no missing value for this observation) whereas there is more variability on the position of observation 10. For the variables, the clouds of points represent the uncertainties on the predictions. Ellipses as well as clouds are quite small and encourage to carry-on the analysis on the imputed dataset.</p>
<p><img data-orig-file="https://francoishusson.files.wordpress.com/2017/02/missmda_ind_orange.png?w=329&amp;h=328&amp;fit=329%2C328&amp;resize=329%2C328" data-orig-size="561,560" data-medium-file="https://francoishusson.files.wordpress.com/2017/02/missmda_ind_orange.png?w=329&amp;h=328&amp;fit=329%2C328&amp;resize=329%2C328?w=300" data-attachment-id="483" data-image-meta="{" data-image-description="" src="https://francoishusson.files.wordpress.com/2017/02/missmda_ind_orange.png?w=329&h=328&fit=329%2C328&resize=329%2C328" data-permalink="https://francoishusson.wordpress.com/?attachment_id=483" data-large-file="https://francoishusson.files.wordpress.com/2017/02/missmda_ind_orange.png?w=329&amp;h=328&amp;fit=329%2C328&amp;resize=329%2C328?w=561" alt="missMDA_ind_orange" data-image-title="missMDA_ind_orange" sizes="(max-width: 329px) 100vw, 329px" data-comments-opened="1" class="wp-image-483" data-recalc-dims="1"><img data-orig-file="https://francoishusson.files.wordpress.com/2017/02/missmda_var_orange.png?w=346&amp;h=345&amp;fit=346%2C345&amp;resize=346%2C345" data-orig-size="561,560" data-medium-file="https://francoishusson.files.wordpress.com/2017/02/missmda_var_orange.png?w=346&amp;h=345&amp;fit=346%2C345&amp;resize=346%2C345?w=300" data-attachment-id="484" data-image-meta="{" data-image-description="" src="https://francoishusson.files.wordpress.com/2017/02/missmda_var_orange.png?w=346&h=345&fit=346%2C345&resize=346%2C345" data-permalink="https://francoishusson.wordpress.com/?attachment_id=484" data-large-file="https://francoishusson.files.wordpress.com/2017/02/missmda_var_orange.png?w=346&amp;h=345&amp;fit=346%2C345&amp;resize=346%2C345?w=561" alt="missMDA_var_orange" data-image-title="missMDA_var_orange" sizes="(max-width: 346px) 100vw, 346px" data-comments-opened="1" class="wp-image-484" data-recalc-dims="1"></p>
<p>The graphics above where obtained after performing multiple imputation with PCA simply be obtained using the function plot.MIPCA as follows:</p>
<blockquote>
<pre>library(missMDA)
data(orange)
nbdim &lt;- estim_ncpPCA(orange) # estimate the number of dimensions to impute 
res.comp &lt;- MIPCA(orange, ncp = nbdim$ncp, nboot = 1000)
plot(res.comp)</pre>
</blockquote>
<p>Now we have hints to answer the famous questions: “I have a dataset with xx% of missing values, can I impute it with your method?” or “Is 30% of missing values too much or not?” or “<em>What is the maximum percentage of missing values?</em>” Indeed, the percentage of missing values impacts the quality of the imputation but not only! The structure of the data (i.e. the relationships between variables) is very important. It is indeed possible to have small ellipses with a high percentage of missing values and the other way around. That is why these graphs are useful. The following ones suggest that we must be very careful with subsequent analyses on the imputed dataset, and even it suggests stopping the analysis of this dataset. <em>When there’s nothing good to do, it’s better to do nothing!</em></p>
<p><img data-orig-file="https://francoishusson.files.wordpress.com/2017/02/missmda_ind2.png?w=340&amp;h=339&amp;fit=340%2C339&amp;resize=340%2C339" data-orig-size="561,560" data-medium-file="https://francoishusson.files.wordpress.com/2017/02/missmda_ind2.png?w=340&amp;h=339&amp;fit=340%2C339&amp;resize=340%2C339?w=300" data-attachment-id="485" data-image-meta="{" data-image-description="" src="https://francoishusson.files.wordpress.com/2017/02/missmda_ind2.png?w=340&h=339&fit=340%2C339&resize=340%2C339" data-permalink="https://francoishusson.wordpress.com/?attachment_id=485" data-large-file="https://francoishusson.files.wordpress.com/2017/02/missmda_ind2.png?w=340&amp;h=339&amp;fit=340%2C339&amp;resize=340%2C339?w=561" alt="missMDA_ind2" data-image-title="missMDA_ind2" sizes="(max-width: 340px) 100vw, 340px" data-comments-opened="1" class="wp-image-485" data-recalc-dims="1"><img data-orig-file="https://francoishusson.files.wordpress.com/2017/02/missmda_var2.png?w=339&amp;h=338&amp;fit=339%2C338&amp;resize=339%2C338" data-orig-size="561,560" data-medium-file="https://francoishusson.files.wordpress.com/2017/02/missmda_var2.png?w=339&amp;h=338&amp;fit=339%2C338&amp;resize=339%2C338?w=300" data-attachment-id="486" data-image-meta="{" data-image-description="" src="https://francoishusson.files.wordpress.com/2017/02/missmda_var2.png?w=339&h=338&fit=339%2C338&resize=339%2C338" data-permalink="https://francoishusson.wordpress.com/?attachment_id=486" data-large-file="https://francoishusson.files.wordpress.com/2017/02/missmda_var2.png?w=339&amp;h=338&amp;fit=339%2C338&amp;resize=339%2C338?w=561" alt="missMDA_var2" data-image-title="missMDA_var2" sizes="(max-width: 339px) 100vw, 339px" data-comments-opened="1" class="wp-image-486" data-recalc-dims="1"></p>
<p>This methodology is also available for categorical data with the functions <strong>MIMCA</strong> and <strong>plot.MIMCA</strong> to visualize the uncertainty around the prediction of categories.</p>
<p>You can contact us for more information:<br>
julie.josse@polytechnique.edu       @JulieJosseStat<br>
husson@agrocampus-ouest.fr</p>
<p> <a rel="nofollow" href="http://feeds.wordpress.com/1.0/gocomments/francoishusson.wordpress.com/493/" target="_blank"><img border="0" alt="" src="http://feeds.wordpress.com/1.0/comments/francoishusson.wordpress.com/493/"></a> <img border="0" alt="" src="https://i1.wp.com/pixel.wp.com/b.gif?resize=1%2C1&ssl=1" data-recalc-dims="1"></p>
	<p>
<div>
<div>To <strong>leave a comment</strong> for the author, please follow the link and comment on their blog: <strong><a href="https://francoishusson.wordpress.com/2017/08/05/can-we-believe-in-the-imputations/"> François Husson</a></strong>.</div>
<hr>
<a rel="nofollow" href="https://www.r-bloggers.com/">R-bloggers.com</a> offers <strong><a rel="nofollow" href="https://feedburner.google.com/fb/a/mailverify?uri=RBloggers">daily e-mail updates</a></strong> about <a rel="nofollow" href="https://www.r-project.org/" title="The R Project for Statistical Computing">R</a> news and <a rel="nofollow" href="https://www.r-bloggers.com/search/tutorial" title="R tutorials">tutorials</a> on topics such as: <a rel="nofollow" href="https://www.r-bloggers.com/search/data%20science" title="Data science">Data science</a>, <a rel="nofollow" href="https://www.r-bloggers.com/search/Big%20Data" title="Big Data">Big Data, <a rel="nofollow" href="https://www.r-users.com/" title="R jobs">R jobs</a>, visualization (<a rel="nofollow" href="https://www.r-bloggers.com/search/ggplot2" title="ggplot and ggplot2 tutorials">ggplot2</a>, <a rel="nofollow" href="https://www.r-bloggers.com/search/boxplot" title="Boxplots using lattice and ggplot2 tutorials">Boxplots</a>, <a rel="nofollow" href="https://www.r-bloggers.com/search/map" title="Maps and gis">maps</a>, <a rel="nofollow" href="https://www.r-bloggers.com/search/animation" title="Animation in R">animation</a>), programming (<a rel="nofollow" href="https://www.r-bloggers.com/search/RStudio" title="RStudio IDE for R">RStudio</a>, <a rel="nofollow" href="https://www.r-bloggers.com/search/sweave" title="Sweave and literate programming">Sweave</a>, <a rel="nofollow" href="https://www.r-bloggers.com/search/LaTeX" title="LaTeX in R">LaTeX</a>, <a rel="nofollow" href="https://www.r-bloggers.com/search/SQL" title="SQL and databases">SQL</a>, <a rel="nofollow" href="https://www.r-bloggers.com/search/eclipse" title="Eclipse IDE for R">Eclipse</a>, <a rel="nofollow" href="https://www.r-bloggers.com/search/git" title="git and github, Version Control System">git</a>, <a rel="nofollow" href="https://www.r-bloggers.com/search/hadoop" title="Large data in R using Hadoop">hadoop</a>, <a rel="nofollow" href="https://www.r-bloggers.com/search/Web+Scraping" title="Web Scraping of google, facebook, yahoo, twitter and more using R">Web Scraping</a>) statistics (<a rel="nofollow" href="https://www.r-bloggers.com/search/regression" title="Regressions and ANOVA analysis tutorials">regression</a>, <a rel="nofollow" href="https://www.r-bloggers.com/search/PCA" title="principal component analysis tutorial">PCA</a>, <a rel="nofollow" href="https://www.r-bloggers.com/search/time+series" title="Time series">time series</a>, <a rel="nofollow" href="https://www.r-bloggers.com/search/trading" title="finance trading">trading</a>) and more...
<img alt="" width="1" src="http://feeds.feedburner.com/~r/RBloggers/~4/TY7IIsaRv7E" height="1"></a></div>