<p>We are releasing our 2017 fantasy football projections in a Shiny webapp using R.  The app allows you to calculate custom rankings/projections for your league based on your league settings.[...]</p>
<p>The post <a rel="nofollow" href="http://fantasyfootballanalytics.net/2017/06/2017-fantasy-football-projections.html">2017 Fantasy Football Projections</a> appeared first on <a rel="nofollow" href="http://fantasyfootballanalytics.net/">Fantasy Football Analytics</a>.</p>
Readers who found my posting last week on our revisit package of interest may wish to check the somewhat related package ropensci/rrrpkg, which Edzer Pemesma tweeted about today.
Line, Bar and Column Charts Hello everybody! This is the first part of an exciting data visualization series r exercises.com is going to provide you. Data visualization involves the creation and study of the visual representation of data. The increasing amounts of data created by Internet activity make the “data visualization” tool totally necessary for […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Getting started with Plotly: basic Plots" rel="bookmark" href="http://www.r-exercises.com/2017/01/10/getting-started-with-plotly-basic-plots/">Getting started with Plotly: basic Plots </a></li>
<li><a title="Shiny Applications Layouts Exercises (Part-9)" rel="bookmark" href="http://www.r-exercises.com/2017/05/20/shiny-applications-layouts-exercises-part-9/">Shiny Applications Layouts Exercises (Part-9) </a></li>
<li><a title="Customize a scatterplot exercises" rel="bookmark" href="http://www.r-exercises.com/2016/03/17/customize-scatterplot/">Customize a scatterplot exercises </a></li>
<li><a href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
TheyWorkForYou is a great website for keeping up with British politics and one of the many fine things mySociety does to make democracy in the UK more transparent. There’s also an API, accessible via http and wrapped up for a few languages. However, R is not amongst them, so I wrote twfy. If you’re interested … <a href="http://conjugateprior.org/2017/06/packaging-the-twfy-api/">Continue reading <span>Packaging the TheyWorkForYou API</span></a>
The new RcppArmadillo release 0.7.900.2.0 is now on CRAN, and the Debian package was just updated as well.
Armadillo is a powerful and expressive C++ template library for linear algebra aiming towards a good balance between speed and ease of use wit...
IQFeed provides streaming data services and trading solutions that cover the Agricultural, Energy and Financial marketplace. It is a well known and recognized data feed provider geared toward retail users and small institutions. The subscription price starts at around $80/month. Stanislav Kovalevsky has developed a package called QuantTools. It is an all in one package designed to enhance quantitative […]
The code below gives a simple implementation of the Metropolis and Metropolis-in-Gibbs sampling algorithms, which are useful for sampling probability densities for which the normalizing constant is difficult to calculate, are irregular, or have high dimension (Metropolis-in-Gibbs). ## Metropolis sampling ## x - current value of Markov chain (numeric vector) ## targ - target log … <a href="http://biostatmatt.com/archives/2964">Continue reading <span>Quick illustration of Metropolis and Metropolis-in-Gibbs Sampling in R</span> <span>→</span></a>
Global choropleth maps
Today I’m writing about using country-level choropleth maps at a global level, using example data showing nations’ military spending as a percentage of GDP. There are a few specific issues to work through as a result of the...
A few weeks ago and then some, I [as occasional blogger!] got contacted by datazar.com to write a piece on this data-sharing platform. I then went and checked what this was all about, having the vague impression this was a platform where I could store and tun R codes, besides dropping collective projects, but from […]
In this tutorial we are going to analyse a weather dataset to produce exploratory analysis and forecast reports based on regression models. We are going to take advantage of a public dataset which is part of the exercise datasets of the “Data Mining and Business Analytics with R” book (Wiley) written by Johannes Ledolter. In […]<ul></ul><strong><p>Related Post</p></strong><ol><li><a rel="bookmark" href="https://datascienceplus.com/weighted-linear-support-vector-machine/" title="Permanent Link toWeighted Linear Support Vector Machine">Weighted Linear Support Vector Machine</a></li><li><a rel="bookmark" href="https://datascienceplus.com/logistic-regression-regularized-with-optimization/" title="Permanent Link toLogistic Regression Regularized with Optimization">Logistic Regression Regularized with Optimization</a></li><li><a rel="bookmark" href="https://datascienceplus.com/analytical-and-numerical-solutions-to-linear-regression-problems/" title="Permanent Link toAnalytical and Numerical Solutions to Linear Regression Problems">Analytical and Numerical Solutions to Linear Regression Problems</a></li><li><a rel="bookmark" href="https://datascienceplus.com/how-to-create-a-loop-to-run-multiple-regression-models/" title="Permanent Link toHow to create a loop to run multiple regression models">How to create a loop to run multiple regression models</a></li><li><a rel="bookmark" href="https://datascienceplus.com/regression-model-with-auto-correlated-errors-part-3-some-astrology/" title="Permanent Link toRegression model with auto correlated errors – Part 3, some astrology">Regression model with auto correlated errors – Part 3, some astrology</a></li></ol>
You’ve probably noticed that Deep Learning is all the rage right now. AlphaGo has beaten the world champion at Go, you can google cat photos and be sure you won’t accidentally get photos of canines, and many other near-miraculous feats: … <a href="https://thinkinator.com/2017/06/03/deep-learning-dude-pt-1/">Continue reading <span>→</span></a>
What would you say if you could automatically wrap your R pipeline – which consists of numerous functions and variables – into a single function? What would you say if you could do it repeatedly, with no extra effort regardless of its complexity? Would you store it to document your progress at that particular moment in … <a href="https://random-remarks.net/2017/06/03/deferred-remote-function-execution-in-r/">More <span>Deferred &amp; Remote Function Execution in R</span></a>
What is the causal impact of the TseTse fly on historical and current development in Africa? Marcella Alsan studies this question in her fascinating article ‘The effect of the TseTse fly on African development’ in the American Economic Review, 2015...
<p>This week’s R bulletin will cover topics on grouping data using ntile function, how to open files automatically, and formatting an Excel sheet using R. Hope you like this R weekly bulletin. Enjoy reading! Shortcut Keys 1. Fold selected chunk – Alt+L 2. Unfold selected chunk – Shift+Alt+L 3. Fold all – Alt+0 Problem Solving Ideas Grouping...</p>
<p>The post <a rel="nofollow" href="https://www.quantinsti.com/blog/r-weekly-bulletin-vol-x/">R Weekly Bulletin Vol – X</a> appeared first on <a rel="nofollow" href="https://www.quantinsti.com/"></a>.</p>
In a previous post, I discussed the key elements that really stood out for me in recent workshops associated with open science, data science, and ecology. Summer workshop season is upon us, and here are some principles to consider that can be used to hack a workshop. These hacks can be applied a priori as an […]
As I mentioned earlier this week, I was on a team at the ROpenSci Unconference (with Brooke Anderson, Karl Broman, Gergely Daróczi, and my Microsoft colleagues Mario Inchiosa and Ali Zaidi) to work on a project to interface the R language with Minecraft. The resulting R package, miner, is now available to install from Github. The goal of the package is to introduce budding programmers to the R language via their interest in Minecraft, and to that end there's also a book (R Programming with Minecraft) and associated R package (craft) under development to provide lots of fun examples of...
For anyone looking for job opportunities, it is nice to have an idea how the job market will perform in the future for your chosen career or industry. Many countries have open data sets that offer this kind of data. In these exercises we will use R to analyze the future perspective of Canadian labour […]<div>
<h3>Related exercise sets:</h3><ol><li><a rel="bookmark" href="http://www.r-exercises.com/2016/08/26/reshape-2-exercises/" title="Reshape 2 Exercises">Reshape 2 Exercises </a></li>
<li><a rel="bookmark" href="http://www.r-exercises.com/2016/07/14/as-date-exercises/" title="As.Date() Exercises">As.Date() Exercises </a></li>
<li><a rel="bookmark" href="http://www.r-exercises.com/2016/11/28/data-frame-exercises-vol-2/" title="Data frame exercises Vol. 2">Data frame exercises Vol. 2 </a></li>
<li><a href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
Saw this the other day: In defense of wrapr::let() (originally part of replyr, and still re-exported by that package) I would say: let() was deliberately designed for a single real-world use case: working with data when you don’t know the column names when you are writing the code (i.e., the column names will come later … <a href="http://www.win-vector.com/blog/2017/06/in-defense-of-wraprlet/">Continue reading <span>In defense of wrapr::let()</span></a>
- I’ve been working with Linux for some time but always in a dual boot setup. While I used Linux-Mint at home, my university computer always had Windows. Most of the times it was not a problem working in one or the other and s...
The results of KDnuggets' 18th annual poll of data science software usage are in, and for the first time in three years Python has edged out R as the most popular software. While R increased its share of usage from 45.7% in last year's poll to 52.1% this year, Python's usage among data scientists increased even more, from 36.6% of users in 2016 to 52.6% of users this year. There were some interesting moves in the long tail, as well. Several tools entered the KDNuggets chart for the first time, including Keras (9.5% of users), PyCharm (9.0%) and Microsoft R...
In the last exercise, We have seen how powerful functional programming principles can be and how it can drammatically increase the readablity of the code and how easily you can work with them .In this set of exercises we will look at functional programming principles with purrr.Purrr comes with a number of interesting features and […]<div>
<h3>Related exercise sets:</h3><ol><li><a rel="bookmark" href="http://www.r-exercises.com/2016/08/05/higher-order-functions-exercises/" title="Higher Order Functions Exercises">Higher Order Functions Exercises </a></li>
<li><a rel="bookmark" href="http://www.r-exercises.com/2017/05/19/a-primer-in-functional-programming-in-r/" title="A Primer in Functional Programming in R (Part – 1)">A Primer in Functional Programming in R (Part – 1) </a></li>
<li><a rel="bookmark" href="http://www.r-exercises.com/2017/01/01/building-shiny-app-exercises-part-4/" title="Building Shiny App exercises part 4">Building Shiny App exercises part 4 </a></li>
<li><a href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
1. Introduction
I serve as a reviewer to several ISI and Scopus indexed journals in Information Technology. Recently, I was reviewing an article, wherein the researchers had made a critical mistake in data analysis. They converted the original categor...
<p>tl;dr: Publication bias and p-hacking can dramatically inflate effect size estimates in meta-analyses. Many methods have been proposed to correct for such bias and to estimate the underlying true effect. In a large simulation study, we found out which methods do not work well under which conditions, and give recommendations what not to use. Estimated […]</p>
<p>The post <a rel="nofollow" href="http://www.nicebread.de/meta-showdown-1/">Correcting bias in meta-analyses: What not to do (meta-showdown Part 1)</a> appeared first on <a rel="nofollow" href="http://www.nicebread.de/">Nicebread</a>.</p>
The 'wrapr'package for use with dplyr programming - UPDATED POST
I’m the first to admit I’m not an R expert, (even duffers can blog about it though), but when I began thinking about writing some dplyr functions to help me create and anal...
By Gabriel Vasconcelos The complete subset regressions (CSR) is a forecasting method proposed by Elliott, Gargano and Timmermann in 2013. It is as very simple but powerful technique. Suppose you have a set of variables and you want to forecast … <a href="https://insightr.wordpress.com/2017/06/01/complete-subset-regressions-simple-and-powerfull/">Continue reading <span>→</span></a>
<p>A solution in the R language to Euler Problem 23. Find the sum of all the positive integers which cannot be written as the sum of two abundant numbers. <a href="http://r.prevos.net/euler-problem-23-non-abundant-sums/">Continue reading <span>→</span></a></p>
<p>The post <a rel="nofollow" href="http://r.prevos.net/euler-problem-23-non-abundant-sums/">Euler Problem 23: Non-Abundant Sums</a> appeared first on <a rel="nofollow" href="http://r.prevos.net/">The Devil is in the Data</a>.</p>
Several years ago, John Ionnidis jolted the scientific establishment with an article titled, “Why Most Published Research Findings Are False.” He had concerns about inattention to statistical power, multiple inference issues and so on. Most people had already been aware of all this, of course, but that conversation opened the floodgates, and many more issues … <a href="https://matloff.wordpress.com/2017/05/31/a-partial-remedy-to-the-reproducibility-problem/">Continue reading <span>A Partial Remedy to the Reproducibility Problem</span> <span>→</span></a>
For the past few months I’ve been working on a new DataCamp course teaching Forecasting using R. I’m delighted that it is now available for anyone to do.
Course blurb Forecasting involves making predictions about the future. It is required in many ...
<p>Contributed by Thomas Kassel. He is currently enrolled in the NYC Data Science Academy remote bootcamp program taking place from January-May 2017. This post is based […]</p>
<p>The post <a rel="nofollow" href="http://blog.nycdatascience.com/student-works/capstone/u-s-residential-energy-use-machine-learning-recs-dataset/">U.S. Residential Energy Use: Machine Learning on the RECS Dataset</a> appeared first on <a rel="nofollow" href="http://blog.nycdatascience.com/">NYC Data Science Academy Blog</a>.</p>
RStudio is excited to announce the availability of its flagship enterprise-ready integrated development environment for R in AWS Marketplace. RStudio Server Pro AWS is identical to RStudio Server Pro, but with turnkey convenience. It comes pre-configured with multiple versions of R, common systems libraries, and the most popular R packages. RStudio Server Pro AWS helps […]
Shiny is an application based on R/RStudio which enables an interactive exploration of data through a dashboard with drop-down lists and checkboxes—programming-free. The apps can be useful for both the data analyst and the public. Shiny apps are based on the Internet: This allows for private consultation of the data on one’s own browser as … <a href="http://r-posts.com/shiny-data-presentation-with-an-extra/">Continue reading <span>Shiny: data presentation with an extra</span></a>
A very useful data visualisation tool in science, particularly in medical and sports settings, is the Bland-Altman/Tukey Mean-Difference plot. When comparing two sets of measurements for the same variable made by different instruments, it is often required to determine whether the instruments are in agreement or not. Correlation and linear regression can tell us something… <a href="https://sw23993.wordpress.com/2017/05/31/bland-altmantukey-mean-difference-plots-using-ggplot2/">Continue reading <span>Bland-Altman/Tukey Mean-Difference Plots using ggplot2</span> <span>→</span></a>
There was a time where statistician had to manually crunch number when they wanted to fit their data to a model. Since this process was so long, those statisticians usually did a lot of preliminary work researching other model who worked in the past or looking for studies in other scientific field like psychology or […]<div>
<h3>Related exercise sets:</h3><ol><li><a rel="bookmark" href="http://www.r-exercises.com/2017/05/02/forecasting-for-small-business-exercises-part-4/" title="Forecasting for small business Exercises (Part-4)">Forecasting for small business Exercises (Part-4) </a></li>
<li><a rel="bookmark" href="http://www.r-exercises.com/2017/05/05/forecasting-arimax-model-exercises-part-5/" title="Forecasting: ARIMAX Model Exercises (Part-5)">Forecasting: ARIMAX Model Exercises (Part-5) </a></li>
<li><a rel="bookmark" href="http://www.r-exercises.com/2017/04/17/forecasting-exponential-smoothing-exercises-part-3/" title="Forecasting: Exponential Smoothing Exercises (Part-3)">Forecasting: Exponential Smoothing Exercises (Part-3) </a></li>
<li><a href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
It was another great year for the R/Finance conference, held earlier this month in Chicago. This is normally a fairly private affair: with attendance capped at around 300 people every year, it's a somewhat exclusive gathering of the best and brightest minds from industry and academia in financial data analysis with R. But for the first time this year (and with thanks to sponsorship from Microsoft), videos of the presentations are available for viewing by everyone. I've included the complete list (copied from the R/Finance website) below, but here are a few of my favourites: No-Bullshit Data Science. Szilard Pafka's...
In the book I use the car package to get VIF and other multicollinearity diagnostics. I’ve occasionally found this breaks down (usually through mixing different versions of R on different machines at work home or on the move). I recently saw the mctest package and thought it would be useful to use that as a […]
I used reading a directory of CSVs as the foundational example in my recent post on idioms. During my exchange with Matt, Hadley and a few others — in the crazy Twitter thread that spawned said post — I mentioned that I’d personally “just use Drill”. I’ll use this post as a bit of a... <a href="https://rud.is/b/2017/05/31/drilling-into-csvs-teaser-trailer/">Continue reading <span>→</span></a>
Forecasting in R is taught by Rob J. Hyndman, author of the forecast package Forecasting involves making predictions about the future. It is required in many situations such as deciding whether to build another power generation plant in the next ten years requires forecasts of future demand; scheduling staff in a call center next week requires … <a href="http://r-posts.com/new-course-forecasting-in-r/">Continue reading <span>New online datacamp course: Forecasting in R</span></a>
Guest post by Qingyue Xu Compiling taxonomic checklists from varied sources of data is a common task that biodiversity informaticians encounter. In the GSoC 2017 project Parser for Biodiversity checklists, my overall goal is to extract taxonomic names from given text into a tabular format so that easy aggregation of biodiversity data in a structured […]
<p>This is the second post about the Marketing Multi-channel Attribution Model with Markov chains (here is the first one). Even though the concept of the first-order Markov chains is pretty simple, you can face other issues and challenges when implementing the approach in practice. In this article, we will review some of them. I tried to organize this […]</p>
<p>The post <a rel="nofollow" href="http://analyzecore.com/2017/05/31/marketing-multi-channel-attribution-model-r-part-2-practical-issues/">Marketing Multi-Channel Attribution model with R (part 2: practical issues)</a> appeared first on <a rel="nofollow" href="http://analyzecore.com/">AnalyzeCore - data is beautiful, data is a story</a>.</p>
Classes 3-7 July 2017: We have updated our very popular training course to take advantage of the latest Microsoft Advanced Analytics technology and re-launched it as Marketing Analytics using Microsoft R and Azure. We have just announced public training dates and are looking forward to giving the course in the week 3-7 July 2017. This is a live, instructor-led course in an online classroom environment. There are class times to suit everyone; participants in Middle East and Asia register here for live classes 08:00-12:00 London time while participants in North and South America register here for classes 10:00-14:00 New York time. Please see the listings for additional time zones. This course has consistently achieved 100% positive promoter scores both on recommending the course and recommending the instructor.
The second update of the 3.6.x release of simmer, the Discrete-Event Simulator for R, is on CRAN, thus inaugurating a bi-monthly release cycle. I must thank Duncan Garmonsway (@nacnudus) for creating and now maintaining “The Bank Tutorial: Part I” vignette, Franz Fuchs for finding an important and weird memory bug (here) that prevented simmer from… <a href="https://www.enchufa2.es/archives/simmer-3-6-2.html">Continuar leyendo <span>simmer 3.6.2</span> <span>→</span></a>
Make the most of your commute! - Podcasts are awesome. Especially when you’re stuck in traffic on the way to work.
Below are some podcasts I listen to that relate to data science and statistics. Each of them has something slightly different t...
Last week I attended the ROpenSci Unconference in Los Angeles, and it was fantastic. Now in its fourth year, the ROpenSci team brought together a talented and diverse group of about 70 R developers from around the world to work on R-related projects in an intense 2-day hackathon. Not only did everyone have a lot of fun, make new connections and learn from others, but the event also advanced the ROpenSci mission of creating packages, tools and resources to support scientific endeavours using R. During the two-way workshop, the attendees self-organized into teams of 4-8 to work on projects. There...
Last week, I released a new package called polypoly to CRAN. It wraps up
some common tasks for dealing with orthogonal polynomials into a single package.
The README shows off the main functionality, as well as the neat “logo” I made for the packag...
Medicare Data – R Shiny App About two weeks ago I created an extremely rough version of an R Shiny Application surrounding Medicare data. Right after publishing the blog post, I received a lot of input for improvement and help from others. Here’s a look a look at the latest version of the Medicare Shiny […]
- I just posted a major update to GetHFData. Version 1.3 of GetHFData makes it possible to download and aggregate order data from Bovespa. The data comprises buy and sell orders sent by market operators. Tabular data includes t...
Our next &quot;R and big data tip&quot; is: summarizing big data. We always say &quot;if you are not looking at the data, you are not doing science&quot;- and for big data you are very dependent on summaries (as you can’t actually look at everything). Simple question: is there an easy way to summarize big data … <a href="http://www.win-vector.com/blog/2017/05/summarizing-big-data-in-r/">Continue reading <span>Summarizing big data in R</span></a>
Together with David Kellen I am currently working on an introductory chapter to mixed models for a book edited by Dan Spieler and Eric Schumacher (the current version can be found here). The goal is to provide a theoretical and practical introduction that is targeted mainly at experimental psychologists, neuroscientists, and others working with experimental […]
This is the third part of the series on Instrumental Variables. For other parts of the series follow the tag instrumental variables. In this exercise set we will use Generalized Method of Moments (GMM) estimation technique using the examples from part-1 and part-2. Recall that GMM estimation relies on the relevant moment conditions. For OLS […]<div>
<h3>Related exercise sets:</h3><ol><li><a rel="bookmark" href="http://www.r-exercises.com/2017/05/15/instrumental-variables-in-r-exercises-part-1/" title="Instrumental Variables in R exercises (Part-1)">Instrumental Variables in R exercises (Part-1) </a></li>
<li><a rel="bookmark" href="http://www.r-exercises.com/2017/05/22/instrumental-variables-in-r-exercises-part-2/" title="Instrumental Variables in R exercises (Part-2)">Instrumental Variables in R exercises (Part-2) </a></li>
<li><a rel="bookmark" href="http://www.r-exercises.com/2017/05/05/forecasting-arimax-model-exercises-part-5/" title="Forecasting: ARIMAX Model Exercises (Part-5)">Forecasting: ARIMAX Model Exercises (Part-5) </a></li>
<li><a href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
Bioinformatics is an amalgamation Biology and Computer science.Biological Data is manipulated using Computers and Computer software’s in Bioinformatics. Biological Data includes DNA; RNA &amp; Proteins. DNA &amp; RNA is made of Nucleotide which are our genetic material in which we are coded.Our Structure and Functions are done by protein, which are build of Amino acids […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Bioinformatics Tutorial with Exercises in R (part 1)" rel="bookmark" href="http://www.r-exercises.com/2017/01/22/bioinformatics-lessons-in-r-1-biostrings-exercises/">Bioinformatics Tutorial with Exercises in R (part 1) </a></li>
<li><a title="Manipulate Biological Data Using Biostrings Package Exercises (Part 1)" rel="bookmark" href="http://www.r-exercises.com/2017/05/21/manipulate-biological-data-using-biostrings-package-part-1/">Manipulate Biological Data Using Biostrings Package Exercises (Part 1) </a></li>
<li><a title="Accessing and Manipulating Biological Databases  Exercises (Part-3)" rel="bookmark" href="http://www.r-exercises.com/2017/05/10/accessing-and-manipulating-biological-databases-exercises-part-3/">Accessing and Manipulating Biological Databases Exercises (Part-3) </a></li>
<li><a href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
Data Science is a fairly broad term and encompasses a wide range of techniques from data visualization to statistics and machine learning models. But the techniques are only tools in a - sometimes very messy - toolbox. And while it is important to know...
<p>Contributed by Bo Lian. This blog post is the first class project on Exploratory Visualization &amp; Shiny. Please check  the Shiny App here. Background and Motivation […]</p>
<p>The post <a rel="nofollow" href="http://blog.nycdatascience.com/student-works/r-shiny/interesting-study-exploring-mental-health-conditions-tech-workplace/">An Interesting Study: Exploring Mental Health Conditions in the Tech Workplace</a> appeared first on <a rel="nofollow" href="http://blog.nycdatascience.com/">NYC Data Science Academy Blog</a>.</p>
Last year, I was able to sit back and lazily “RT” Julia Silge’s excellent retrospective on her 2016 @rOpenSci “unconference” experience. Since Julia was not there this year, and the unconference experience is still in primary storage (LMD v2.0 was a success!) I thought this would be the perfect time for a mindful look-back. And... <a href="https://rud.is/b/2017/05/28/l-a-unconf-idential-a-k-a-an-ropensci-runconf17-retrospective/">Continue reading <span>→</span></a>
The R/Finance 2017 conference was just held at the UIC in Chicago, and the event was a huge success. There were a ton of high quality presentations really showcasing innovation in finance. We gave a presentation on tidyquant illustrating the key benefi...
Living in the Bay Area has led me to think more and more about real estate (and how amazingly expensive it is here…)  I’ve signed up for trackers on Zillow and Redfin, but the data analyst in me always wants to dive deeper, to look back historically, to quantify, to visualize the trends, etc…  With […]
Many people around the globe would like to immigrate to Canada as a Skilled Worker. These candidates must prove language proficiency in French and English, at least 2 years of working experience after graduation, and more. But, many immigrants that arrive in canada face unemployment rates sometimes even higher than in their original countries. So, […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Cross Tabulation with Xtabs exercises" rel="bookmark" href="http://www.r-exercises.com/2016/05/12/cross-tabulation-with-xtabs-exercises/">Cross Tabulation with Xtabs exercises </a></li>
<li><a title="As.Date() Exercises" rel="bookmark" href="http://www.r-exercises.com/2016/07/14/as-date-exercises/">As.Date() Exercises </a></li>
<li><a title="Building Shiny App Exercises (part-9)" rel="bookmark" href="http://www.r-exercises.com/2017/04/01/building-shiny-app-exercises-part-9/">Building Shiny App Exercises (part-9) </a></li>
<li><a href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
This post will be a modified backtest of the Adaptive Asset Allocation backtest from AllocateSmartly, using the Hierarchical Risk Parity … <span><a href="https://quantstrattrader.wordpress.com/2017/05/26/testing-the-hierarchical-risk-parity-algorithm/">Continue reading <span>→</span></a></span>
When working with big data with R (say, using Spark and sparklyr) we have found it very convenient to keep data handles in a neat list or data_frame. Please read on for our handy hints on keeping your data handles neat. When using R to work over a big data system (such as Spark) much … <a href="http://www.win-vector.com/blog/2017/05/managing-spark-data-handles-in-r/">Continue reading <span>Managing Spark data handles in R</span></a>
by Juan M. Lavista Ferres , Senior Director of Data Science at Microsoft In what was one of the most viral episodes of 2017, political science Professor Robert E Kelly was live on BBC World News talking about the South Korean president being forced out of office when both his kids decided to take an easy path to fame by showing up in their dad’s interview. The video immediately went viral, and the BBC reported that within five days more than 100 million people from all over the world had watched it. Many people around the globe via Facebook, Twitter...
<p>High-level info If you build a model and never update it you’re missing a trick. Behaviours change so your model will tend to perform worse over time. You’ve got to regularly refresh it, whether that’s adjusting the existing model to</p>
<p>The post <a rel="nofollow" href="http://itsalocke.com/versioning-r-model-objects-in-sql-server/">Versioning R model objects in SQL Server</a> appeared first on <a rel="nofollow" href="http://itsalocke.com/">Locke Data</a>. Locke Data are a data science consultancy aimed at helping organisations get ready and get started with data science.</p>
It took us quite a while but we have finally released a new version of rtdists to CRAN which provides a few significant improvements. As a reminder, rtdists [p]rovides response time distributions (density/PDF, distribution function/CDF, quantile function, and random generation): (a) Ratcliff diffusion model based on C code by Andreas and Jochen Voss and (b) […]
Today we are proud to announce a major release of the RQGIS package providing an interface between R and QGIS. We have completeley rewritten RQGIS by now using reticulate to establish a tunnel to the Python QGIS API.
It's been a while since my last post on some TB WHO data. A lot has happened since then, including the opportunity to attend the Open Data Science Conference (ODSC) East held in Boston, MA. Over a two day period I had the opportunity to listen to a number of leaders in various industries and fields. It...... <a href="https://incidental-ideas.org/2017/05/25/regular-expression-treemaps-to-visualize-emergency-department-visits/#more-1730">Continue Reading →</a>
Shiny Application Layouts – Shiny Themes In the last part of the series we will check out which themes are available in the shinythemes package. More specifically we will create a demo app with a selector from which you can choose the theme you want. This part can be useful for you in two ways. […]<div>
<h3>Related exercise sets:</h3><ol><li><a rel="bookmark" href="http://www.r-exercises.com/2017/01/01/building-shiny-app-exercises-part-4/" title="Building Shiny App exercises part 4">Building Shiny App exercises part 4 </a></li>
<li><a rel="bookmark" href="http://www.r-exercises.com/2017/04/30/shiny-application-layouts-exercises-part-3/" title="Shiny Application Layouts exercises part 3">Shiny Application Layouts exercises part 3 </a></li>
<li><a rel="bookmark" href="http://www.r-exercises.com/2016/12/12/building-shiny-app-exercises-part-1/" title="Building Shiny App exercises part 1">Building Shiny App exercises part 1 </a></li>
<li><a href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
In an earlier blog post I provided R code for a CI of a difference in R square for dependent and non-dependent correlations. This was based on a paper by Zou (2007). That paper also provides a method for calculating the CI of a difference in independent R square coefficients based on the limits of […]
Data scientist Giora Simchoni recently published a fantastic analysis of the history of pop songs on the Billboard Hot 100 using the R language. Giora used the rvest package in R to scrape data from the Ultimate Music Database site for the 350,000 chart entries (and 35,000 unique songs) since 1940, and used those data to create and visualize several measures of song popularity over time. A novel measure that Giora calculates is &quot;area under the song curve&quot;: the sum of all the ranks above 100 for every week the song is in the Hot 100. By that measure, the...
The nnetar function in the forecast package for R fits a neural network model to a time series with lagged values of the time series as inputs (and possibly some other exogenous inputs). So it is a nonlinear autogressive model, and it is not possible t...
<p>A proposed solution in the R language to Euler Problem 22. What is the total of all the name scores in the file of 5163 first names? <a href="http://r.prevos.net/euler-problem-22-names-scores/">Continue reading <span>→</span></a></p>
<p>The post <a rel="nofollow" href="http://r.prevos.net/euler-problem-22-names-scores/">Euler Problem 22 : Names Scores</a> appeared first on <a rel="nofollow" href="http://r.prevos.net/">The Devil is in the Data</a>.</p>
<p>Using the R programming language to draw the Sierpinski triangle fractal using the chaos game. Drawing a fractal using random numbers. <a href="http://r.prevos.net/sierpinski-triangle/">Continue reading <span>→</span></a></p>
<p>The post <a rel="nofollow" href="http://r.prevos.net/sierpinski-triangle/">The Sierpinski Triangle: Visualising infinity in R</a> appeared first on <a rel="nofollow" href="http://r.prevos.net/">The Devil is in the Data</a>.</p>
As also described in Cormen, et al (2009) p. 65, in algorithm design, divide-and-conquer paradigm incorporates a recursive approach in which the main problem is: Divided into smaller sub-problems (divide), The sub-problems are solved (conquer), And the solutions to sub-problems are combined to solve the original and “bigger” problem (combine). Instead of constructing indefinite number … <p><a href="http://www.serhatcevikel.com/?p=119">Continue reading<span> &quot;A recipe for dynamic programming in R: Solving a “quadruel” case from PuzzlOR&quot;</span></a></p>
Following the surprising success of my latest post, I decided to show yet another use case of the handy ggplot2::annotation_custom(). Here I will show how to add small graphical information to maps – just like putting a stamp on an envelope.
<p>TWO SHOT RUSSIAN ROULETTE WITH 2 BULLETS OR AN EQUAL CHANCE OF 1 or 3 BULLETS With p as the probability of dying on one shot, this figure shows how to get the probability of living through the game. Peter Ayton is giving a talk today at the London Judgement and Decision Making Seminar Imagine […]</p>
<p>The post <a rel="nofollow" href="http://www.decisionsciencenews.com/2017/05/24/counterintuitive-probability-problem-day/">Counterintuitive probability problem of the day</a> appeared first on <a rel="nofollow" href="http://www.decisionsciencenews.com/">Decision Science News</a>.</p>
Data wrangling is a task of great importance in data analysis. Data wrangling, is the process of importing, cleaning and transforming raw data into actionable information for analysis. It is a time-consuming process which is estimated to take about 60-80% of analyst’s time. In this series we will go through this process. It will be […]<div>
<h3>Related exercise sets:</h3><ol><li><a rel="bookmark" href="http://www.r-exercises.com/2016/08/24/using-manova-to-analyse-banking-crises/" title="Using MANOVA to Analyse a Banking Crisis Exercises">Using MANOVA to Analyse a Banking Crisis Exercises </a></li>
<li><a rel="bookmark" href="http://www.r-exercises.com/2017/01/01/building-shiny-app-exercises-part-4/" title="Building Shiny App exercises part 4">Building Shiny App exercises part 4 </a></li>
<li><a rel="bookmark" href="http://www.r-exercises.com/2017/05/04/accessing-and-manipulating-biological-databases-exercises-part-2/" title="Accessing and Manipulating Biological Databases  Exercises (Part 2)">Accessing and Manipulating Biological Databases Exercises (Part 2) </a></li>
<li><a href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
Brute force approach to solving a problem is usually the way of running through all possible combinations and repeating a certain calculation. Until a more elegant solution is devised – for example finding a numerical formula – brute forcing is the only tool at hand. Provided that the nature of the calculation is not unfeasibly … <p><a href="http://www.serhatcevikel.com/?p=115">Continue reading<span> &quot;How brute is your force?: Three ways to get radicals in batch using R&quot;</span></a></p>
Microsoft R Open (MRO), Microsoft's enhanced distribution of open source R, has been upgraded to version 3.4.0 and is now available for download for Windows, Mac, and Linux. This update upgrades the R language engine to R 3.4.0, reduces the size of the installer image, and updates the bundled packages. R 3.4.0 (upon which MRO 3.4.0 is based) is a major update to the R language, with many fixes and improvements. Most notably, R 3.4.0 introduces a just-in-time (JIT) compiler to improve performance of the scripts and functions that you write. There have been a few minor tweaks to the...
This is your chance to win one of two 2-day passes to the first San Francisco EARL Conference on June 6 and 7. To win: All you need to do is tell us why you want to come! How to … <a href="http://www.mango-solutions.com/wp/2017/05/win-an-ticket-to-san-francisco-earl/">Continue reading <span>→</span></a>
Aim of the ggeffects-package The aim of the ggeffects-package is similar to the broom-package: transforming “untidy” input into a tidy data frame, especially for further use with ggplot. However,… <span><a rel="bookmark" href="https://strengejacke.wordpress.com/2017/05/24/ggeffects-create-tidy-data-frames-of-marginal-effects-for-ggplot-from-model-outputs-rstats/">Weiterlesen <span>&quot;ggeffects: Create Tidy Data Frames of Marginal Effects for ‚ggplot‘ from Model Outputs #rstats&quot;</span></a></span><img height="1" alt="" width="1" src="https://pixel.wp.com/b.gif?host=strengejacke.wordpress.com&blog=10592659&post=1261&subd=strengejacke&ref=&feed=1" border="0">
To post your R job on the next post Just visit this link and post a new R job to the R community. You can post a job for free (and there are also “featured job” options available for extra exposure). Current R jobs Job seekers: please follow the links below to learn more and apply for your R job of interest: Featured Jobs Full-Time Data Scientist / Analytics Consultant Hedera Insights – Posted by HederaInsights Antwerpen Vlaanderen, Belgium 18 May 2017 Full-Time Data Scientist (m/f) Meritocracy – Posted by arianna@meritocracy Hamburg Hamburg, Germany 11 May 2017 Full-Time Data Scientist One Acre Fund – Posted by OAF Nairobi Nairobi County, Kenya 9 May 2017 Full-Time Back-End Developer – Sacramento Kings (Sacramento, CA) Sacramento Kings – Posted by khavey Sacramento California, United States 9 May 2017 Full-Time Data Analyst, Chicago Violence Reduction Strategy National Network for Safe Communities (NNSC) – Posted by nnsc Chicago Illinois, United States 5 May 2017 More New Jobs Full-Time Data Scientist / Analytics Consultant Hedera Insights – Posted by HederaInsights Antwerpen Vlaanderen, Belgium 18 May 2017 Full-Time Data Scientists for ArcelorMittal @ Avilés, Principado de Asturias, Spain ArcelorMittal – Posted by JuanM Avilés Principado de Asturias, Spain 12 May 2017 Full-Time Data Scientist (m/f) Meritocracy – Posted by arianna@meritocracy Hamburg Hamburg, Germany 11 May 2017 Full-Time Data Scientist Prospera Technologies – Posted by Prospera Technologies Tel Aviv-Yafo Tel Aviv District, […]
This is a quick note looking for any further feedback on the simglm package prior to CRAN submission later this week. The goal is to submit Thursday or Friday this week. The last few documentation finishing touches are happening now working toward a ve...
There are several tools available in R for creating animations (movies) from statistical graphics. The animation package by Yihui Xie will create an animated GIF or video file, using a series of R charts you generate as the frames. And the gganimate package by David Robinson is an extension to ggplot2 that will create a movie from charts created using the ggplot2 syntax: in much the same way that you can create multiple panels using faceting, you can instead create an animation with multiple frames. But from a storytelling perspective, such animations can sometimes seem rather disjointed. For example, here's...
In my last post Which linear model is best? I wrote about using stepwise selection as a method for selecting linear models, which turns out to have some issues (see this article, and Wikipedia). This post will be about two methods that slightly modify ordinary least squares (OLS) regression – ridge regression and the lasso. … <a href="https://realdataweb.wordpress.com/2017/05/23/ridge-regression-and-the-lasso/">Continue reading <span>Ridge Regression and the Lasso</span></a>
We’re excited to announce a powerful new ability to organize content in RStudio Connect: version 1.5.0. Tags allow publishers to arrange what they’ve published and enable users to find and discover the content most relevant to them. The release also includes a newly designed (and customizable!) landing page and multiple important security enhancements. Tagging Content […]
NOTE: I’ll do my best to ensure the next post will have nothing to do with Twitter, and this post might not completely meet my R⁶ criteria. A single, altruistic, nigh exuberant R tweet about slurping up a directory of CSVs devolved quickly — at least in my opinion, and partly (sadly) with my aid... <a href="https://rud.is/b/2017/05/23/r%E2%81%B6-idiomatic-for-the-people/">Continue reading <span>→</span></a>
This week, DataCamp is celebrating 1 million learners on its platform and is offering 50% off for unlimited access to the full curriculum. Join the learners who have completed over 40 million exercises on DataCamp and learn R or Python for data science...
This post discusses a number of options that are available in R for analyzing data from max-diff experiments, using the package flipMaxDiff. For a more detailed explanation of how to analyze max-diff, and what the outputs...
The first ever EARL (Enterprise Applications of the R Language) conference in San Francisco will take place on June 5-7 (and it's not too late to register). The EARL conference series is now in its fourth year, and the prior conferences in London and Boston have each been a fantastic way to learn how R is used in real-world applications. Judging from the speaker lineup in San Francisco, next month's event looks like it will feature some great R stores as well. Included on the program will be stories from the following companies: AirBnB (Keynote presentation by Ricardo Bion) StitchFix...
This post will be about replicating the Marcos Lopez de Prado algorithm from his paper building diversified portfolios that outperform … <span><a href="https://quantstrattrader.wordpress.com/2017/05/22/the-marcos-lopez-de-prado-hierarchical-risk-parity-algorithm/">Continue reading <span>→</span></a></span>
This is the second part of the series on Instrumental Variables. For other parts of the series follow the tag instrumental variables. In this exercise set we will build on the example from part-1. We will now consider an over-identified case i.e. we have multiple IVs for an endogenous variable. We will also look at […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Instrumental Variables in R exercises (Part-1)" rel="bookmark" href="http://www.r-exercises.com/2017/05/15/instrumental-variables-in-r-exercises-part-1/">Instrumental Variables in R exercises (Part-1) </a></li>
<li><a title="Bioinformatics Tutorial with Exercises in R (part 1)" rel="bookmark" href="http://www.r-exercises.com/2017/01/22/bioinformatics-lessons-in-r-1-biostrings-exercises/">Bioinformatics Tutorial with Exercises in R (part 1) </a></li>
<li><a title="Let’s get started with dplyr" rel="bookmark" href="http://www.r-exercises.com/2017/01/12/lets-get-started-with-dplyr/">Let’s get started with dplyr </a></li>
<li><a href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
R is a very popular language for doing analytics, and particularly statistics, on your data. There are a number of R functions for reading in data, but most of them take a delimited text file (such as .CSV) for input. […]
Introduction I spent good chunks of Friday, Saturday, and Sunday attempting to write another blog post on using R and the quantstrat package for backtesting, and all I have to show for my work is frustration. So I’ve started to fall out of love with quantstrat and am thinking of exploring Python backtesting libraries from…<a href="https://ntguardian.wordpress.com/2017/05/22/the-end-of-the-honeymoon-falling-out-of-love-with-quantstrat/">Read more <span>The End of the Honeymoon: Falling Out of Love with quantstrat</span></a>
For my recently published paper, I produced not-so-standard figures that show the two step decomposition used in the analysis. Have a look:
A debate about which language is better suited for Datascience, R or Python, can set off diehard fans of these languages into a tizzy. This post tries to look at some of the different similarities and similar differences between these languages. To a large extent the ease or difficulty in learning R or Python is … <a href="https://gigadom.wordpress.com/2017/05/22/r-vs-python-different-similarities-and-similar-differences/">Continue reading <span>R vs Python: Different similarities and similar differences</span></a>
Andar, lo que es andar, anduve encima siempre de las nubes (Del tiempo perdido, Robe) If you give importance to colours, maybe you know already COLOURlovers. As can be read in their website, COLOURlovers is a creative community where people from around the world create and share colors, palettes and patterns, discuss the latest trends … <a href="https://fronkonstin.com/2017/05/22/sunflowers-for-colourlovers/">Continue reading <span>Sunflowers for COLOURlovers</span> <span>→</span></a>
By Gabriel Vasconcelos Motivation The name bagging comes from boostrap aggregating. It is a machine learning technique proposed by Breiman (1996) to increase stability in potentially unstable estimators. For example, suppose you want to run a regression with a few … <a href="https://insightr.wordpress.com/2017/05/22/bagging-the-perfect-solution-for-model-instability/">Continue reading <span>→</span></a>
Bioinformatics is an amalgamation Biology and Computer science.Biological Data is manipulated using Computers and Computer software’s in Bioinformatics. Biological Data includes DNA; RNA &amp; Protiens. DNA &amp; RNA is made of Nucleotides which are our genetic material in which we are coded.Our Structure and Functions are done by protein, which are build of Amino acids […]<div>
<h3>Related exercise sets:</h3><ol><li><a rel="bookmark" href="http://www.r-exercises.com/2017/01/22/bioinformatics-lessons-in-r-1-biostrings-exercises/" title="Bioinformatics Tutorial with Exercises in R (part 1)">Bioinformatics Tutorial with Exercises in R (part 1) </a></li>
<li><a rel="bookmark" href="http://www.r-exercises.com/2017/01/01/building-shiny-app-exercises-part-4/" title="Building Shiny App exercises part 4">Building Shiny App exercises part 4 </a></li>
<li><a rel="bookmark" href="http://www.r-exercises.com/2016/12/25/building-shiny-app-exercises-part-3/" title="Building Shiny App exercises part 3">Building Shiny App exercises part 3 </a></li>
<li><a href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
Many of my posts seem to begin with a link to a tweet, and this one falls into that pattern: And @_inundata is already working on a #rstats palette. https://t.co/bNfpL7OmVl— Timothée Poisot (@tpoi) May 21, 2017 I’d seen the Ars Tech post about the named color palette derived from some training data. I could tell... <a href="https://rud.is/b/2017/05/21/a-very-pallete-able-post/">Continue reading <span>→</span></a>
There will be a few posts about switching from plyr/reshape2 for data wrangling to the more contemporary dplyr/tidyr. My most common use of plyr looked something like this: we take a data frame, split it by some column(s), and use an anonymous function to do something useful. The function takes a data frame and returns […]
Continuing my examination of the individual level voting behaviour from the New Zealand Election Study, I wanted to look at the way individuals swap between parties, and between “did not vote” and a party, from one election to another. How much an...
About the book
This book applies tidy data principles to text analysis. The aim is to present tools to make many text mining tasks easier, more effective, and consistent with tools already in use, and in particular it presents the tidytext R pack...
I’ll admit I didn’t really know who Bill Nye was before yesterday. His name sounds a bit like Bill Nighy’s, that’s all I knew. But well science is all around and quite often scientists on Twitter start interesting campaigns. Remember the #actua...
Shiny Application Layouts – Update Input In the ninth part of our series we will see the updated input scenario. This is different from the Dynamic UI example we met in part 8, where the UI component is generated on the server and sent to the UI, where it replaces an existing UI component. This […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Building Shiny App exercises part 4" rel="bookmark" href="http://www.r-exercises.com/2017/01/01/building-shiny-app-exercises-part-4/">Building Shiny App exercises part 4 </a></li>
<li><a title="Building Shiny App exercises part 1" rel="bookmark" href="http://www.r-exercises.com/2016/12/12/building-shiny-app-exercises-part-1/">Building Shiny App exercises part 1 </a></li>
<li><a title="Building Shiny App exercises part 3" rel="bookmark" href="http://www.r-exercises.com/2016/12/25/building-shiny-app-exercises-part-3/">Building Shiny App exercises part 3 </a></li>
<li><a href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
This is to announce that Münster now has its very own R users group!
If you are from the area, come join us (or if you happen to know someone who is and who might be interested, please forward the info).
You can find us on meetup.com: https://ww...
Win-Vector LLC has recently been teaching how to use R with big data through Spark and sparklyr. We have also been helping clients become productive on R/Spark infrastructure through direct consulting and bespoke training. I thought this would be a good time to talk about the power of working with big-data using R, share some … <a href="http://www.win-vector.com/blog/2017/05/new-series-r-and-big-data-concentrating-on-spark-and-sparklyr/">Continue reading <span>New series: R and big data (concentrating on Spark and sparklyr)</span></a>
<p>This week’s R bulletin will cover topics on how to list files, extracting file names, and creating a folder using R. Hope you like this R weekly bulletin. Enjoy reading! Shortcut Keys 1. Run the current chunk – Ctrl+Alt+C 2. Run the next chunk – Ctrl+Alt+N 3. Run the current function definition – Ctrl+Alt+F Problem...</p>
<p>The post <a rel="nofollow" href="https://www.quantinsti.com/blog/r-weekly-bulletin-vol-ix/">R Weekly Bulletin Vol – IX</a> appeared first on <a rel="nofollow" href="https://www.quantinsti.com/"></a>.</p>
If you weren't able to make it to Chicago for R/Finance, the annual conference devoted to applications of R in the financial industry, don't fret: the entire conference is being livestreamed (with thanks to the team at Microsoft). You can watch the proceedings at aka.ms/r_finance, and recordings will be available at the same link after the event. Check out the conference program below for the schedule of events (times in US Central Standard Daylight Time). Friday, May 19th, 2017 09:30 - 09:35 Kickoff 09:35 - 09:40 Sponsor Introduction 09:40 - 10:10 Marcelo Perlin: GetHFData: An R package for downloading and...
In the exercises below we cover the basics of functional programming in R( part 1 of a two series exercises on functional programming) . We consider recursion with R , apply family of functions , higher order functions such as Map ,Reduce,Filter in R . Answers to the exercises are available here. If you obtained […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Accessing Dataframe Objects Exercises" rel="bookmark" href="http://www.r-exercises.com/2016/05/20/accessing-dataframe-objects-exercises/">Accessing Dataframe Objects Exercises </a></li>
<li><a title="Correlation and Correlogram Exercises" rel="bookmark" href="http://www.r-exercises.com/2017/04/08/correlation-and-correlogram-exercises/">Correlation and Correlogram Exercises </a></li>
<li><a title="Building Shiny App exercises part 4" rel="bookmark" href="http://www.r-exercises.com/2017/01/01/building-shiny-app-exercises-part-4/">Building Shiny App exercises part 4 </a></li>
<li><a href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
by Le Zhang (Data Scientist, Microsoft) and Graham Williams (Director of Data Science, Microsoft) The Azure Data Science Virtual Machine (DSVM) is a curated VM which provides commonly-used tools and software for data science and machine learning, pre-installed. AzureDSVM is a new R package that enables seamless interaction with the DSVM from a local R session, by providing functions for the following tasks: Deployment, deallocation, deletion of one or multiple DSVMs; Remote execution of local R scripts: compute contexts available in Microsoft R Server can be enabled for enhanced computation efficiency for either a single DSVM or a cluster of...
Correspondence analysis is a popular data science technique. It takes a large table, and turns it into a seemingly easy-to-read visualization. Unfortunately, it is not quite as easy to read as most people assume. In How...
<p>In this post, I describe the latest iteration of my automatic document production with R. It improves upon the methods used in Rtraining, and previous work on this topic can read by going to the auto deploying R documentation tag.</p>
<p>The post <a rel="nofollow" href="http://itsalocke.com/improving-automatic-document-production-with-r/">Improving automatic document production with R</a> appeared first on <a rel="nofollow" href="http://itsalocke.com/">Locke Data</a>. Locke Data are a data science consultancy aimed at helping organisations get ready and get started with data science.</p>
This document describes the ‘vwline’ package, which provides an R interface for drawing variable-width curves. The package provides functions to draw line segments through a set of locations, or a smooth curve relative to a set of control points, with the width of the line allowed to vary along the length of the line. Paul … <a href="http://stattech.wordpress.fos.auckland.ac.nz/2017/05/19/2017-01-variable-width-lines-in-r/">Continue reading <span>2017-01 Variable-width lines in R</span></a>
Shinydashboard 0.6.0 is now on CRAN! This release of shinydashboard was aimed at both fixing bugs and also bringing the package up to speed with users’ requests and Shiny itself (especially fully bringing bookmarkable state to shinydashboard’s sidebar). In addition to bug fixes and new features, we also added a new “Behavior” section to the […]
While the Riddler puzzle this week was anticlimactic,  as it meant filling all digits in the above division towards a null remainder, it came as an interesting illustration of how different division is taught in the US versus France: when I saw the picture above, I had to go and check an American primary school […]
Get the most out of the EARL Conference with the new phone app, available on iTunes and Google play. View the agenda, speakers, and sponsors in the palm of your hand. Bookmark the sessions you’d like to attend and rate … <a href="http://www.mango-solutions.com/wp/2017/05/new-earl-conference-app/">Continue reading <span>→</span></a>
This set of exercises will help you to help you improve your skills with character functions in R. Most of the exercises are related with text mining, a statistical technique that analyses text using statistics. If you find them interesting I would suggest checking the library tm, this includes functions designed for this task. There […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Regular Expressions Exercises – Part 1" rel="bookmark" href="http://www.r-exercises.com/2016/10/30/regular-expressions-part-1/">Regular Expressions Exercises – Part 1 </a></li>
<li><a title="Scan exercises" rel="bookmark" href="http://www.r-exercises.com/2016/01/11/scan-exercises/">Scan exercises </a></li>
<li><a title="Building Shiny App exercises part 4" rel="bookmark" href="http://www.r-exercises.com/2017/01/01/building-shiny-app-exercises-part-4/">Building Shiny App exercises part 4 </a></li>
<li><a href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
A few days ago, Joel Courtheyn posted the following issue in the errors package repository on GitHub: Experimenting with the new package I detected a difference in calculation of the error depending on the way a formula was written. Originally I tried to calculate the error for z1 &lt;- (x^3 - 2y)/x^0.5 but this gave me… <a href="https://www.enchufa2.es/archives/x-x-is-not-2x.html">Continuar leyendo <span>x + x is not 2x</span> <span>→</span></a>
In this article I will discuss array indexing, operators, and composition in depth. If you work through this article you should end up with a very deep understanding of array indexing and the deep interpretation available when we realize indexing is an instance of function composition (or an example of permutation groups or semigroups: some … <a href="http://www.win-vector.com/blog/2017/05/on-indexing-operators-and-composition/">Continue reading <span>On indexing operators and composition</span></a>
This post will be about creating constant expiry (E.G. a rolling 30-day contract) using VIX settlement data from the CBOE … <span><a href="https://quantstrattrader.wordpress.com/2017/05/18/constant-expiry-vix-futures-using-public-data/">Continue reading <span>→</span></a></span>
Unsupervised learning refers to data science approaches that involve learning without a prior knowledge about the classification of sample data. In Wikipedia, unsupervised learning has been described as “the task of inferring a function to describe hidden structure from ‘unlabeled’ data (a classification of categorization is not included in the observations)”. The overarching objectives of […]<ul></ul><strong><p>Related Post</p></strong><ol><li><a rel="bookmark" href="https://datascienceplus.com/using-mca-and-variable-clustering-in-r-for-insights-in-customer-attrition/" title="Permanent Link toUsing MCA and variable clustering in R for insights in customer attrition">Using MCA and variable clustering in R for insights in customer attrition</a></li><li><a rel="bookmark" href="https://datascienceplus.com/web-scraping-and-applied-clustering-global-happiness-and-social-progress-index/" title="Permanent Link toWeb Scraping and Applied Clustering Global Happiness and Social Progress Index">Web Scraping and Applied Clustering Global Happiness and Social Progress Index</a></li><li><a rel="bookmark" href="https://datascienceplus.com/key-phrase-extraction-from-tweets/" title="Permanent Link toKey Phrase Extraction from Tweets">Key Phrase Extraction from Tweets</a></li><li><a rel="bookmark" href="https://datascienceplus.com/financial-time-series-forecasting-an-easy-approach/" title="Permanent Link toFinancial time series forecasting – an easy approach">Financial time series forecasting – an easy approach</a></li><li><a rel="bookmark" href="https://datascienceplus.com/outlier-detection-and-treatment-with-r/" title="Permanent Link toOutlier detection and treatment with R">Outlier detection and treatment with R</a></li></ol>
Creating the experimental design for a max-diff experiment is easy in R. This post describes how to create and check a max-diff experimental design. If you are not sure what this is, it would be best to read A beginner's guide to max-diff first.
<p>A solution in the R language to Euler Problem 21 which asks to evaluate the sum of all the amicable, or friendly, numbers under 10000. <a href="http://r.prevos.net/euler-problem-21-amicable-numbers/">Continue reading <span>→</span></a></p>
<p>The post <a rel="nofollow" href="http://r.prevos.net/euler-problem-21-amicable-numbers/">Euler Problem 21: Amicable Numbers</a> appeared first on <a rel="nofollow" href="http://r.prevos.net/">The Devil is in the Data</a>.</p>
Copulas are a powerful statistical tool commonly used in the finance sector to generate samples from a given multivariate joint distribution. The principal advantage of using those types of function over other methods is that copulas describe the multivariate joint distribution as his margin and the dependence structure between them, which give the user the […]<div>
<h3>Related exercise sets:</h3><ol><li><a rel="bookmark" href="http://www.r-exercises.com/2016/07/26/stock-prices-analysis-part-1-exercises/" title="Stock prices analysis  part 1 exercises">Stock prices analysis part 1 exercises </a></li>
<li><a rel="bookmark" href="http://www.r-exercises.com/2017/02/13/data-science-for-doctors-part-3-distributions/" title="Data Science for Doctors – Part 3 : Distributions">Data Science for Doctors – Part 3 : Distributions </a></li>
<li><a rel="bookmark" href="http://www.r-exercises.com/2016/08/02/stock-prices-analysis-part-2-exercises/" title="Stock prices analysis part 2 exercises">Stock prices analysis part 2 exercises </a></li>
<li><a href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
<p>We are ready for the third R-Lab, the monthly appointment where we co-work together on a real data science problem using R. This time the R-Lab is promoted by nothing but the Assessorato alla Partecipazione, Cittadinanza Attiva e Open Data of the Comune di Milano! We will access their municipality budget data, and use one day of joint work for designing and realizing an R Shiny app that allows citizens to visualize and explore the city revenues and spending info. </p>
<p>The post <a rel="nofollow" href="http://www.milanor.net/blog/r-lab-3-shiny-comune-milano-explore-municipality-budget-data/">R-Lab #3: A Shiny for the Milano Municipality Budget Data | Milan, May 27th</a> appeared first on <a rel="nofollow" href="http://www.milanor.net/blog">MilanoR</a>.</p>
The Consumer Data Research Centre, the UK-based organization that works with consumer-related organisations to open up their data resources, recently published a new course online: An Introduction to Spatial Data Analysis and Visualization in R. Created by James Cheshire (whose blog Spatial.ly regularly features interesting R-based data visualizations) and Guy Lansley, both of University College London Department of Geography, this practical series is designed to provide an accessible introduction to techniques for handling, analysing and visualising spatial data in R. In addition to a basic introduction to R, the course covers specialized topics around handling spatial and geographic data in...
We’ve just released timekit v0.3.0 to CRAN. The package updates include changes that help with making an accurate future time series with tk_make_future_timeseries() and we’ve added a few features to tk_get_timeseries_signature(). Most important ar...
Looks like I’ll be diving into some Bayesian analyses using JAGS. This post is primarily intended as a collection of links to [potentially] useful information, but also includes a few initial thoughts (I might update it occasionally with new links). In terms of R packages, a very brief play suggests that R2jags is more user […]
You can take your correspondence analysis plots to the next level by including images. Better still, you don’t need to paste in the images after the analysis is complete – you can include them right...
By Ashwin Agrawal URL of the Project Idea: https://github.com/rstats-gsoc/gsoc2017/wiki/Biodiversity-data-cleaning Introduction There are an increasing number of scientists using R for their data analyses, however, the skill set required to handle biodiversity data in R, is considerably varies. Since, users need to retrieve, manage and assess high volume data with complex structure (Darwin Core standard, DwC); only […]
Very excited about the next few weeks which will cover a number of R conferences, workshops or classes with talks, mostly around Rcpp and one notable exception:
May 19: Rcpp: From Simple Examples to Machine learning, pre-conference workshop at our R...
At the New York R Conference earlier this year, my colleague Lixun Zhang gave a presentation on the challenges and opportunites financial services companies encounter when using R. In the talk, he shares some lessons learned while working with an couple of international banks that have been using SAS, but are transitioning workloads to R. The talk also includes an example of operationalizing R code for production using Microsoft R Server. You can see his presentation linked below, and the slides are available here (PDF). You can find many more interesting presentations from the 2017 New York R Conference archived...
I am very happy to announce v0.3.0 of the padr package, which was introduced in January. As requested by many, you are now able to use intervals of which the unit is different from 1. In earlier version the eight interval values only allowed for a single unit (e.g. year, day, hour). Now you can use any time period that is accepted by seq.Date or seq.POSIXt (e.g. 2 months, 6 hours, 5 minutes) in both thicken and pad. get_interval does test for both the interval and the unit of the interval of the datetime variable from now on.
What tools do we use most for data science, machine learning, or analytics? Python, R, SAS, KNIME, RapidMiner,…? How do we use them? We are about to find out as the two most popular surveys on data science tools have … <a href="http://r4stats.com/2017/05/16/data-science-surveys/">Continue reading <span>→</span></a>
It has been a long held dream of mine to create a spinning globe using nothing but R (I wish I was joking, but I’m not). Thanks to the brilliant mapmate package created by Matt Leonawicz and shed loads of computing power, today that dream became a reality. The globe below took 19 hours and 30 […]
Most of the examples of working with most of the AWS services show basic username &amp; password authentication. That’s all well-and-good, but many shops use the AWS Security Token Service to provide temporary credentials and session tokens to limit exposure and provide more uniform multi-factor authentication. At my workplace, Frank Mitchell created a nice electron... <a href="https://rud.is/b/2017/05/16/r%E2%81%B6-using-r-with-amazon-athena-awas-temporary-security-credentials/">Continue reading <span>→</span></a>
I learned statistics and probability by simulating data. Sure, I battled my way through proofs, but I never believed the results until I saw it in a simulation. I guess I have it backwards, it worked for me. And now that I do this for a living, I continue to use simulation to understand models, … <a href="http://r-posts.com/it-can-be-easy-to-explore-data-generating-mechanisms-with-the-simstudy-package/">Continue reading <span>It can be easy to explore data generating mechanisms with the simstudy package</span></a>
Learning Data Science By Doing
DataCamp’s goal is to build the best learning platform for data science. Our philosophy is that you learn data science by doing: our high-quality videos, in-browser coding, and gamification provide learners with an eng...
The new Visual Studio 2017 has built-in support for programming in R and Python. For older versions of Visual Studio, support for these languages has been available via the RTVS and PTVS add-ins, but the new Data Science Workloads in Visual Studio 2017 make them available without a separate add-in. Just choose the &quot;Data Science and analytical applications&quot; option during installation to install everything you need, including Microsoft R Client and the Anaconda Python distribution. If you're new to the Python capabilities in Visual Studio, this Lap Around Python in VS2017 will provide an overview of the capabilities. The capabilities...
One of the most frequently encountered issues in econometrics is endogeneity. Consider the simple Ordinary Least Squares (OLS) regression setting in which we model wages as a function of years of schooling (education): One of the main assumption of OLS is that the independent variables are not correlated with the error term. However, this is […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Forecasting: ARIMAX Model Exercises (Part-5)" rel="bookmark" href="http://www.r-exercises.com/2017/05/05/forecasting-arimax-model-exercises-part-5/">Forecasting: ARIMAX Model Exercises (Part-5) </a></li>
<li><a title="Model Evaluation Exercises 1" rel="bookmark" href="http://www.r-exercises.com/2016/12/02/model-evaluation-exercise-1/">Model Evaluation Exercises 1 </a></li>
<li><a title="Forecasting: Exponential Smoothing Exercises (Part-3)" rel="bookmark" href="http://www.r-exercises.com/2017/04/17/forecasting-exponential-smoothing-exercises-part-3/">Forecasting: Exponential Smoothing Exercises (Part-3) </a></li>
<li><a href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
In this post, I am exploring network analysis techniques in a family network of major characters from Game of Thrones.
Not surprisingly, we learn that House Stark (specifically Ned and Sansa) and House Lannister (especially Tyrion) are the most import...
- I’m looking forward to attending R in Finance conference in Chicago, next friday (2017-05-09). The program looks great! I am really happy, and a bit surprised, to see so many presentations related to market microstructure in...
Hello R community. if you’re up for some fun tinkering with a Shiny App please join me on a new project. I would love to see some collaboration in designing a Shiny Application which will help people make a decision about a healthcare provider. I have only just begun on this project but would to […]
In this article we will show how to run a three-way analysis of variance when both the third-order interaction effect and the second-order interaction effects are statistically significant. This type of analysis can become pretty tedious, especially when our factors have many levels, so we will try to explain it here as clearly as possible. … <a href="http://r-posts.com/three-way-analysis-of-variance-simple-second-order-interaction-effects-and-simple-main-effects/">Continue reading <span>Three-Way Analysis of Variance: Simple Second-Order Interaction Effects and Simple Main Effects</span></a>
If you follow me on Twitter or monitor @Rapid7’s Community Blog you know I’ve been involved a bit in the WannaCry ransomworm triage. One thing I’ve been doing is making charts of the hourly contribution to the Bitcoin addresses that the current/main attackers are using to accept ransom payments (which you really shouldn’t pay, now,... <a href="https://rud.is/b/2017/05/14/r%E2%81%B6-tracking-wannacry-bitcoin-wallet-payments-with-r/">Continue reading <span>→</span></a>
<p>Intro The Great Bambino. The Big Unit. Joltin' Joe. Henry Rowengartner. If you're familiar with the sport of baseball, you might recognize some of these names […]</p>
<p>The post <a rel="nofollow" href="http://blog.nycdatascience.com/student-works/predicting-baseball-hall-fame/">Predicting the Baseball Hall of Fame</a> appeared first on <a rel="nofollow" href="http://blog.nycdatascience.com/">NYC Data Science Academy Blog</a>.</p>
The latest release of the Rborist package, which provides an accelerated
implementation of the Random Forest (TM) algorithm, is available from CRAN.
Version 0.1-6 offers several notable improvements:
Sparse matrix representation
Sparse numeric dcgM...
The telephone had rung when Jean was watching her favorite TV Show. It was a call center selling newspaper, so she got really upset. This situation is not unpleasant just for Jean. The call center is losing too! By calling a person the will never buy whatever is been sold, the call center is wasting […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Intermediate Tree 2" rel="bookmark" href="http://www.r-exercises.com/2017/01/05/intermediate-tree-2/">Intermediate Tree 2 </a></li>
<li><a title="Model Evaluation Exercises 1" rel="bookmark" href="http://www.r-exercises.com/2016/12/02/model-evaluation-exercise-1/">Model Evaluation Exercises 1 </a></li>
<li><a title="Forecasting: ARIMAX Model Exercises (Part-5)" rel="bookmark" href="http://www.r-exercises.com/2017/05/05/forecasting-arimax-model-exercises-part-5/">Forecasting: ARIMAX Model Exercises (Part-5) </a></li>
<li><a href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
In this post I am inspired by two tweets, mainly this one and also this one. Since the total number of articles every year is increasing, no matter which subject you choose, the curve representing number of articles as a function of year of publication...
Imagine a gene that comes in two variants, where one of them is deleterious to the carrier. This is not so hard to imagine, and it is often the case. Most mutations don’t matter at all. Of those that matter, most are damaging. Next, imagine that the mutation happens over and over again with some […]
Visualising uncertainty in time-series using animations
I was reading an example of visualising election outcome uncertainty
using a wobbly
needle and
wondered, could animating uncertainty help communicate for the kind of
work I do on population model...
Last week I posted some analysis of individual voting behaviour in New Zealand’s 2014 general election. In that post, I used logistic regression in four different models to predict the probability of an individual giving party vote to each of the fo...
Shiny Application Layouts – Dynamic UI In the eightth part of our series we will see how we can build a user interface with dynamically generated components. The UI components are generated on the server side with the use of renderUI() and are displayed with uiOutput() on the ui side. Every time a new command […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Building Shiny App exercises part 4" rel="bookmark" href="http://www.r-exercises.com/2017/01/01/building-shiny-app-exercises-part-4/">Building Shiny App exercises part 4 </a></li>
<li><a title="Building Shiny App exercises part 1" rel="bookmark" href="http://www.r-exercises.com/2016/12/12/building-shiny-app-exercises-part-1/">Building Shiny App exercises part 1 </a></li>
<li><a title="Shiny Application Layouts Exercises (Part-2)" rel="bookmark" href="http://www.r-exercises.com/2017/04/26/shiny-application-layout-exercises-part-2/">Shiny Application Layouts Exercises (Part-2) </a></li>
<li><a href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
Abstract
In the latest update to the rwml-R Github repo, R code is provided to complete the analysis of New York City taxi data from Chapter 6 of the book “Real-World Machine Learning” by Henrik Brink, Joseph W. Richards, and Mark Fetherolf. Examp...
We love to engage with R and RStudio users online in webinars and communities because it is so efficient for everyone. But sometimes it’s great to meet in person, too! Next week RStudio will be in Miami, Baltimore and Chicago. We wanted to let you know in case you’ll be there at the same time […]
It's well-known that the home team has an advantage in soccer (or football, as it's called in England). But which teams have made the most of their home-field advantage over the years? Evolutionary biologist (and Liverpool fan) Joe Gallagher analyzed the percentage of points won in the UK Premier League (which awards 3 points for a win and one point for a draw) for teams at home and away: On average, Premier League teams win around 60% of their points at home. The green bars show the 10 teams who won most of their points at home (Burnley managed only...
<p>This week’s R bulletin will cover topics on plotting charts like saving the plot, adding a grid, and plotting multiple data sets in a single plot. Hope you like this R weekly bulletin. Enjoy reading! Shortcut Keys 1. Run current document – Ctrl+Alt+R 2. Run from document beginning to current line – Ctrl+Alt+B 3. Run...</p>
<p>The post <a rel="nofollow" href="https://www.quantinsti.com/blog/r-weekly-bulletin-vol-viii/">R Weekly Bulletin Vol – VIII</a> appeared first on <a rel="nofollow" href="https://www.quantinsti.com/"></a>.</p>
Shiny Application Layouts – Conditional Panel In the seventh part of our series we will use the rnorm() function to create a UI with a Conditional Panel. This type of Panel is visible only when the value of a JavaScript expression is true. The JS expression is re-evaluated every time shiny runs with a different […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Building Shiny App exercises part 4" rel="bookmark" href="http://www.r-exercises.com/2017/01/01/building-shiny-app-exercises-part-4/">Building Shiny App exercises part 4 </a></li>
<li><a title="Building Shiny App exercises part 1" rel="bookmark" href="http://www.r-exercises.com/2016/12/12/building-shiny-app-exercises-part-1/">Building Shiny App exercises part 1 </a></li>
<li><a title="Building Shiny App Exercises (part-9)" rel="bookmark" href="http://www.r-exercises.com/2017/04/01/building-shiny-app-exercises-part-9/">Building Shiny App Exercises (part-9) </a></li>
<li><a href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
<p>Following my post about logistic regressions, Ryan got in touch about one bit of building logistic regressions models that I didn’t cover in much detail – interpreting regression coefficients. This post will hopefully help Ryan (and others) out. @SteffLocke This was</p>
<p>The post <a rel="nofollow" href="http://itsalocke.com/interpreting-regression-cofficients/">How to go about interpreting regression cofficients</a> appeared first on <a rel="nofollow" href="http://itsalocke.com/">Locke Data</a>. Locke Data are a data science consultancy aimed at helping organisations get ready and get started with data science.</p>
Focus for books on R tend to be highly focused on either statisticians or programmers. There is a dearth of material to assist those in typically less quantitative field access the powerful tools in the R ecosystem. Enter Text Analysis with R for Students of Literature. I haven't done a deep read of the book, […]
There's a handy new function in R 3.4.0 for anyone interested in data about CRAN packages. It's not documented, but it's pretty simple: tools::CRAN_package_db() returns a data frame with one row for every package on CRAN and 65 columns of data on those packages, as shown below. > names(tools::CRAN_package_db()) [1] &quot;Package&quot; &quot;Version&quot; &quot;Priority&quot; [4] &quot;Depends&quot; &quot;Imports&quot; &quot;LinkingTo&quot; [7] &quot;Suggests&quot; &quot;Enhances&quot; &quot;License&quot; [10] &quot;License_is_FOSS&quot; &quot;License_restricts_use&quot; &quot;OS_type&quot; [13] &quot;Archs&quot; &quot;MD5sum&quot; &quot;NeedsCompilation&quot; [16] &quot;Additional_repositories&quot; &quot;Author&quot; &quot;Authors@R&quot; [19] &quot;Biarch&quot; &quot;BugReports&quot; &quot;BuildKeepEmpty&quot; [22] &quot;BuildManual&quot; &quot;BuildResaveData&quot; &quot;BuildVignettes&quot; [25] &quot;Built&quot; &quot;ByteCompile&quot; &quot;Classification/ACM&quot; [28] &quot;Classification/ACM-2012&quot; &quot;Classification/JEL&quot; &quot;Classification/MSC&quot; [31] &quot;Classification/MSC-2010&quot; &quot;Collate&quot; &quot;Collate.unix&quot; [34] &quot;Collate.windows&quot; &quot;Contact&quot; &quot;Copyright&quot; [37] &quot;Date&quot; &quot;Description&quot;...
Recently, I read a post regarding a sentiment analysis of Mr Warren Buffett’s annual shareholder letters in the past 40 years written by Michael Toth. In this post, only five of the annual shareholder letters showed negative net sentiment scores, whereas a majority of the letters (88%) displayed a positive net sentiment score. Toth noted […]<ul></ul><strong><p>Related Post</p></strong><ol><li><a title="Permanent Link toUsing MongoDB with R" rel="bookmark" href="https://datascienceplus.com/using-mongodb-with-r/">Using MongoDB with R</a></li><li><a title="Permanent Link toFinding Optimal Number of Clusters" rel="bookmark" href="https://datascienceplus.com/finding-optimal-number-of-clusters/">Finding Optimal Number of Clusters</a></li><li><a title="Permanent Link toAnalyzing the first Presidential Debate" rel="bookmark" href="https://datascienceplus.com/analyzing-the-first-presidential-debate/">Analyzing the first Presidential Debate</a></li><li><a title="Permanent Link toGoodReads: Machine Learning (Part 3)" rel="bookmark" href="https://datascienceplus.com/goodreads-machine-learning-part-3/">GoodReads: Machine Learning (Part 3)</a></li><li><a title="Permanent Link toMachine Learning for Drug Adverse Event Discovery" rel="bookmark" href="https://datascienceplus.com/machine-learning-for-drug-adverse-event-discovery/">Machine Learning for Drug Adverse Event Discovery</a></li></ol>
In advance of upcoming Business Science talks on tidyquant at R/Finance and EARL San Francisco, we are releasing a technical paper entitled “New Tools For Performing Financial Analysis within the ‘Tidy’ Ecosystem”. The technical paper covers an...
About the book
I obtained a copy of this book by Matthew Jockers throughout Universities' access from Springer. You can also get a copy from Amazon.
This book is short and to the point. I would actually strongly recommend it to anyone interested ...
The programme for the 2017 R in Insurance conference in Paris has been published. Talks will discuss new ideas and research with the applications in life and general insurance, from network analysis, reserving, pricing to catastrophe modelling, followe...
<p>A proposed solution in the R language to Euler Problem 20: Find the sum of the digits in the faculty of 100: 100 × 99 × ... × 3 × 2 × 1 <a href="http://r.prevos.net/euler-problem-20/">Continue reading <span>→</span></a></p>
<p>The post <a rel="nofollow" href="http://r.prevos.net/euler-problem-20/">Euler Problem 20: Large Integer Factorials</a> appeared first on <a rel="nofollow" href="http://r.prevos.net/">The Devil is in the Data</a>.</p>
Developer Q&amp;A site Stack Overflow recently introduced Stack Overflow Trends, a useful tool for tracking the growth and decline in the rate of questions asked on various topics (by their Stack Overflow tag). For example, you can see that activity around both R and Python has been increasing over the past 8 years: As you'd expect from a general purpose language, the volume of Python questions is much greater than the volume of R questions. R is a data science language, so it's difficult to compare it with data science usages of Python. But inspired by David Robinson's blog post...
I share an interesting and very complete article published in customer THINK by Bob Hayes about the top skills in data science.Go to the full article:http://customerthink.com/top-10-skills-in-data-science/
In the exercises below we cover how we can Manipulate Biological Data using Seqinr packages Install Packages seqinr Answers to the exercises are available here. If you obtained a different (correct) answer than those listed on the solutions page, please feel free to post your answer as a comment on that page. Exercise 1 Read […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Accessing and Manipulating Biological Databases  Exercises (Part 2)" rel="bookmark" href="http://www.r-exercises.com/2017/05/04/accessing-and-manipulating-biological-databases-exercises-part-2/">Accessing and Manipulating Biological Databases Exercises (Part 2) </a></li>
<li><a title="Bioinformatics Tutorial with Exercises in R (part 1)" rel="bookmark" href="http://www.r-exercises.com/2017/01/22/bioinformatics-lessons-in-r-1-biostrings-exercises/">Bioinformatics Tutorial with Exercises in R (part 1) </a></li>
<li><a title="Accessing and Manipulating Biological Databases  Exercises (Part 1)" rel="bookmark" href="http://www.r-exercises.com/2017/04/29/accessing-and-manipulating-biological-databases-exercises-part-1/">Accessing and Manipulating Biological Databases Exercises (Part 1) </a></li>
<li><a href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
Recently I have been working on a Kaggle competition where participants are tasked with predicting Russian housing prices. In developing a model for the challenge, I came across a few methods for selecting the best regression model for a given dataset. Let’s load up some data and take a look. ## [1] 47 6 ## … <a href="https://realdataweb.wordpress.com/2017/05/10/which-linear-model-is-best/">Continue reading <span>Which linear model is best?</span></a>
One nice feature of NIMBLE’s MCMC system is that a user can easily write new samplers from R, combine them with NIMBLE’s samplers, and have them automatically compiled to C++ via the NIMBLE compiler. We’ve observed that block sampling using a simple adaptive multivariate random walk Metropolis-Hastings sampler doesn’t always work well in practice, so […]
Last week, my Microsoft colleagues Bharath Sankaranarayan and Carl Saroufim presented a live webinar showing how you can predict a patient's length of stay at a hospital using SQL Server R Services. The recorded webinar is available for on-demand viewing now. (Registration is required to view.) The webinar is based on the Machine Learning Solution Template Predicting Length of Stay in Hospitals, which we covered here on the blog back in March. The solution is based on an instance of the Data Science Virtual Machine, which makes it easy to try it yourself. Just click the &quot;Deploy&quot; button to create...
Although MIT OCW has been operating for more than 15 years, I consider it important to do this post as there are still many people who do not know about its existence.MIT OpenCourseWare (OCW) is a web-based publication of virtually all MIT course co...
Shiny Applications Layouts – Absolutely-positioned panel In the sixth part of our journey through Shiny App Layouts we will meet the absolutely-positioned panels. These are panels that you can drag and drop or not wherever you want in the interface. Moreover you can put anything in them, including inputs and outputs. This part can be […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Building Shiny App exercises part 4" rel="bookmark" href="http://www.r-exercises.com/2017/01/01/building-shiny-app-exercises-part-4/">Building Shiny App exercises part 4 </a></li>
<li><a title="Building Shiny App exercises part 1" rel="bookmark" href="http://www.r-exercises.com/2016/12/12/building-shiny-app-exercises-part-1/">Building Shiny App exercises part 1 </a></li>
<li><a title="Shiny Application Layouts exercises part 3" rel="bookmark" href="http://www.r-exercises.com/2017/04/30/shiny-application-layouts-exercises-part-3/">Shiny Application Layouts exercises part 3 </a></li>
<li><a href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
The title is self-descriptive, so I will not dwell on the issue at length before showing the code. Just a small note: to my knowledge, there is only one public snippet out there that addresses this particular problem. It uses the Bioc package rhdf5 and you can find it here. The main problem is that it only works when… <a href="https://www.enchufa2.es/archives/load-a-pythonpandas-data-frame-from-an-hdf5-file-into-r.html">Continuar leyendo <span>Load a Python/pandas data frame from an HDF5 file into R</span> <span>→</span></a>
- Setting a name for a CRAN package is an intimate process. Out of an
infinite range of possibilities, an idea comes for a package and you
spend at least a couple of days writing up and testing your code before
submitting to CRAN...
<p>datasauRus is a package storing the datasets from the paper Same Stats, Different Graphs: Generating Datasets with Varied Appearance and Identical Statistics through Simulated Annealing. It’s a useful package for: Having a dinosaur dataset Showing a dinosaur related variant of</p>
<p>The post <a rel="nofollow" href="http://itsalocke.com/datasaurus-now-cran/">datasauRus now on CRAN</a> appeared first on <a rel="nofollow" href="http://itsalocke.com/">Locke Data</a>. Locke Data are a data science consultancy aimed at helping organisations get ready and get started with data science.</p>
  Both the World Health Organization‘s statistical profile of Qatar and the much more detailed Annual Health Report of the Department of Epidemiology and Medical Statistics of the Sate of Qatar show beyond the shadow of a doubt that cardiovascular diseases, diabetes, hypertension, obesity and other metabolic/noncommunicable diseases are the <a href="http://r-blog.salvaggio.net/?p=611">Read More ...</a>
Tagging this as #rstats-related since many R coders use Travis-CI to automate package builds (and other things). Security researcher Ivan Vyshnevskyi did some ++gd responsible disclosure to the Travis-CI folks letting them know they were leaking the contents of “secure” environment variables in the build logs. The TL;DR on “secure” environment variables is that they... <a href="https://rud.is/b/2017/05/08/travis-ci-flaw-exposed-some-secure-environment-variable-contents/">Continue reading <span>→</span></a>
A week or so ago, I came up with a new chart type – race concordance charts – for looking at a motor circuit race from the on-track perspective of a particular driver. Here are a couple of examples from the 2017 F1 Grand Prix: The gap is the time to the car on track […]
This is the last video of a three part introduction to Bayesian data analysis aimed at you who isn’t necessarily that well-versed in probability theory but that do know a little bit of programming. If you haven’t watched the other parts yet, I re...
Building machine learning and statistical models often requires pre- and post-transformation of the input and/or response variables, prior to training (or fitting) the models. For example, a model may require training on the logarithm of the response and input variables. As a consequence, fitting and then generating predictions from these models requires repeated application of … <br><br><a href="https://alexioannides.com/2017/05/08/machine-learning-pipelines-for-r/">Continue reading</a>
To post your R job on the next post Just visit this link and post a new R job to the R community. You can post a job for free (and there are also “featured job” options available for extra exposure). Current R jobs Job seekers: please follow the links below to learn more and apply for your R job of interest: Featured Jobs Full-Time Data Analyst, Chicago Violence Reduction Strategy National Network for Safe Communities (NNSC) – Posted by nnsc Chicago Illinois, United States 5 May2017 Full-Time Data Scientist for Parkbob @ Wien, Austria Parkbob – Posted by ivan.kasanicky Wien Wien, Austria 20 Apr2017 Full-Time Data Engineer (m/w) Dalia Research GmbH – Posted by Dalia Research Berlin Berlin, Germany 21 Mar2017 More New Jobs Full-Time Data Analyst, Chicago Violence Reduction Strategy National Network for Safe Communities (NNSC) – Posted by nnsc Chicago Illinois, United States 5 May2017 Full-Time Transportation Market Research Analyst @ Arlington, Virginia, U.S. RSG – Posted by patricia.holland@rsginc.com Arlington Virginia, United States 4 May2017 Full-Time Data Manager @ Los Angeles, California, U.S. Virtual Pediatric Systems, LLC – Posted by gsotocampos Los Angeles California, United States 3 May2017 Full-Time Sr. Manager, Analytics @ Minneapolis, Minnesota, U.S. Korn Ferry – Posted by jone1087 Minneapolis Minnesota, United States 3 May2017 Full-Time Health Services Data Science […]
It is my dream to do everything with R. And we aRe almost there. We can write blogs in blogdown or bookdown, write reports in RMarkdown (thank you Yihui Xie!) create interactive webpages with Shiny (thank you Winston Chang). Control our lifx light...
Missing data is a problem that challenge data analysis methodologically and computationally in medical research. Patients of the clinical trials and cohort studies may drop out of the study, and therefore, generate missing data. The missing data could be at random when participants who drop out of study are not different from those who remained […]<ul></ul><strong><p>Related Post</p></strong><ol><li><a title="Permanent Link toCreating Graphs with Python and GooPyCharts" rel="bookmark" href="https://datascienceplus.com/creating-graphs-with-python-and-goopycharts/">Creating Graphs with Python and GooPyCharts</a></li><li><a title="Permanent Link toVisualizing Tennis Grand Slam Winners Performances" rel="bookmark" href="https://datascienceplus.com/visualizing-tennis-grand-slam-winners-performances/">Visualizing Tennis Grand Slam Winners Performances</a></li><li><a title="Permanent Link toPlotting Data Online via Plotly and Python" rel="bookmark" href="https://datascienceplus.com/plotting-data-online-via-plotly-and-python/">Plotting Data Online via Plotly and Python</a></li><li><a title="Permanent Link toUsing PostgreSQL and shiny with a dynamic leaflet map: monitoring trash cans" rel="bookmark" href="https://datascienceplus.com/using-postgresql-and-shiny-with-a-dynamic-leaflet-map-monitoring-trash-cans/">Using PostgreSQL and shiny with a dynamic leaflet map: monitoring trash cans</a></li><li><a title="Permanent Link toVisualizing Streaming Data And Alert Notification with Shiny" rel="bookmark" href="https://datascienceplus.com/visualizing-streaming-data-with-shiny/">Visualizing Streaming Data And Alert Notification with Shiny</a></li></ol>
R is my language of choice for data science but a good data scientist should have some knowledge of all of the great tools available to them. Recently, I have been gleefully using Python for machine learning problems (specifically pandas and the wonderful scikit-learn). However, for all its greatness, I couldn’t help but feel it… <a href="https://sw23993.wordpress.com/2017/05/08/ggplot2-style-plotting-in-python/">Continue reading <span>ggplot2 style plotting in Python</span> <span>→</span></a>
<p>Ever wondered how to make an rmarkdown title dynamic? Maybe, wanted to use a parameter in multiple locations? Maybe wanted to pass through a publication date? Advanced use of YAML headers can help! Normally, when we write rmarkdown, we might</p>
<p>The post <a rel="nofollow" href="http://itsalocke.com/r-quick-tip-sequential-yaml-headers-rmarkdown-parameter-re-use/">R Quick Tip: parameter re-use within rmarkdown YAML</a> appeared first on <a rel="nofollow" href="http://itsalocke.com/">Locke Data</a>. Locke Data are a data science consultancy aimed at helping organisations get ready and get started with data science.</p>
Graham Parsons At Mango we’re often giving R training in locations where a reliable WiFi connection is not always guaranteed, so if we need trainees to download packages from CRAN it can be a show-stopper. Here are a couple of … <a href="http://www.mango-solutions.com/wp/2017/05/installing-packages-without-internet/">Continue reading <span>→</span></a>
<p>By Milind Paradkar In today’s algorithmic trading having a trading edge is one of the most critical elements. It’s plain simple. If you don’t have an edge, don’t trade! Hence, as a quant, one is always on a look out for good trading ideas. One of the good resources for trading strategies that have been...</p>
<p>The post <a rel="nofollow" href="https://www.quantinsti.com/blog/trading-strategy-52-weeks-high-effect-in-stocks/">Trading Strategy: 52-Weeks High Effect in Stocks</a> appeared first on <a rel="nofollow" href="https://www.quantinsti.com/"></a>.</p>
The 2017 Ice Hockey World Championship has started. Thus I want to share a small research on the height of ice hockey players that I did almost a year ago and published in Russian.
Political machinations are a tad insane in the U.S. these days &amp; I regularly hit up @ProPublica &amp; @GovTrack sites (&amp; sub to the GovTrack e-mail updates) as I try to be an informed citizen, especially since I’ve got a Senator and Representative who seem to be in the sway of 🍊. I’ve always appreciated... <a href="https://rud.is/b/2017/05/07/plot-the-vote-making-u-s-senate-house-cartograms-in-r/">Continue reading <span>→</span></a>
Shiny Application Layouts-Vertical Layout In the fifth part of our series we will apply the kmeans() function to the iris dataset to create a shiny application. The difference is that now we will display its result vertically. This part can be useful for you in two ways. First of all, you can see different ways […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Building Shiny App exercises part 7" rel="bookmark" href="http://www.r-exercises.com/2017/02/19/building-shiny-app-exercises-part-7/">Building Shiny App exercises part 7 </a></li>
<li><a title="Building Shiny App exercises part 4" rel="bookmark" href="http://www.r-exercises.com/2017/01/01/building-shiny-app-exercises-part-4/">Building Shiny App exercises part 4 </a></li>
<li><a title="Building Shiny App exercises part 6" rel="bookmark" href="http://www.r-exercises.com/2017/02/07/building-shiny-app-exercises-part-6/">Building Shiny App exercises part 6 </a></li>
<li><a href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
<p>Just a few days ago I stated the following on Twitter: Just reduced the runtime of an algorithm from 9 hours to 3 min. by using a different data structure… Know you data structures 🙂 #rstats — Verena Haunschmid (@ExpectAPatronum) May 1, 2017 Since my tweet has been liked and shared a lot, I thought … <a href="http://blog.haunschmid.name/r-speedup/">Continue reading <span>Know your data structures!</span></a></p>
<p>The post <a rel="nofollow" href="http://blog.haunschmid.name/r-speedup/">Know your data structures!</a> appeared first on <a rel="nofollow" href="http://blog.haunschmid.name/">verenahaunschmid</a>.</p>
Introduction Beginning R users often come to the false impression that the popular packages dplyr and tidyr are both all of R and sui generis inventions (in that they might be unprecedented and there might no other reasonable way to get the same effects in R). These packages and their conventions are high-value, but they … <a href="http://www.win-vector.com/blog/2017/05/dplyr-in-context/">Continue reading <span>dplyr in Context</span></a>
Shiny Application Layouts – Navbar Page Features In the fourth part of our series we will see some of the most important features that a Navbar page provides in order to enhance the appearance of our shiny application. We will use the “Cars” app which we built in Shiny Application Layouts-Navbar Page. This part can […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Building Shiny App exercises part 4" rel="bookmark" href="http://www.r-exercises.com/2017/01/01/building-shiny-app-exercises-part-4/">Building Shiny App exercises part 4 </a></li>
<li><a title="Shiny Application Layouts exercises part 3" rel="bookmark" href="http://www.r-exercises.com/2017/04/30/shiny-application-layouts-exercises-part-3/">Shiny Application Layouts exercises part 3 </a></li>
<li><a title="Building Shiny App exercises part 1" rel="bookmark" href="http://www.r-exercises.com/2016/12/12/building-shiny-app-exercises-part-1/">Building Shiny App exercises part 1 </a></li>
<li><a href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
<p>This week’s R bulletin will cover topics like how to create a sequence of dates, how to add a number to a date and time variable and converting a date in American format to a standard format. Hope you like this R weekly bulletin. Enjoy reading! Shortcut Keys 1. Run current line/selection – Ctrl+Enter 2....</p>
<p>The post <a rel="nofollow" href="https://www.quantinsti.com/blog/r-weekly-bulletin-vol-vii/">R Weekly Bulletin Vol – VII</a> appeared first on <a rel="nofollow" href="https://www.quantinsti.com/"></a>.</p>
We will mention the steps to create your own R package using RStudio and we will provide the link to download the complete MIT guide:&quot;Instructions for Creating Your Own R Package&quot;, In Song kim, Phil Martin, Nina McMurry. February 23, 2016 .1. Start by ...
The US Census Bureau released a new build 1.1.39 of their X-13ARIMA-SEATS program, released as binary and source. So Christoph and went to work and updated our x13binary package on CRAN.
The x13binary package takes the pain out of installing X-13ARIM...
Months ago, I passed by R Questions from Stack Overflow published on Kaggle. I was interested in tag pairs in particular, i.e. which tags appear together in R questions, so I worked on this simple kernel.
Someone asked on Twitter about the characteristics of New Zealand First voters. While some crude conclusions can be drawn from examining votes by location cast and then comparing that with census data, we really need individual level data to answer the...
A new RcppEigen release 0.3.3.3.0 was put into CRAN (and Debian) a few days ago. It brings Eigen 3.3.* to R.
Once again, Yixuan Qiu did most of the heavy lifting over a multi-month period as some adjustments needed to be made in the package itself, a...
I caught a glimpse of a tweet by @dataandme on Friday: Using R &amp; rvest to explore Malaysian property mkt: &quot;Web Scraping: The Sequel, Propwall.my&quot; https://t.co/daZOOJJfPN #rstats #rvest pic.twitter.com/u6QMhm4M3e— Mara Averick (@dataandme) May 5, 2017 Mara is — without a doubt — the best data science promoter in the Twitterverse. She seems to have her... <a href="https://rud.is/b/2017/05/05/scrapeover-friday-a-k-a-another-r-scraping-makeover/">Continue reading <span>→</span></a>
A summary note on recent set of #rstats discoveries in estimating AIC scores to better understand a quasipoisson family in GLMS relative to treating data as poisson. Conceptual GLM workflow rules/guidelines Data are best untransformed. Fit better model to data. Select your data structure to match purpose with statistical model. Use logic and understanding of data not […]
The standard ARIMA (autoregressive integrated moving average) model allows to make forecasts based only on the past values of the forecast variable. The model assumes that future values of a variable linearly depend on its past values, as well as on the values of past (stochastic) shocks. The ARIMAX model is an extended version of […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Forecasting: Linear Trend and ARIMA Models Exercises (Part-2)" rel="bookmark" href="http://www.r-exercises.com/2017/04/15/forecasting-linear-models-exercises-part-2/">Forecasting: Linear Trend and ARIMA Models Exercises (Part-2) </a></li>
<li><a title="Forecasting: Multivariate Regression Exercises (Part-4)" rel="bookmark" href="http://www.r-exercises.com/2017/05/01/forecasting-multivariate-regression-exercises-part-4/">Forecasting: Multivariate Regression Exercises (Part-4) </a></li>
<li><a title="Forecasting: Exponential Smoothing Exercises (Part-3)" rel="bookmark" href="http://www.r-exercises.com/2017/04/17/forecasting-exponential-smoothing-exercises-part-3/">Forecasting: Exponential Smoothing Exercises (Part-3) </a></li>
<li><a href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
The reasons someone might attend a conferences differ from person to person so we crowdsourced the top 10 reasons you should attend EARL San Francisco. 1. Learn something new. This is a pretty obvious one and we’ve got an excellent … <a href="http://www.mango-solutions.com/wp/2017/05/10-reasons-to-attend-earl/">Continue reading <span>→</span></a>
<p>A new version of HIBPwned has been accepted onto CRAN. This occurred yesterday so it could still be filtering into some mirrors. HIBPwned is an R wrapper for the useful website HaveIBeenPwned and if you don’t already utilise the package</p>
<p>The post <a rel="nofollow" href="http://itsalocke.com/minor-update-hibpwned/">Minor update to HIBPwned</a> appeared first on <a rel="nofollow" href="http://itsalocke.com/">Locke Data</a>. Locke Data are a data science consultancy aimed at helping organisations get ready and get started with data science.</p>
Getting certain special symbols into R plots, combined with values that are currently stored in variables, has been an ongoing headache of mine. In particular, plotmath symbols such as the plus-minus sign (±), for which the plotmath command is %+-%, had always caused problems due to my inability to parse the R help documentation. For […]
<p>
A couple of days ago, Molly Brooks and coauthors posted a <a href="http://doi.org/10.1101/132753">preprint</a> on <a href="http://biorxiv.org/">BioRχiv</a> illustrating the use of the <strong>glmmTMB</strong> R package for fitting zero-inflated GLMMs <span>(Brooks et al., 2017)</span>. In the paper, <strong>glmmTMB</strong> is compared with several other GLMM-fitting packages. <strong>mgcv</strong> has recently gained the ability to fit a wider range of families beyond the exponential family of distributions, including zero-inflated Poisson models. <strong>mgcv</strong> can also fit simple GLMMs through a spline equivalent of a Gaussian random effect. So, whilst I was waiting on some Bayesian GAMs to finish sampling, I decided to see how <strong>mgcv</strong> compared against <strong>glmmTMB</strong> on the two examples used in the paper.
</p>
<div>
<div>
<p>
Brooks, M. E., Kristensen, K., Benthem, K. J. van, Magnusson, A., Berg, C. W., Nielsen, A., et al. (2017). Modeling Zero-Inflated count data with glmmTMB. bioRxiv, 132753. doi:<a href="http://doi.org/10.1101/132753">http://doi.org/10.1101/132753</a>.
</p>
</div></div>
In the exercises below we cover how we can Access and Manipulate Biological Data bases through rentrez &amp; Seqinr packages Install Packages rentrez seqinr Answers to the exercises are available here. If you obtained a different (correct) answer than those listed on the solutions page, please feel free to post your answer as a comment […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Accessing and Manipulating Biological Databases  Exercises (Part 1)" rel="bookmark" href="http://www.r-exercises.com/2017/04/29/accessing-and-manipulating-biological-databases-exercises-part-1/">Accessing and Manipulating Biological Databases Exercises (Part 1) </a></li>
<li><a title="Bioinformatics Tutorial with Exercises in R (part 1)" rel="bookmark" href="http://www.r-exercises.com/2017/01/22/bioinformatics-lessons-in-r-1-biostrings-exercises/">Bioinformatics Tutorial with Exercises in R (part 1) </a></li>
<li><a title="Building Shiny App exercises part 1" rel="bookmark" href="http://www.r-exercises.com/2016/12/12/building-shiny-app-exercises-part-1/">Building Shiny App exercises part 1 </a></li>
<li><a href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
- I’m pleased to announce that my book, Processing and Analyzing Financial Data with R, is finally ready! The book is a long term project that I always desired to do. It summarises everything that I wish I knew when I started t...
Data plots can sometimes look very dull and need to be jazzed up a bit. Now, nobody’s suggesting that the important statistical properties of the data be changed, but wouldn’t it be useful if the points could be moved around a bit, to create something visually appealing without losing the desired statistical properties? Readers have […]
It goes without saying that there are always many ways to solve a problem in R, but clearly some ways are better (for example, faster) than others. Recently, I found myself in a situation where I could not find a way to avoid using a loop, and I was immediately concerned, knowing that I would … <a href="http://r-posts.com/everyone-knows-that-loops-in-r-are-to-be-avoided-but-vectorization-is-not-always-possible/">Continue reading <span>Everyone knows that loops in R are to be avoided but vectorization is not always possible</span></a>
Once you've built a predictive model, in many cases the next step is to operationalize the model: that is, generate predictions from the pre-trained model in real time. In this scenario, latency becomes the critical metric: new data typically become available a single row at a time, and it's important to respond with that single prediction (or score) as quickly as possible. Consider the example of presenting your credit card for payment at a store: the bank has to evaluate that transaction as being fraudulent or not, and return that signal to the store while you wait for the credit...
<p>Solution in R to Euler Problem 19: How many Sundays fell on the first of the month during the twentieth century (1 Jan 1901 to 31 Dec 2000)? <a href="http://r.prevos.net/euler-problem-19/">Continue reading <span>→</span></a></p>
<p>The post <a rel="nofollow" href="http://r.prevos.net/euler-problem-19/">Euler Problem 19: Counting Sundays — When does the week start?</a> appeared first on <a rel="nofollow" href="http://r.prevos.net/">The Devil is in the Data</a>.</p>
<p>If you’re getting the following error when you’ve installed R 3.4.0 on Windows, you’re not alone. Error in if (file.exists(dest) &amp;&amp; file.mtime(dest) > file.mtime(lib) &amp;&amp; : missing value where TRUE/FALSE needed The R team have released a patched version but</p>
<p>The post <a rel="nofollow" href="http://itsalocke.com/error-installing-latest-r-version-3-4-0-windows/">Error installing latest R version (3.4.0) on Windows</a> appeared first on <a rel="nofollow" href="http://itsalocke.com/">Locke Data</a>. Locke Data are a data science consultancy aimed at helping organisations get ready and get started with data science.</p>
The timekit package contains a collection of tools for working with time series in R. There’s a number of benefits. One of the biggest is the ability to use a time series signature to predict future values (forecast) through data mining techniques. W...
Informatics (or Information Science) is the practice of creating, storing, finding, manipulating and sharing information. These are all tasks that the R language was designed for, and so Technical Foundations of Informatics, the online course guide for the University of Washington course of the same name, also provides an excellent resource for learning those skills using R. The course guide, co-developed by Michael Freeman and Joel Ross, is a self-contained book that teaches you how to work with data using R in modern and reproducable ways. It assumes no technical background, but jumps quickly into setting up the necessary infrastructure...
Five courses in R are starting tomorrow and the next two months on Statistics.com. You may use the code “2qR-blogger-17″ when registering (offering a reduced rate of $399 instead of,  around, $589 a course).  List of R courses: May 5: Mapping in R taught by Chris Brunsdon, (Director of the National Centre for Geocomputation, at the National University of Ireland, and the co-author of the R package GISTools) – take this f you’ve had some programming, or command line scripting. May 5:  Graphics in R taught by Paul Murrell (Senior Lecturer in the Department of Statistics at the University of Auckland, New Zealand and author of Graphics in R) – take this course to get under the hood and look at core R graphics functions. June 16:  R for Statistical Analysis taught by John Verzani, (City University of NY College of Staten Island and the author Using R for Introductory Statistics) – take this to learn R via your existing knowledge of basic statistics. June 23: Data Mining in R taught by Dr. Inbal Yahav, (a faculty member at the Graduate School of Business  Administration, Bar-Ilan  University, Israel, and co-author of the text Data Mining For Business Analytics Using R)  – take this to learn how to partition data and […]
Sinew is a R package that generates a roxygen2 skeletons populated with information scraped from within the function script. The goal of the package is to automate nearly all of the mundane tasks needed to document functions, properly set up the import fields for oxygenation, and make it easier to attain documentation consistency across functions.  Functionality makeOxygen: … <a href="http://r-posts.com/adding-sinew-to-roxygen2-skeletons/">Continue reading <span>Sinew: a R Package to create self-populating roxygen2 skeletons</span></a>
Operations need to have demand forecasts in order to establish optimal resource allocation policies. But, when we make predictions the only thing that we assure is the occurrence of prediction errors. Fortunately, there is no need to be 100% accurate to succeed, we just need to perform better than our competitors. In this exercise we […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Forecasting: Exponential Smoothing Exercises (Part-3)" rel="bookmark" href="http://www.r-exercises.com/2017/04/17/forecasting-exponential-smoothing-exercises-part-3/">Forecasting: Exponential Smoothing Exercises (Part-3) </a></li>
<li><a title="Forecasting for small business Exercises (Part-3)" rel="bookmark" href="http://www.r-exercises.com/2017/04/25/forecasting-for-small-business-exercises-part-3/">Forecasting for small business Exercises (Part-3) </a></li>
<li><a title="Forecasting: Time Series Exploration Exercises (Part-1)" rel="bookmark" href="http://www.r-exercises.com/2017/04/10/forecasting-time-series-exploration-exercises-part-1/">Forecasting: Time Series Exploration Exercises (Part-1) </a></li>
<li><a href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
<p>I regularly get asked why I don’t consider monthly seasonality in my models for daily or sub-daily time series. For example, <a href="http://disq.us/p/1icjljk">this recent comment</a> on my post on seasonal periods, or <a href="http://disq.us/p/1488nf3">this comment</a> on my post on daily data.</p>
<p>The fact is, I’ve never seen a time series with monthly seasonality, although that does not mean it does not exist. Monthly seasonality would occur if there is some regular activity that takes place every month and which affects the time series.</p>
<p>For example, some companies try to average their expenditure across the month and often have to spend more at the end of the month to justify the budget. So daily expenditure tends to increase at the end of each month, producing a monthly seasonal pattern.</p>
<p>Or imagine a situation where a company always stocks up on supplies on the second Tuesday in every month. Then daily expenditure would have a monthly seasonal pattern.</p>
<p>This type of seasonal pattern is quite difficult to model. The major problem is that months are not of equal length, and Tuesdays do not always fall on the same day of the month. So unlike weekly and yearly seasonality, the seasonal pattern is not periodic and cannot be modelled in the same way that we model other types of seasonality.</p>
<p>The best approach is to consider what is causing the monthly seasonality, and try to allow for it explicitly using regressor variables. If there is an end-of-month effect, then a dummy variable indicating which day(s) are at the end of the month would effectively handle it. If there is a regular event on a specific day in the month (such as the second Tuesday), then again a dummy variable would be best used.</p>
<p>Approximating monthly seasonality by assuming the months are all of 30 days is unlikely to be effective when the seasonality is induced by these types of business practices.</p>
The website dataseries.org aims to be Switzerland’s FRED – a free comprehensive database of Swiss time series. Powered by R and written in Shiny (also using a bit of JavaScript) it allows you to quickly search and explore a large number of data series. Switzerland’s time series in one place Similarly to the United States, public […]
Uncertainty is the biggest enemy of a profitable business. That is especially true of small business who don’t have enough resources to survive an unexpected diminution of revenue or to capitalize on a sudden increase of demand. In this context, it is especially important to be able to predict accurately the change in the markets […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Forecasting: Linear Trend and ARIMA Models Exercises (Part-2)" rel="bookmark" href="http://www.r-exercises.com/2017/04/15/forecasting-linear-models-exercises-part-2/">Forecasting: Linear Trend and ARIMA Models Exercises (Part-2) </a></li>
<li><a title="Forecasting: Exponential Smoothing Exercises (Part-3)" rel="bookmark" href="http://www.r-exercises.com/2017/04/17/forecasting-exponential-smoothing-exercises-part-3/">Forecasting: Exponential Smoothing Exercises (Part-3) </a></li>
<li><a title="Forecasting for small business Exercises (Part-3)" rel="bookmark" href="http://www.r-exercises.com/2017/04/25/forecasting-for-small-business-exercises-part-3/">Forecasting for small business Exercises (Part-3) </a></li>
<li><a href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
Once the pseudo-story [noise] removed, a linear programming Le Monde mathematical puzzle: For the integer linear programming problem max 2x¹+2x²+x³+…+x¹⁰ under the constraints x¹>x²+x³, x²>x³+x⁴, …, x⁹>x¹⁰+x¹, x¹⁰>x¹+x² find a solution with the maximal number of positive entries. Expressed this way, it becomes quite straightforward to solve with the help of a linear programming R […]
There's a reason why data scientists spend so much time exploring data using graphics. Relying only on data summaries like means, variances, and correlations can be dangerous, because wildly different data sets can give similar results. This is a principle that has been demonstrated in statistics classes for decades with Anscombe's Quartet: four scatterplots which despite being qualitatively different all have the same mean and variance and the same correlation between them. (You can easily check this in R by loading the data with data(anscombe).) But what you might not realize is that it's possible to generate bivariate data with...
Tinkering with a new chart type over the weekend, I spotted something rather odd in in my F1 track history charts – what look to be outliers in the form of cars that hadn’t been lapped on that lap appearing behind the lap leader of the next lap, on track. If you count the number […]
I have written about referential transparency before. In this article I would like to discuss “leaky abstractions” and why wrapr::let() supplies a useful (but leaky) abstraction for R programmers. Abstractions A common definition of an abstraction is (from the OSX dictionary): the process of considering something independently of its associations, attributes, or concrete accompaniments. In … <a href="http://www.win-vector.com/blog/2017/05/why-to-use-wraprlet/">Continue reading <span>Why to use wrapr::let()</span></a>
<p>Around 8:30pm I saw this tweet and duly retweeted &lt;throws away Anscombe quartet> https://t.co/WuyU9D6npK — Richie Cotton (@richierocks) May 1, 2017 It turns out awesome folks, George and Justin, had made a process whereby they can generate different distributions of</p>
<p>The post <a rel="nofollow" href="http://itsalocke.com/the-making-of-datasaurus/">The making of datasauRus</a> appeared first on <a rel="nofollow" href="http://itsalocke.com/">Locke Data</a>. Locke Data are a data science consultancy aimed at helping organisations get ready and get started with data science.</p>
Data visualization of sports historical results is one of the means by which champions strengths and weaknesses comparison can be outlined. In this tutorial, we show what plots flavors may help in champions performances comparison, timeline visualization, player-to-player and player-to-tournament relationships. We are going to use the Tennis Grand Slam Tournaments results as outlined by […]<ul></ul><strong><p>Related Post</p></strong><ol><li><a title="Permanent Link toPlotting Data Online via Plotly and Python" rel="bookmark" href="https://datascienceplus.com/plotting-data-online-via-plotly-and-python/">Plotting Data Online via Plotly and Python</a></li><li><a title="Permanent Link toUsing PostgreSQL and shiny with a dynamic leaflet map: monitoring trash cans" rel="bookmark" href="https://datascienceplus.com/using-postgresql-and-shiny-with-a-dynamic-leaflet-map-monitoring-trash-cans/">Using PostgreSQL and shiny with a dynamic leaflet map: monitoring trash cans</a></li><li><a title="Permanent Link toVisualizing Streaming Data And Alert Notification with Shiny" rel="bookmark" href="https://datascienceplus.com/visualizing-streaming-data-with-shiny/">Visualizing Streaming Data And Alert Notification with Shiny</a></li><li><a title="Permanent Link toMetro Systems Over Time: Part 3" rel="bookmark" href="https://datascienceplus.com/metro-systems-over-time-part-3/">Metro Systems Over Time: Part 3</a></li><li><a title="Permanent Link toMetro Systems Over Time: Part 2" rel="bookmark" href="https://datascienceplus.com/metro-systems-over-time-part-2/">Metro Systems Over Time: Part 2</a></li></ol>
<p>In early June I will be speaking at the San Francisco EARL Conference about my experience monetizing my own open source R packages. This is quite...</p>
<p>The post <a rel="nofollow" href="http://www.arilamstein.com/blog/2017/05/01/upcoming-talk-monetizing-r-packages/">Upcoming Talk on Monetizing R Packages</a> appeared first on <a rel="nofollow" href="http://www.arilamstein.com/">AriLamstein.com</a>.</p>
<p>An oft asked question is what resources can I recommend for getting started with data science? Here are my recommendations, and if you have others, please put them in the comments! NB Links in this post may be affiliate links</p>
<p>The post <a rel="nofollow" href="http://itsalocke.com/getting-started-with-data-science-recommended-resources/">Getting started with data science – recommended resources</a> appeared first on <a rel="nofollow" href="http://itsalocke.com/">Locke Data</a>. Locke Data are a data science consultancy aimed at helping organisations get ready and get started with data science.</p>
<p>
One of my more popular <a href="http://stackoverflow.com/a/14424417/429846">answers</a> on StackOverflow concerns the issue of prediction intervals for a generalized linear model (GLM). My answer really only addresses how to compute confidence intervals for parameters but in the comments I discuss the more substantive points raised by the OP in their question. Lately there’s been a bit of back and forth between Jarrett Byrnes and myself about what a prediction “interval” for a GLM might mean. Comments, even on StackOverflow, aren’t a good place for a discussion so I thought I’d post something here that went into a bit more detail as to why, for some common types of GLMs, prediction intervals aren’t that useful and require a lot more thinking about what they mean and how they should be calculated. For illustration, I thought I’d use some small teaching example data sets, but whilst writing the post it started to get a little on the long side. So, I’ve broken it into two and in this part I look at logistic regression.
</p>
<div></div>
Are you an expert R programmer? If so, this is *not* for you. This is a short tutorial for R novices, explaining vectors, a basic R data structure. Here’s an example: 10 150 30 45 20.3 And here’s another one: -5 -4 -3 -2 -1 0 1 2 3 still another one: &quot;Darth Vader&quot; &quot;Luke […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Data Structures Exercises" rel="bookmark" href="http://www.r-exercises.com/2017/03/15/data-structures-exercises/">Data Structures Exercises </a></li>
<li><a title="Unit testing in R using testthat library Exercises" rel="bookmark" href="http://www.r-exercises.com/2017/03/12/unit-testing-in-r-using-testthat-library/">Unit testing in R using testthat library Exercises </a></li>
<li><a title="Descriptive Analytics-Part 1: Data Formatting Exercises" rel="bookmark" href="http://www.r-exercises.com/2016/10/26/descriptive-analytics-part-1-data-formatting/">Descriptive Analytics-Part 1: Data Formatting Exercises </a></li>
<li><a href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
<p>
One of my more popular <a href="http://stackoverflow.com/a/14424417/429846">answers</a> on StackOverflow concerns the issue of prediction intervals for a generalized linear model (GLM). Comments, even on StackOverflow, aren’t a good place for a discussion so I thought I’d post something hereon my blog that went into a bit more detail as to why, for some common types of GLMs, prediction intervals aren’t that useful and require a lot more thinking about what they mean and how they should be calculated. I’ve broken it into two and in this, the second part, I look at Possion models.
</p>
<div></div>
Alteryx Designer, the self-service analytics workflow tool, recently added integration with Microsoft R. This allows you to train models provided by Microsoft R, and create predictions from them, without needing to write R code — you simply drag-and-drop to create a workflow. In a recent post at the Microsoft R blog, Bharath Sankaranarayan walks through the process of building a model to predict response rates in a marketing campaign. In the post, you'll see how to create a workflow that connects to data loaded in SQL Server, and trains a logistic regression model on the data in-database. For the complete...
The database PostgreSQL can have different schemas. These work like a window for users, where they get to see specific things within a database, e.g. tables. In this post we’ll look at how… <a href="https://scottishsnow.wordpress.com/2017/05/01/rpostgresql-schemas/">Continue reading <span>→</span></a>
In the previous exercises of this series, forecasts were based only on an analysis of the forecast variable. Another approach to forecasting is to use external variables, which serve as predictors. This set of exercises focuses on forecasting with the standard multivariate linear regression. Running regressions may appear straightforward but this method of forecasting is […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Forecasting: Linear Trend and ARIMA Models Exercises (Part-2)" rel="bookmark" href="http://www.r-exercises.com/2017/04/15/forecasting-linear-models-exercises-part-2/">Forecasting: Linear Trend and ARIMA Models Exercises (Part-2) </a></li>
<li><a title="Forecasting: Exponential Smoothing Exercises (Part-3)" rel="bookmark" href="http://www.r-exercises.com/2017/04/17/forecasting-exponential-smoothing-exercises-part-3/">Forecasting: Exponential Smoothing Exercises (Part-3) </a></li>
<li><a title="Multiple Regression (Part 3) Diagnostics" rel="bookmark" href="http://www.r-exercises.com/2017/03/11/multiple-regression-part-3-diagnostics/">Multiple Regression (Part 3) Diagnostics </a></li>
<li><a href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
Since getting started with generating templated R reports a few weeks ago, I’ve started spending the odd few minutes every race weekend around looking at ways of automating the generation of F1 qualifying and race reports. Im yesterday’s race, some of the commentary focussed on whether MAS had given BOT an “assist” in blocking VET, […]<img height="1" alt="" width="1" src="https://pixel.wp.com/b.gif?host=blog.ouseful.info&blog=325417&post=16178&subd=ouseful&ref=&feed=1" border="0">
All my previous posts on machine learning have dealt with supervised learning. But we can also use machine learning for unsupervised learning. The latter are e.g. used for clustering and (non-linear) dimensionality reduction.
For this task, I am using...
Last week I published a post about scraping Radio Swiss Classic program. After that, Bob Rudis wrote an extremely useful post improving my code a lot and teaching me cool stuff. I don’t know why I forgot to add pauses between requests… Really bad b...
<p>The web application NYC movie locations guide is a tool designed to aid the visualization, analysis and exploration of movies that have been filmed in New […]</p>
<p>The post <a rel="nofollow" href="http://blog.nycdatascience.com/student-works/r-shiny/movie-lovers-guide-new-york/">A Movie Lover’s Guide to New York</a> appeared first on <a rel="nofollow" href="http://blog.nycdatascience.com/">NYC Data Science Academy Blog</a>.</p>
Shiny Application Layouts-Navbar Page In the third part of our series we will build another small shiny app but use another UI. Specifically we are going to create a Shiny application that includes more than one distinct sub-components each with its own characteristics. For our case we are going to use the cars dataset to […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Building Shiny App exercises part 4" rel="bookmark" href="http://www.r-exercises.com/2017/01/01/building-shiny-app-exercises-part-4/">Building Shiny App exercises part 4 </a></li>
<li><a title="Building Shiny App exercises part 1" rel="bookmark" href="http://www.r-exercises.com/2016/12/12/building-shiny-app-exercises-part-1/">Building Shiny App exercises part 1 </a></li>
<li><a title="Data Science for Doctors – Part 3 : Distributions" rel="bookmark" href="http://www.r-exercises.com/2017/02/13/data-science-for-doctors-part-3-distributions/">Data Science for Doctors – Part 3 : Distributions </a></li>
<li><a href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
This guide is part of a series on setting up your own private server running shiny apps. There are many guides with great advice on how to set up an R shiny server and related software. I try to make a comprehensive guide based in part on these resourc...
Once I realized that my planned, larger post would not come to fruition today I took the R⁶ post (i.e. “minimal expository, keen focus) route, prompted by a Twitter discussion with some R mates who needed to convert “lightly formatted” Microsoft Word (docx) documents to markdown. Something like this: to: This is definitely a job... <a href="https://rud.is/b/2017/04/30/r%E2%81%B6-using-pandoc-from-r-a-neat-package-for-reading-subtitles/">Continue reading <span>→</span></a>
Continuing my exploring methods for spatial visualisation of data in R, today I’m looking at linked micromaps. Micromaps are a way of showing statistical graphics for a small subset of regions at a time, with a small map indicating which regions are...
I don’t do a lot of plotting in my job, but I recently heard about a website called Plotly that provides a plotting service for anyone’s data. They even have a plotly package for Python (among others)! So in this article we will be learning how to plot with their package. Let’s have some fun […]<ul></ul><strong><p>Related Post</p></strong><ol><li><a title="Permanent Link toUsing PostgreSQL and shiny with a dynamic leaflet map: monitoring trash cans" rel="bookmark" href="https://datascienceplus.com/using-postgresql-and-shiny-with-a-dynamic-leaflet-map-monitoring-trash-cans/">Using PostgreSQL and shiny with a dynamic leaflet map: monitoring trash cans</a></li><li><a title="Permanent Link toVisualizing Streaming Data And Alert Notification with Shiny" rel="bookmark" href="https://datascienceplus.com/visualizing-streaming-data-with-shiny/">Visualizing Streaming Data And Alert Notification with Shiny</a></li><li><a title="Permanent Link toMetro Systems Over Time: Part 3" rel="bookmark" href="https://datascienceplus.com/metro-systems-over-time-part-3/">Metro Systems Over Time: Part 3</a></li><li><a title="Permanent Link toMetro Systems Over Time: Part 2" rel="bookmark" href="https://datascienceplus.com/metro-systems-over-time-part-2/">Metro Systems Over Time: Part 2</a></li><li><a title="Permanent Link toMetro Systems Over Time: Part 1" rel="bookmark" href="https://datascienceplus.com/metro-systems-over-time-part-1/">Metro Systems Over Time: Part 1</a></li></ol>
Now that we looked into the basics of [crayon-5904e98bad533532123467-i/] function, we can discuss how the optimisation mechanism works, how the parameters are restricted and what are the initials values for the parameters in the optimisation of the function. This will be fairly technical post for the researchers who are interested in the inner (darker) parts […]
In the exercises below we cover how we can Access and Manipulate Biological Data bases through rentrez &amp; seqinr packages Install Packages rentrez seqinr Answers to the exercises are available here If you obtained a different (correct) answer than those listed on the solutions page, please feel free to post your answer as a comment […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Bioinformatics Tutorial with Exercises in R (part 1)" rel="bookmark" href="http://www.r-exercises.com/2017/01/22/bioinformatics-lessons-in-r-1-biostrings-exercises/">Bioinformatics Tutorial with Exercises in R (part 1) </a></li>
<li><a title="Regular sequences" rel="bookmark" href="http://www.r-exercises.com/2015/10/23/regular-sequences/">Regular sequences </a></li>
<li><a title="Reading delimited data" rel="bookmark" href="http://www.r-exercises.com/2016/01/07/reading-delimited-data/">Reading delimited data </a></li>
<li><a href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
<p>This week’s R bulletin will cover topics like how to parse milliseconds in R, how to format dates and method to extract specific parts of date and time. Hope you like this R weekly bulletin. Enjoy reading! Shortcut Keys 1. Indent – hit Tab button at beginning of the line 2. Outdent – Shift+Tab 3. Go...</p>
<p>The post <a rel="nofollow" href="https://www.quantinsti.com/blog/r-weekly-bulletin-vol-vi/">R Weekly Bulletin Vol – VI</a> appeared first on <a rel="nofollow" href="https://www.quantinsti.com/"></a>.</p>
Running *.XDF files using RevoScaleR computational functions versus have dataset available in Columnstore table or in In-Memory OLTP table will be focus of comparison for this blog post. For this test, I will use the AirLines dataset, available here. Deliberately, I have picked a sample 200 MB (of 13GB dataset) in order to properly test … <a href="https://tomaztsql.wordpress.com/2017/04/28/performance-differences-between-revoscaler-columnstore-table-and-in-memory-oltp-table/">Continue reading <span>Performance differences between RevoScaleR, ColumnStore Table and In-Memory OLTP Table</span></a>
Some things are easy to convert from a long-running sequential process to a system where each part runs at the same time, thus reducing the required time overall. We often call these &quot;embarrassingly parallel&quot; problems, but given how easy it is to reduce the time it takes to execute them by converting them into a parallel process, &quot;pleasingly parallel&quot; may well be a more appropriate name. Using the foreach package (available on CRAN) is one simple way of speeding up pleasingly parallel problems using R. A foreach loop is much like a regular for loop in R, and by default...
<p>Contributed by Brandy Freitas as part of the Spring 2017 NYC Data Science Academy 12-Week Data Science Bootcamp. This post is based on the first class […]</p>
<p>The post <a rel="nofollow" href="http://blog.nycdatascience.com/student-works/trends-teen-risk-behavior-nyc/">Are the Kids Alright? Trends in Teen Risk Behavior in NYC</a> appeared first on <a rel="nofollow" href="http://blog.nycdatascience.com/">NYC Data Science Academy Blog</a>.</p>
Data science enhances people’s decision making. Doctors and researchers are making critical decisions every day. Therefore, it is absolutely necessary for those people to have some basic knowledge of data science. This series aims to help people that are around medical field to enhance their data science skills. We will work with a health related […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Data science for Doctors: Inferential Statistics Exercises(Part-4)" rel="bookmark" href="http://www.r-exercises.com/2017/04/02/data-science-for-doctors-inferential-statistics-part4/">Data science for Doctors: Inferential Statistics Exercises(Part-4) </a></li>
<li><a title="Data science for Doctors: Inferential Statistics Exercises (part-3)" rel="bookmark" href="http://www.r-exercises.com/2017/03/27/data-science-for-doctors-inferential-statistics-exercises-part-3/">Data science for Doctors: Inferential Statistics Exercises (part-3) </a></li>
<li><a title="Data Science for Doctors – Part 1 : Data Display" rel="bookmark" href="http://www.r-exercises.com/2017/01/29/data-science-for-doctors-part-1-data-display/">Data Science for Doctors – Part 1 : Data Display </a></li>
<li><a href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
Based on an interesting dataset from the Wall Street Journal I made the above visualization of the median starting salary for US college graduates from different undergraduate institutions (I have also looked at the mid-career salaries, and the salar...
As many of you will be aware, I like to post some R code, and I especially like to post base R versions of ggplot2 things! Well these amazing boxplots turned up on github – go and check them out! So I did my own version in base R – check out the code here and […]
<p>In shiny, you can use the fileInput with the parameter multiple = TRUE to enable you to upload multiple files at once. But how do you process those multiple files in shiny and consolidate into a single dataset? The bit</p>
<p>The post <a rel="nofollow" href="http://itsalocke.com/upload-multiple-files-in-shiny-and-consolidate-into-a-dataset/">R Quick Tip: Upload multiple files in shiny and consolidate into a dataset</a> appeared first on <a rel="nofollow" href="http://itsalocke.com/">Locke Data</a>. Locke Data are a data science consultancy aimed at helping organisations get ready and get started with data science.</p>
Machine Learning in Production by Szilard Pafka In this talk I will discuss the main...
The Riddler of today has a secretary problem, where one measures sequentially N random variables until one deems the current variable to be the largest of the whole sample. The classical secretary problem has a counter-intuitive solution where one first measures N/e random variables without taking any decision and then and only then picks the […]
Via Max Galka, always a great source of interesting data visualizations, we have this lovely visualization of population density in Europe in 2011, created by Henrik Lindberg: Impressively, the chart was created with just 14 lines of R code: (To recreate it yourself, download the GEOSTAT-grid-POP-1K-2011-V2-0-1.zip file from eurostat, and move the two .csv files inside in range of your R script.) The code parses the latitude/longitude of population centers listed in the CSV file, arranges them into a 0.01 by 0.01 degree grid, and plots each row as a horizontal line with population as the vertical axis. Grid cells...
<p>By Milind Paradkar You say you never programmed in life before? Never heard of words like Classes and Objects, Dataframe, Methods, Inheritance, Loops? Are you fearful of programming, huh? Don’t be! Programming can be fun, stimulating, and once you start and learn to program many of you would love spending hours programming different strategies; you would...</p>
<p>The post <a rel="nofollow" href="https://www.quantinsti.com/blog/overcome-fear-programming/">Overcome the Fear of Programming</a> appeared first on <a rel="nofollow" href="https://www.quantinsti.com/"></a>.</p>
A couple weeks ago I stumbled across a feature in R that I had never heard of before. The functions save(), load(), and the R file type .rda. The .rda files allow a user to save their R data structures such as vectors, matrices, and data frames. The file is automatically compressed, with user options […]
Suppose your friend is a restaurant chain owner (only 3 units) facing some competitors challenges related to low price, lets call it a price war. Inside his business he knows that there’s no much cost to be cut. But, he thinks that, maybe if he tries harder to find better supplier with low freight and […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Lets Begin with something sample" rel="bookmark" href="http://www.r-exercises.com/2016/03/23/lets-begin-with-something-sample/">Lets Begin with something sample </a></li>
<li><a title="Data Science for Operational Excellence (Part-1)" rel="bookmark" href="http://www.r-exercises.com/2017/04/06/data-science-for-operational-excellence-part-1-exercises/">Data Science for Operational Excellence (Part-1) </a></li>
<li><a title="Data Exploration with Tables exercises" rel="bookmark" href="http://www.r-exercises.com/2016/04/20/data-exploration-with-tables-exercises/">Data Exploration with Tables exercises </a></li>
<li><a href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
Thanks to the power of Reddit the “Population Lines” print (buy here) I created back in 2013 has attracted a huge amount of interest in the past week or so (a Europe only version made by Henrik Lindberg made the Reddit front page). There’s been lots of subsequent discussion about it’s inspiration, effectiveness as a form of […]
This post will be detailing a process to create a VIX term structure from freely available CBOE VIX settlement data … <span><a href="https://quantstrattrader.wordpress.com/2017/04/27/creating-a-vix-futures-term-structure-in-r-from-official-cboe-settlement-data/">Continue reading <span>→</span></a></span>
Bach, the epitome of a musician who strove all life long and finally acquired the ‘Habit of Perfection’, was a thoroughly imperfect human being (John Eliot Gardiner, Bach: Music in the Castle of Heaven) Sometimes I dream awake and imagine I am a famous musician.  I fantasize being Paco de Lucía playing Mi niño Curro alone … <a href="https://fronkonstin.com/2017/04/27/genetic-music-from-schoenberg-to-bach/">Continue reading <span>Genetic Music: From Schoenberg to Bach</span> <span>→</span></a>
<p>There is no shortage of analyses on the NYC bike share system. Most of them aim at predicting the demand for bikes and balancing bike stock, […]</p>
<p>The post <a rel="nofollow" href="http://blog.nycdatascience.com/student-works/r-visualization/using-nyc-citi-bike-data-help-bike-enthusiasts-find-mate-dating-app/">Using NYC Citi Bike Data to Help Bike Enthusiasts Find their Mate</a> appeared first on <a rel="nofollow" href="http://blog.nycdatascience.com/">NYC Data Science Academy Blog</a>.</p>
<p>Proposed solution to Euler Problem 18 in the R language. Find the maximum total from top to bottom of a triangle consisting of numbers. <a href="http://r.prevos.net/euler-problem-18-67-maximum-path-sum/">Continue reading <span>→</span></a></p>
<p>The post <a rel="nofollow" href="http://r.prevos.net/euler-problem-18-67-maximum-path-sum/">Euler Problem 18 &amp; 67: Maximum Path Sums</a> appeared first on <a rel="nofollow" href="http://r.prevos.net/">The Devil is in the Data</a>.</p>
Qualtrics allows users to collect online data through surveys. My R package qualtRics contains convenience functions to pull survey results straight into R using the Qualtrics API instead of having to download survey results manually.
Currently, the...
The founder of the NYC-based startup dv01 watched the 2008 financial crisis and was inspired to bring greater transparency to institutional investors in the consumer lending market. Despite being an open-source shop, they switched their data services to Microsoft SQL Server to provide better performance (reducing latency for queries from tens of seconds to under two seconds). They also use R for modeling, as you can see in the video below: Principal Data Scientist Wei Wei Lu also mentions Microsoft Machine Learning in the video. The MicrosoftML package, included in SQL Server R Services and Microsoft R Server 9, provides...
Here is an assortment of R Shiny apps that you may find useful for exploration if you are in the process of learning Shiny and looking for something different. Some of these apps are very small and simple whereas others are large and complex. This repository provides full code and any necessary accompanying data sets. […]
I recently came across a great natural language dataset from Mark Riedel: 112,000 plots of stories downloaded from English language Wikipedia. This includes books, movies, TV episodes, video games- anything that has a Plot section on a Wikipedia page.
...
In the last two weeks, I have posted twice about modifying age bias plots and Bland-Altman-like plots for comparing age estimates. From those posts, I have decided that I prefer to
plot differences between the ages on the y-axis (as com...
SHINY APPLICATION LAYOUTS-PLOT PLUS COLUMNS In the second part of our series we will build another small shiny app but use another UI. More specifically we will present the example of a UI with a plot at the top and columns at the bottom that contain the inputs that drive the plot. For our case […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Building Shiny App exercises part 1" rel="bookmark" href="http://www.r-exercises.com/2016/12/12/building-shiny-app-exercises-part-1/">Building Shiny App exercises part 1 </a></li>
<li><a title="Building Shiny App exercises part 4" rel="bookmark" href="http://www.r-exercises.com/2017/01/01/building-shiny-app-exercises-part-4/">Building Shiny App exercises part 4 </a></li>
<li><a title="Building Shiny App exercises part 3" rel="bookmark" href="http://www.r-exercises.com/2016/12/25/building-shiny-app-exercises-part-3/">Building Shiny App exercises part 3 </a></li>
<li><a href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
I guess we all use it, the good old histogram. One of the first things we are taught in Introduction to Statistics and routinely applied whenever coming across a new continuous variable. However, it easily gets messed up by outliers. Putting most of the data into a single bin or a few bins, and scattering the outliers barely visible over the x-axis. This distribution might look familiar
The knitr package by Yihui Xie is a wonderful tool for reproducible data science. I especially like using it with R Markdown documents, where with some simple markup in an easy-to-read document I can easily combine R code and narrative text to generate an attractive document with words, tables and pictures in HTML, PDF or Word format. Say, something like this: In that document, the numerical weather records and the chart were generated by R, combined into a document using R Markdown, and then generated as a word file with knitr. (You can find the R Markdown file to generate...
Uncertainty is the biggest enemy of a profitable business. That is especially true of small business who don’t have enough resources to survive an unexpected diminution of revenue or to capitalize on a sudden increase of demand. In this context, it is especially important to be able to predict accurately the change in the markets […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Forecasting: Exponential Smoothing Exercises (Part-3)" rel="bookmark" href="http://www.r-exercises.com/2017/04/17/forecasting-exponential-smoothing-exercises-part-3/">Forecasting: Exponential Smoothing Exercises (Part-3) </a></li>
<li><a title="Forecasting: Time Series Exploration Exercises (Part-1)" rel="bookmark" href="http://www.r-exercises.com/2017/04/10/forecasting-time-series-exploration-exercises-part-1/">Forecasting: Time Series Exploration Exercises (Part-1) </a></li>
<li><a title="Multiple Regression (Part 3) Diagnostics" rel="bookmark" href="http://www.r-exercises.com/2017/03/11/multiple-regression-part-3-diagnostics/">Multiple Regression (Part 3) Diagnostics </a></li>
<li><a href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
I’m super excited to announce that plotly 4.6.0 is now on CRAN! Go ahead and install it with: install.packages(&quot;plotly&quot;) This release brings a ton of new features and improvements — some of which are over in the year making. I recently held a webinar introducing the biggest features, including linked views, animation, and crosstalk integration. In […]
We’re delighted to announce our line up for the first San Francisco EARL Conference. As always, we received a large number of excellent abstracts so the Mango team spent many hours deliberating in order to bring the best program to … <a href="http://www.mango-solutions.com/wp/2017/04/speaker-announcment-san-francisco-earl/">Continue reading <span>→</span></a>
I have created a repository (https://github.com/56north/encrypted_dashboard) with code that automatically sets up Rstudio Server and Shiny Server behind and Nginx proxy with SSL certificates. The two servers share apps and packages so you can build cool stuff in Rstudio and deploy it immediately to Shiny. Woow!!! 😀 Below is the readme from the repo. I... <a title="Read Setup encrypted Rstudio and Shiny dashboard solution in 3 minutes" href="http://www.56n.dk/setup-encrypted-rstudio-and-shiny-dashboard-solution-in-3-minutes/">Read more »</a>
Rent Prices are Soaring in Most of Colorado Call it gentrification, supply-and-demand, call it whatever you’d like… the fact is, rent prices have gone up in Colorado in the last decade. Chip Oglesby – GitHub – did a nice analysis on the data provided by colorado.gov. Chip’s analysis can be seen here. His analysis states, […]
In this post we look at stop-loss orders in quantstrat, and how to pick optimal parameters for a strategy.
<p>Choroplethr version 3.6.1 is now on CRAN. This version makes it easier to Calculate the percent change in demographic datasets Visualize that percent change on a...</p>
<p>The post <a rel="nofollow" href="http://www.arilamstein.com/blog/2017/04/24/choroplethr-v3-6-1-now-cran/">Choroplethr v3.6.1 is now on CRAN</a> appeared first on <a rel="nofollow" href="http://www.arilamstein.com/">AriLamstein.com</a>.</p>
Optimized transportation planning is a task usually left to the firm’s logistic department. However, it is often difficult to visualize, specially if there are many points involved in the logistic network. R and its packages can help solving this issue. Our goal here is to expand logistics networking visualization. In order to do that, we […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Descriptive Analytics-Part 5: Data Visualisation (Spatial data)" rel="bookmark" href="http://www.r-exercises.com/2016/12/26/descriptive-analytics-part-5-data-visualisation-spatial/">Descriptive Analytics-Part 5: Data Visualisation (Spatial data) </a></li>
<li><a title="Bind exercises" rel="bookmark" href="http://www.r-exercises.com/2016/02/22/bind-exercises/">Bind exercises </a></li>
<li><a title="Spatial analysis with ggmap Exercises (part-1)" rel="bookmark" href="http://www.r-exercises.com/2017/03/09/spatial-analysis-with-ggmap-exercises-part-1/">Spatial analysis with ggmap Exercises (part-1) </a></li>
<li><a href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
R 3.4.0, the latest release of the R programming language (codename: &quot;You Stupid Darkness&quot;), is now available. This is the annual major update to the R language engine, and provides improved performance for R programs. The source code was released by the R Core Team on Friday and binaries for Windows, Mac and Linux are available for download now from CRAN. The most significant change in this release is that the JIT ('Just In Time') byte-code compiler is now enabled at level 3 by default. This means that top-level loops will be compiled before being run, and all functions will...
In physics, engineering and other disciplines, a single number, a bare quantity, is useless, meaningless. When you measure something, your results will be within the precision of your equipment, and then you need to propagate those errors up to whatever final indirect measure you are interested in. Finally, you need to express it properly. For… <a href="https://www.enchufa2.es/archives/errors-0-0-1.html">Continuar leyendo <span>errors 0.0.1</span> <span>→</span></a>
This is a very short post on mapping with ggplot2.
<p>I recently delivered a day of training at SQLBits and I really upped my game in terms of infrastructure for it. The resultant solution was super smooth and mitigated all the install issues and preparation for attendees. This meant we</p>
<p>The post <a rel="nofollow" href="http://itsalocke.com/r-training-environment/">Building an R training environment</a> appeared first on <a rel="nofollow" href="http://itsalocke.com/">Locke Data</a>. Locke Data are a data science consultancy aimed at helping organisations get ready and get started with data science.</p>
R 3.4.0 (codename “You Stupid Darkness”) was released 3 days ago. You can get the latest binaries version from here. (or the .tar.gz source code from here). The full list of bug fixes and new features is provided below. As mentioned two months ago by David Smith, R 3.4.0 indicates several major changes aimed at improving the performance of R in … <a href="https://www.r-statistics.com/2017/04/r-3-4-0-is-released-with-new-speed-upgrades-and-bug-fixes/">Continue reading<span> &quot;R 3.4.0 is released – with new speed upgrades and bug-fixes&quot;</span></a>
<p>Basic NLP in R With text survey data about AirBnb R is a very powerful programming language with many great built in statistical functions and a […]</p>
<p>The post <a rel="nofollow" href="http://blog.nycdatascience.com/student-works/nlp-with-airbnb/">NLP with AirBnb</a> appeared first on <a rel="nofollow" href="http://blog.nycdatascience.com/">NYC Data Science Academy Blog</a>.</p>
In this set of exercises we shall follow the practice of conducting an experimental study. Researcher wants to see if there is any influence of working-out on body mass. Three groups of subjects with similar food and sport habits were included in the experiment. Each group was subjected to a different set of exercises. Body […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Repeated measures ANOVA in R Exercises" rel="bookmark" href="http://www.r-exercises.com/2016/11/29/repeated-measures-anova-in-r-exercises/">Repeated measures ANOVA in R Exercises </a></li>
<li><a title="One Way Analysis of Variance Exercises" rel="bookmark" href="http://www.r-exercises.com/2016/09/30/one-way-analysis-of-variance-exercises/">One Way Analysis of Variance Exercises </a></li>
<li><a title="Data science for Doctors: Inferential Statistics Exercises (part-2)" rel="bookmark" href="http://www.r-exercises.com/2017/03/19/data-science-for-doctors-inferential-statistics-exercises-part-2/">Data science for Doctors: Inferential Statistics Exercises (part-2) </a></li>
<li><a href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
I am not a classical music expert at all, but I happen to have friends who are, and am even married to someone playing the cello (and the ukulele!). I appreciate listening to such music from time to time, in particular Baroque music. A friend made me d...
The classification decisions made by machine learning models are usually difficult - if not impossible - to understand by our human brains. The complexity of some of the most accurate classifiers, like neural networks, is what makes them perform so wel...
I’ve been trying to catch up with mapping functionality in R and its extended ecoverse, so might do a few posts on this in the next month or so. First up (more or less by accident) is cartograms - maps where some other numeric variable is substitut...
This guide is part of a series on setting up your own private server running shiny apps. There are many guides with great advice on how to set up an R shiny server and related software. I try to make a comprehensive guide based in part on these resourc...
This week, I am exploring Holger K. von Jouanne-Diedrich’s OneR package for machine learning. I am running an example analysis on world happiness data and compare the results with other machine learning models (decision trees, random forest, gradient...
Abstract
The rwml-R Github repo is updated with R code for exploratory data analysis of New York City taxi data from Chapter 6 of the book “Real-World Machine Learning” by Henrik Brink, Joseph W. Richards, and Mark Fetherolf. Examples given includ...
Another interesting thing that an R course participant identified: Sometimes one wants to make a function that returns multiple layers to be added to a ggplot2 plot. One could think that just adding them and returning would work, but it doesn’t. I think it has to do with how + is evaluated. There are a […]
Hello everyone, The more I am learning about Data Science, the more I see how complex it is and how much variety it has. Due to this, I wanted to have a more complete blog which would tackle Data Science and its variety. So here is Enhance Data Science, the blog will have four mains […]
<p>In real estate, spatial data is the name of the game. Countless other domains utilize the power of this data, which is becoming more prevalent by the day. In this post I will go over a few simple, but powerful tools to get you started using using geographic information in R. GISTools provides an easy-to-use […]</p>
Analytical challenges in multivariate data analysis and predictive modeling include identifying redundant and irrelevant variables. A recommended analytics approach is to first address the redundancy; which can be achieved by identifying groups of variables that are as correlated as possible among themselves and as uncorrelated as possible with other variable groups in the same data […]<ul></ul><strong><p>Related Post</p></strong><ol><li><a title="Permanent Link toWeb Scraping and Applied Clustering Global Happiness and Social Progress Index" rel="bookmark" href="https://datascienceplus.com/web-scraping-and-applied-clustering-global-happiness-and-social-progress-index/">Web Scraping and Applied Clustering Global Happiness and Social Progress Index</a></li><li><a title="Permanent Link toKey Phrase Extraction from Tweets" rel="bookmark" href="https://datascienceplus.com/key-phrase-extraction-from-tweets/">Key Phrase Extraction from Tweets</a></li><li><a title="Permanent Link toFinancial time series forecasting – an easy approach" rel="bookmark" href="https://datascienceplus.com/financial-time-series-forecasting-an-easy-approach/">Financial time series forecasting – an easy approach</a></li><li><a title="Permanent Link toOutlier detection and treatment with R" rel="bookmark" href="https://datascienceplus.com/outlier-detection-and-treatment-with-r/">Outlier detection and treatment with R</a></li><li><a title="Permanent Link toImplementing Apriori Algorithm in R" rel="bookmark" href="https://datascienceplus.com/implementing-apriori-algorithm-in-r/">Implementing Apriori Algorithm in R</a></li></ol>
I caught this “gem” in the Wall Street Journal tonight: It’s pretty hard to compare store-to-store, even though it is fairly clear which ones are going-going-gone. If we want to see the relative percentage of each store closing and also want to see how they stack up against each other, then let’s make a column... <a href="https://rud.is/b/2017/04/21/shuttering-pies-with-retiring-stores/">Continue reading <span>→</span></a>
R is a very fluid language amenable to meta-programming, or alterations of the language itself. This has allowed the late user-driven introduction of a number of powerful features such as magrittr pipes, the foreach system, futures, data.table, and dplyr. Please read on for some small meta-programming effects we have been experimenting with. Meta-Programming Meta-programming is … <a href="http://www.win-vector.com/blog/2017/04/programming-over-r/">Continue reading <span>Programming over R</span></a>
<p>This week’s R bulletin will cover topics like how to avoid for-loops, add or shorten an existing vector, and play a beep sound in R. We will also cover functions like env.new function, readSeries, and the with and within functions. Hope you like this R weekly bulletin. Enjoy reading! Shortcut Keys 1. To stop debugging...</p>
<p>The post <a rel="nofollow" href="https://www.quantinsti.com/blog/r-weekly-bulletin-vol-v/">R Weekly Bulletin Vol – V</a> appeared first on <a rel="nofollow" href="https://www.quantinsti.com/"></a>.</p>
There are a few packages for sending email directly from R, but I work in a place where none of these work due to strict network settings. To at least partially circumvent this, here’s some code to produce a PowerShell script to send email(s) via Outlook. The PowerShell script can then be run either by […]
Yesterday, I had the honour of presenting at The Data Science Conference in Chicago. My topic was Reproducible Data Science with R, and while the specific practices in the talk are aimed at R users, my intent was to make a general argument for doing data science within a reproducible workflow. Whatever your tools, a reproducible process: Saves time, Produces better science, Creates more trusted research, Reduces the risk of errors, and Encourages collaboration. Sadly there's no recording of this presentation, but my hope is that the slides are sufficiently self-contained. Some of the images are links to further references,...
<p>Logistic regressions are a great tool for predicting outcomes that are categorical. They use a transformation function based on probability to perform a linear regression. This makes them easy to interpret and implement in other systems. Logistic regressions can be</p>
<p>The post <a rel="nofollow" href="http://itsalocke.com/logistic-regressions-r/">Logistic regressions (in R)</a> appeared first on <a rel="nofollow" href="http://itsalocke.com/">Locke Data</a>. Locke Data are a data science consultancy aimed at helping organisations get ready and get started with data science.</p>
In the Exercises we will discuss User Defined Function in R Answers to the exercises are available here. Exercise 1 Create a function to print square of number Exercise 2 Create a function to print a number raise to another with the one argument a default argument Exercise 3 Create a function to print class […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Matrix exercises" rel="bookmark" href="https://www.r-exercises.com/2015/11/28/matrix-exercises/">Matrix exercises </a></li>
<li><a title="Functions exercises vol. 2" rel="bookmark" href="https://www.r-exercises.com/2016/12/05/functions-exercises-vol-2/">Functions exercises vol. 2 </a></li>
<li><a title="Data frame exercises Vol. 2" rel="bookmark" href="https://www.r-exercises.com/2016/11/28/data-frame-exercises-vol-2/">Data frame exercises Vol. 2 </a></li>
<li><a href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
Last week I posted about a modified age bias plot. In this post I began looking more deeply at an alternative plot called the Bland-Altman plot. Below, I describe this plot, demonstrate how to construct it in R, give a mild critique of its ...
Time for a new release of Rblpapi -- version 0.3.6 is now on CRAN. Rblpapi provides a direct interface between R and the Bloomberg Terminal via the C++ API provided by Bloomberg Labs (but note that a valid Bloomberg license and installation is requir...
<p>In R-Lab#2 we realized a Shinyapp that shows the earthquakes evolution over the Bove-Vettore fault. Here report, code, slides and app!</p>
<p>The post <a rel="nofollow" href="http://www.milanor.net/blog/earthquakes-maps-report-shinyapp-from-r-lab2/">Earthquakes &amp; Maps - Report and shinyapp from R-Lab#2</a> appeared first on <a rel="nofollow" href="http://www.milanor.net/blog">MilanoR</a>.</p>
One of the major announcements from yesterday's Data Amp event was that SQL Server 2017 will add Python as a supported language. Just as with the continued R support, SQL Server 2017 will allow you to process data in the database using any Python function or package without needing to export the data from the database, and use SQL Server itself as an operationalization platform for production applications using Python code. In addition, the high-performance and distributed statistical and machine learning functions from the RevoScaleR and MicrosoftML packages in Microsoft R will be available as Python functions for use within...
Seven months, two weeks and three days ago, we “officially” released Datazar version 1.0 to the general public. I put officially in quotes because Datazar has always been available to the general public. We develop with our community to ensure that...
R programming has seen a big shift in the last couple of years. All those packages that RStudio have been creating to solve this or that problem suddenly started to cohere into a larger ecosystem of packages. Once it was given a name, the tidyverse, it became possible to start thinking about the structure of […]
I’m pleased to announce that readxl 1.0.0 is available on CRAN. readxl makes it easy to bring tabular data out of Excel and into R, for modern .xlsx files and the legacy .xls format. readxl does not have any tricky external dependencies, such as Java or Perl, and is easy to install and use on […]
<p>Playing arcade games in R? Introducing pong, the first R-cade game. This code simulates the legendary game of pong in your favourite data science language. <a href="http://r.prevos.net/pong/">Continue reading <span>→</span></a></p>
<p>The post <a rel="nofollow" href="http://r.prevos.net/pong/">R-Cade Games: Simulating the Legendary Game of Pong</a> appeared first on <a rel="nofollow" href="http://r.prevos.net/">The Devil is in the Data</a>.</p>
I pushed a bug-fix release of quantmod to CRAN last night. The major changes were togetSymbols.FRED (#141)getSymbols.oanda (#144)getSymbols.yahoo (#149)All three providers made breaking changes to their URLs/interfaces.getSymbols.google also got some ...
During today's Data Amp online event, Joseph Sirosh announced the new Microsoft R Server 9.1, which is available for customers now. In addition the updated Microsoft R Client, which has the same capabilities for local use, is available free for everyone on both Windows and — new to this update — Linux. This release adds many new capabilities to Microsoft R, including: Based on R 3.3.3. This update is based on the latest release of open source R from the R Foundation, bringing many improvements to the core language engine. Microsoft R Client now available on Linux. The Microsoft R...
Support Vector Machines (SVM) is a data classification method that separates data using hyperplanes. The concept of SVM is very intuitive and easily understandable. If we have labeled data, SVM can be used to generate multiple separating hyperplanes such that the data space is divided into segments and each segment contains only one kind of … <a href="http://r-posts.com/machine-learning-using-support-vector-machines/">Continue reading <span>Machine Learning Using Support Vector Machines</span></a>
<p>The recent(ish) advent of parameters in rmarkdown reports is pretty nifty but there’s a little bit of behaviour that can come in handy but doesn’t come across in the documentation. You can use table parameters for rmarkdown reports. Previously, if</p>
<p>The post <a rel="nofollow" href="http://itsalocke.com/table-parameters-rmarkdown-reports/">R Quick Tip: Table parameters for rmarkdown reports</a> appeared first on <a rel="nofollow" href="http://itsalocke.com/">Locke Data</a>. Locke Data are a data science consultancy aimed at helping organisations get ready and get started with data science.</p>
There are several aspects of the R language that make it hard to learn, and repeating a model for groups in a data set used to be one of them. Here I briefly describe R’s built-in approach, show a much … <a href="http://r4stats.com/2017/04/18/group-by-modeling-in-r-made-easy/">Continue reading <span>→</span></a>
Data visualization and charting are actively evolving as a more and more important field of web development. In fact, people perceive information much better when it is represented graphically rather than numerically as raw data. As a result, various business intelligence apps, reports, and so on widely implement graphs and charts to visualize and clarify … <a href="http://r-posts.com/creating-interactive-charts-with-r-shiny-mysql-and-anychart-js-via-template/">Continue reading <span>Creating Interactive Charts with R, Shiny, MySQL and AnyChart JS via Template</span></a>
Warren Buffett — known as the &quot;Oracle of Omaha&quot; — is one of the most successful investors of all time. Wherever the winds of the market may blow, he always seems to find a way to deliver impressive returns for his investors and his company, Berkshire Hathaway. Every year he authors his famous &quot;shareholder letter&quot; with his musing about the market and investment strategy and — perhaps as reflects his continued success — this sentiment analysis of his letters by data scientist Michael Toth shows that the tone has been generally positive over time. Only five of the forty years...
We have been developing weighted effect coding in an ongoing series of publications (hint: a publication in the R Journal will follow). To include nominal and ordinal variables as predictors in regression models, their categories ...
The technology is available for researchers to create a reproducible manuscript whereby calculations and graphs are generated computationally – thereby saving researcher time and avoiding human error. eLife is exploring ways to support life and biomedical scientists who wish to communicate their research in this way. In this post, Chris Hartgerink, a metascience researcher at Tilburg … <a href="http://r-posts.com/composing-reproducible-manuscripts-using-r-markdown/">Continue reading <span>Composing reproducible manuscripts using R Markdown</span></a>
It’s likely you’ve seen the news regarding yet-another researcher showing off a phishing domain attack. The technique is pretty simple: find a target domain you want to emulate register a homoglpyh version of it use the hacker’s favorite tool, Let’s Encrypt to serve it up with a nice, shiny green lock icon deploy some content... <a href="https://rud.is/b/2017/04/17/when-homoglyphs-attack-generating-phishing-domain-names-with-r/">Continue reading <span>→</span></a>
A purely arithmetic Le Monde mathematical puzzle: Find the four integers w, x, y, z such that the four smallest pairwise sums among the six pairwise sums are 59, 65, 66, and 69. Similarly, find the four smallest of the five integers v, x, y, z such that the five smallest pairwise sums among the […]
Nomograms are useful computational tools for model visualisation, graphical assessment of variable importance and the calculation of predicted values.  The nomogram function in the rms package is a popular way of creating (static) nomograms for a variety of regression models. For example, the following code will generate a nomogram from a logistic regression model used … <a href="http://r-posts.com/generating-dynamic-nomograms-using-dynnom/">Continue reading <span>Generating Dynamic Nomograms using DynNom</span></a>
<p>Choroplethr version 3.6.0 is now on CRAN. This version adds functionality for getting and mapping demographics of US Census Tracts. You can install it from...</p>
<p>The post <a rel="nofollow" href="http://www.arilamstein.com/blog/2017/04/17/choroplethr-v3-6-0-now-cran/">Choroplethr v3.6.0 is now on CRAN</a> appeared first on <a rel="nofollow" href="http://www.arilamstein.com/">AriLamstein.com</a>.</p>
There will be free AI workshop in Seattle on May 9, presented by members of the Microsoft Data Science team. The AI Immersion Workshop includes five specializations to choose from (in parallel tracks), all focused on an aspect of developing and deploying intelligent applications: Applied Machine Learning for Developers, featuring Microsoft R Server and Azure Machine Learning Big AI – Applying Artificial Intelligence at Scale, with examples of machine learning and AI on structured and unstructured data Weaving Cognitive and Azure Services to Provide Next-Generation Intelligence, featuring the Microsoft Cognitive Services APIs Deep Learning and the Microsoft Cognitive Toolkit Building...
In my previous blog post, Saving input and output with sp_execute_external_script, I was exploring the possibilities how to capture the R code that external procedure sends it internally to the Launchpad.exe program.  And a blog comment by reader Bob gave me additional push to write the second part to same topic. Thank you Bob for … <a href="https://tomaztsql.wordpress.com/2017/04/17/saving-input-and-output-with-sp_execute_external_script-using-temporal-table-and-file-table-part-2/">Continue reading <span>Saving input and output with sp_execute_external_script using temporal table and file table (part #2)</span></a>
To post your R job on the next post Just visit this link and post a new R job to the R community. You can post a job for free (and there are also two “featured job” options available for extra exposure). Current R jobs Job seekers: please follow the links below to learn more and apply for your R job of interest: Featured Jobs Full-Time Data Science/Biomedical Engineering Trinity College Dublin – Posted by lucydoogan Dublin County Dublin, Ireland 11 Apr2017 Freelance R and Shiny Application Dev and Support Zenith Media – Posted by Timmwardion Melbourne Victoria, Australia 5 Apr2017 Full-Time Technical Support Engineer at RStudio RStudio – Posted by agadrow Anywhere 28 Mar2017 Full-Time Data Engineer (m/w) Dalia Research GmbH – Posted by Dalia Research Berlin Berlin, Germany 21 Mar2017 More New Jobs Full-Time Data Science/Biomedical EngineeringTrinity College Dublin – Posted by lucydoogan DublinCounty Dublin, Ireland 11 Apr2017 Freelance R and Shiny Application Dev and SupportZenith Media – Posted by Timmwardion MelbourneVictoria, Australia 5 Apr2017 Full-Time Data Scientist – Analytics in Booking.com @ Amsterdam, Noord-Holland, NetherlandsBooking.com – Posted by work_at_booking AmsterdamNoord-Holland, Netherlands 5 Apr2017 Full-Time Data Scientist @ Mumbai, Maharashtra, Indiacitiustech – Posted by suchita nagar MumbaiMaharashtra, India 3 Apr2017 Full-Time Technical Support Engineer at RStudioRStudio […]
Small area estimation (SAE) has become a widely used technique in official statistics since the last decade of past century. When the sample size is not enough to provide reliable estimates at a very particular level, the power of models and auxiliary ...
Data science enhances people’s decision making. Doctors and researchers are making critical decisions every day. Therefore, it is absolutely necessary for those people to have some basic knowledge of data science. This series aims to help people that are around medical field to enhance their data science skills. We will work with a health related […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Data science for Doctors: Inferential Statistics Exercises(Part-4)" rel="bookmark" href="http://www.r-exercises.com/2017/04/02/data-science-for-doctors-inferential-statistics-part4/">Data science for Doctors: Inferential Statistics Exercises(Part-4) </a></li>
<li><a title="Data science for Doctors: Inferential Statistics Exercises (part-2)" rel="bookmark" href="http://www.r-exercises.com/2017/03/19/data-science-for-doctors-inferential-statistics-exercises-part-2/">Data science for Doctors: Inferential Statistics Exercises (part-2) </a></li>
<li><a title="Data science for Doctors: Inferential Statistics Exercises (part-3)" rel="bookmark" href="http://www.r-exercises.com/2017/03/27/data-science-for-doctors-inferential-statistics-exercises-part-3/">Data science for Doctors: Inferential Statistics Exercises (part-3) </a></li>
<li><a href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
Moments ago Rcpp passed a big milestone as there are now 1000 packages on CRAN depending on it (as measured by Depends, Imports and LinkingTo, but excluding Suggests). The graph is on the left depicts the growth of Rcpp usage over time.
One easy way...
About a year-and-a-half ago, some students and I wrote OMSI, Online Measurement of Student Insight, an online software tool to improve examinations for students and save instructors lots of time and drudgery currently spent on administering exams. It is written in a mixture of Python and R. (Python because it was easier to find students … <a href="https://matloff.wordpress.com/2017/04/15/online-but-in-class-examinations-with-an-r-example/">Continue reading <span>Online But In-Class Examinations (with an R Example)</span> <span>→</span></a>
This guide is part of a series on setting up your own private server running shiny apps. There are many guides with great advice on how to set up an R shiny server and related software. I try to make a comprehensive guide based in part on these resourc...
(or: how to correctly use xgboost from R) R has &quot;one-hot&quot; encoding hidden in most of its modeling paths. Asking an R user where one-hot encoding is used is like asking a fish where there is water; they can’t point to it as it is everywhere. For example we can see evidence of one-hot encoding … <a href="http://www.win-vector.com/blog/2017/04/encoding-categorical-variables-one-hot-and-beyond/">Continue reading <span>Encoding categorical variables: one-hot and beyond</span></a>
There are two main approaches to time series forecasting. One of them is to find persistent patterns in a time series itself, and extrapolate those patterns. Another approach is to discover how a series depend on other variables, which serve as predictors. This set of exercises focuses on the first approach, while the second one […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Multiple Regression (Part 3) Diagnostics" rel="bookmark" href="http://www.r-exercises.com/2017/03/11/multiple-regression-part-3-diagnostics/">Multiple Regression (Part 3) Diagnostics </a></li>
<li><a title="Forecasting for small business Exercises (Part-1)" rel="bookmark" href="http://www.r-exercises.com/2017/04/13/forecasting-for-small-business-exercises-part-1/">Forecasting for small business Exercises (Part-1) </a></li>
<li><a title="3D plotting exercises" rel="bookmark" href="http://www.r-exercises.com/2016/04/06/3d-plotting-exercises/">3D plotting exercises </a></li>
<li><a href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
<p>This week’s R bulletin will cover topics like removing duplicate rows, finding row number, sorting a data frame in the same order, sorting a data frame in different order, and creating two tabs in an excel workbook. We will also cover functions like Sys.time, julian, and the second &amp; minute function from the lubridate package. Hope...</p>
<p>The post <a rel="nofollow" href="https://www.quantinsti.com/blog/r-weekly-bulletin-vol-iv/">R Weekly Bulletin Vol – IV</a> appeared first on <a rel="nofollow" href="https://www.quantinsti.com/"></a>.</p>
<p>Here's another rule of three, this one in statistics.</p>
<p>The post <a rel="nofollow" href="http://www.decisionsciencenews.com/2017/04/14/another-rule-three-one-statistics/">Another rule of three, this one in statistics</a> appeared first on <a rel="nofollow" href="http://www.decisionsciencenews.com/">Decision Science News</a>.</p>
When writing a blog, sooner or later, one measures and consequently tries to improve some kind of success metric.
In my case; I have been tracking user behavior (visitors, bounce rate, pageviews, …) for slightly over a year with Google Analytics. Whi...
The latest draft of my book is available. This will be my last pre-publication update, as I’m in the process …<p><a href="https://cartesianfaith.com/2017/04/14/modeling-data-with-functional-programming-part-i/">Continue reading <span>→</span></a></p>
<p>Following on from when we announced the availability of our community workshops, we’ve got three in the next three months that folks can attend. May 19th – Data science project in a day We’ll be in Kiev, Ukraine, doing a</p>
<p>The post <a rel="nofollow" href="http://itsalocke.com/community-workshops/">Community workshops</a> appeared first on <a rel="nofollow" href="http://itsalocke.com/">Locke Data</a>. Locke Data are a data science consultancy aimed at helping organisations get ready and get started with data science.</p>
Network problems are everywhere. We can easily find instances in logistics, telecom, project mangement, among others. In order to attack these problems using linear programming we need to go beyond assign and transportation problems that we saw in part I. Our goal here is to expand the problems we can solve using lpsove and igraph […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Data Hacking with RDSTK 3" rel="bookmark" href="http://www.r-exercises.com/2017/02/16/data-hacking-with-rdstk-3/">Data Hacking with RDSTK 3 </a></li>
<li><a title="Building Shiny App exercises part 4" rel="bookmark" href="http://www.r-exercises.com/2017/01/01/building-shiny-app-exercises-part-4/">Building Shiny App exercises part 4 </a></li>
<li><a title="Descriptive Analytics-Part 6: Interactive dashboard ( 2/2)" rel="bookmark" href="http://www.r-exercises.com/2017/01/08/descriptive-analytics-part-6-interactive-dashboard-22/">Descriptive Analytics-Part 6: Interactive dashboard ( 2/2) </a></li>
<li><a href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
Original Age Bias Plot
Campana et al. (1995) introduced the “age bias plot” to visually assess potential differences in paired age estimates (e.g., between two structures such as scales and otoliths, between two readers, or between one ...
by [Ben Marwick](https://twitter.com/benmarwick/), Associate Professor of Archaeology, University of Washington and Senior Research Scientist, University of Wollongong The [Society of American Archaeology (SAA)](http://www.saa.org/) is one of the largest professional organisations for archaeologists in the world, and just concluded its annual meeting in Vancouver, BC at the end of March. The R language has been a part of this meeting for more than a decade, with occasional citations of R Core in the posters, and more recently, the distinctive ggplot2 graphics appearing infrequently on posters and slides. However, among the few archaeologists that have heard of R, it has a reputation...
Choosing R packages for mixed effects modelling based on the car you drive
There are many roads you can take to fit a mixed effects model
(sometimes termed hierarchical models) in R. There are numerous
packages that each deploy different engines to fi...
A new RcppArmadillo version 0.7.800.2.0 is now on CRAN.
Armadillo is a powerful and expressive C++ template library for linear algebra aiming towards a good balance between speed and ease of use with a syntax deliberately close to a Matlab. RcppArma...
I’m planning to submit dplyr 0.6.0 to CRAN on May 11 (in four weeks time). In preparation, I’d like to announce that the release candidate, dplyr 0.5.0.9002 is now available. I would really appreciate it if you’d try it out and report any problems. This will ensure that the official release has as few bugs […]
<p>The more common approach to QR decomposition is employing Householder reflections rather than utilizing Gram-Schmidt. In practice, the Gram-Schmidt procedure is not recommended as it can lead to cancellation that causes inaccuracy of the computation of , which may result in a non-orthogonal matrix. Householder reflections are another method of...</p>
<p>The post <a rel="nofollow" href="http://www.aaronschlegel.com/qr-decomposition-householder-reflections/">QR Decomposition with Householder Reflections</a> appeared first on <a rel="nofollow" href="http://www.aaronschlegel.com/">Aaron Schlegel</a>.</p>
by Andrie de Vries In 2014 we introduced the checkpoint package for reproducible research. This package makes it easy to use R package versions that existed on CRAN at a given date in the past, and to use varying package versions with different projects. Previous blog posts include: Introducing the Reproducible R Toolkit and the checkpoint package An update to the checkpoint package New features in checkpoint v0.3.15 now on CRAN On April 12, 2017, we published version 0.4.0 of checkpoint to CRAN. The checkpoint() function enables reproducible research by managing your R package versions. These packages are downloaded into...
This post will be about pre-processing custom indicators in quantstrat–that is, how to add values to your market data that … <span><a href="https://quantstrattrader.wordpress.com/2017/04/13/nuts-and-bolts-of-quantstrat-part-v/">Continue reading <span>→</span></a></span>
The riddle of this week is about an optimisation of positioning the four digits of a multiplication of two numbers with two digits each and is open to a coding resolution: Four digits are drawn without replacement from {0,1,…,9}, one at a time. What is the optimal strategy to position those four digits, two digits […]
Uncertainty is the biggest enemy of a profitable business. That is especially true of small business who don’t have enough resources to survive an unexpected diminution of revenue or to capitalize on a sudden increase of the demand. In this context, it is especially important to be able to predict accurately the change in the […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Forecasting: Time Series Exploration Exercises (Part-1)" rel="bookmark" href="http://www.r-exercises.com/2017/04/10/forecasting-time-series-exploration-exercises-part-1/">Forecasting: Time Series Exploration Exercises (Part-1) </a></li>
<li><a title="Stock Prices Analysis part 3 – Exercises" rel="bookmark" href="http://www.r-exercises.com/2016/08/09/stock-prices-analysis-part-3-exercises/">Stock Prices Analysis part 3 – Exercises </a></li>
<li><a title="Lattice exercises – part 1" rel="bookmark" href="http://www.r-exercises.com/2016/04/30/lattice-exercises-part-1/">Lattice exercises – part 1 </a></li>
<li><a href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
I recently released an (other one) R package on CRAN - fuzzywuzzyR - which ports the fuzzywuzzy python library in R. “fuzzywuzzy does fuzzy string matching by using the Levenshtein Distance to calculate the differences between sequences (of...
<p>By Milind Paradkar Any programmer inevitably writes tons of codes in his daily work. However, not all programmers inculcate the habit of writing clean codes which can be easily be understood by others. One of the reasons can be the lack of awareness among programmers of the best practices followed in writing a program. This...</p>
<p>The post <a rel="nofollow" href="https://www.quantinsti.com/blog/r-best-practices-r-you-writing-the-r-way/">R Best Practices: R you writing the R way!</a> appeared first on <a rel="nofollow" href="https://www.quantinsti.com/"></a>.</p>
By now, word of the forcible deplanement of a medical professional by United has reached even the remotest of outposts in the #rstats universe. Since the news brought this practice to global attention, I found some aggregate U.S. Gov data made a quick, annual, aggregate look at this soon after the incident: Overall annual boarding... <a href="https://rud.is/b/2017/04/13/come-fly-with-me-well-not-really-comparing-involuntary-disembarking-rates-across-u-s-airlines-in-r/">Continue reading <span>→</span></a>
The field of data science is changing so rapidly that it’s quite hard to keep up with it all. When I first started tracking The Popularity of Data Science Software in 2010, I followed only ten packages, all of them classic … <a href="http://r4stats.com/2017/04/12/keeping-up-with-your-data-science-options/">Continue reading <span>→</span></a>
This coming Wednesday, April 19 at 8AM Pacific Time (click for your local time), Microsoft will be hosting a major on-line event of interest to anyone working with big data, analytics, and artificial intelligence: Microsoft Data Amp. During Data Amp, Executive Vice President Scott Guthrie and Corporate Vice President Joseph Sirosh will share how Microsoft’s latest innovations put data, analytics and artificial intelligence at the heart of business transformation. The event will include exciting announcements that will help you derive even more value from the cloud, enable transformative application development, and ensure you can capitalize on intelligence from any data,...
Hello, R users! Today we're launching Beginning Bayes in R by Jim Albert.
There are two schools of thought in the world of statistics, the frequentist perspective and the Bayesian perspective. At the core of the Bayesian perspective is the idea of rep...
In the Exercises we will cover Hashes, Factors and Zoo in R Answers to the exercises are available here. Exercise 1 Create a Hash based Key Value Pairs with three employees, with Employees as the key and the name as the values. Exercise 2 Create Hash of an Employee with the Name, Age, Address &amp; […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Data frame exercises Vol. 2" rel="bookmark" href="http://www.r-exercises.com/2016/11/28/data-frame-exercises-vol-2/">Data frame exercises Vol. 2 </a></li>
<li><a title="Descriptive Analytics-Part 1: Data Formatting Exercises" rel="bookmark" href="http://www.r-exercises.com/2016/10/26/descriptive-analytics-part-1-data-formatting/">Descriptive Analytics-Part 1: Data Formatting Exercises </a></li>
<li><a title="Data Science for Doctors – Part 1 : Data Display" rel="bookmark" href="http://www.r-exercises.com/2017/01/29/data-science-for-doctors-part-1-data-display/">Data Science for Doctors – Part 1 : Data Display </a></li>
<li><a href="http://www.r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://www.r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
Skip to TL/DR…. Water movement in estuaries is affected by many processes acting across space and time. Tidal exchange with the ocean is an important hydrodynamic process that can define several characteristics of an estuary. Physical flushing rates and water circulation are often controlled by tidal advection, whereas chemical and biological components are affected by […]
When you do simulations, for instance in R, e.g. drawing samples from a distribution, it’s best to set a random seed via the function set.seed in order to have reproducible results. The function has no default value. I think I mostly use set.seed(1)....
This periodic table can serve as a guide to navigate the key players in the data science space. The resources in the table were chosen by looking at surveys taken from data science users, such as the 2016 Data Science Salary Survey by O'Reilly, the 201...
This week, a chart with some Bayesian polemic behind it. Alexander Etz put this on Twitter: He is working on an R package to provide easy Bayesian adjustments for reporting bias with a method by Guan &amp; Vandekerchhove. Imagine a study … <a href="https://robertgrantstats.wordpress.com/2017/04/12/dataviz-of-the-week-12417/">Continue reading <span>→</span></a>
Over the couple of months there have been a bunch of smaller releases to packages in the tidyverse. This includes: forcats 0.2.0, for working with factors. readr 1.1.0, for reading flat-files from disk. stringr 1.2.0, for manipulating strings. tibble 1.3.0, a modern re-imagining of the data frame. This blog post summarises the most important new […]<img height="1" alt="" width="1" src="https://pixel.wp.com/b.gif?host=blog.rstudio.org&blog=18843819&post=4349&subd=rstudioblog&ref=&feed=1" border="0">
Chris Moffit has a nice blog on how to use the transform function in pandas. He provides some (fake) data on sales and asks the question of what fraction of each order is from each SKU. Being a R nut and a tidyverse fan, I thought to compare and contrast the code for the pandas […]
<p>Summary of my presentation to the Melbourne R user Group (MelbuRn) about Data science from a Strategic Business Perspective. <a href="http://r.prevos.net/data-science-business/">Continue reading <span>→</span></a></p>
<p>The post <a rel="nofollow" href="http://r.prevos.net/data-science-business/">Data Science from a Strategic Business Perspective</a> appeared first on <a rel="nofollow" href="http://r.prevos.net/">The Devil is in the Data</a>.</p>
As anyone who's tried to analyze real-world data knows, there are any number of problems that may be lurking in the data that can prevent you from being able to fit a useful predictive model: Categorical variables can include infrequently-used levels, which will cause problems if sampling leaves them unrepresented in the training set. Numerical variables can be in wildly different scales, which can cause instability when fitting models. The data set may include several highly-correlated columns, some of which could be pruned from the data without sacrificing predictive power. The data set may include missing values that need to...
Authors: John Mount and Nina Zumel Introduction In teaching thinking in terms of coordinatized data we find the hardest operations to teach are joins and pivot. One thing we commented on is that moving data values into columns, or into a “thin” or entity/attribute/value form (often called “un-pivoting”, “stacking”, “melting” or “gathering“) is easy to … <a href="http://www.win-vector.com/blog/2017/04/teaching-pivot-un-pivot/">Continue reading <span>Teaching pivot / un-pivot</span></a>
We’re excited to announce the release of RStudio Connect: version 1.4.6. This is an incremental release which features significantly improved startup time and support for server-side Shiny bookmarks. Improved Startup &amp; Job Listing Time We now track R process jobs in the database which allows us to list and query jobs much more quickly. This […]
SHINY DASHBOARD STRUCTURE &amp; APPEARANCE Finally we reached in the final part of our series. At this part we will see how to improve the structure and the appearance of our dashboard even more, according to our preferences and of course make it more attractive to the user. Last but not least we will see […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Building Shiny App Exercises (part-8)" rel="bookmark" href="http://www.r-exercises.com/2017/03/24/building-shiny-app-exercises-part-8/">Building Shiny App Exercises (part-8) </a></li>
<li><a title="Building Shiny App exercises part 2" rel="bookmark" href="http://www.r-exercises.com/2016/12/18/building-shiny-app-exercises-part-2/">Building Shiny App exercises part 2 </a></li>
<li><a title="Building Shiny App exercises part 1" rel="bookmark" href="http://www.r-exercises.com/2016/12/12/building-shiny-app-exercises-part-1/">Building Shiny App exercises part 1 </a></li>
<li><a href="http://r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
11.04.2017 A new release of Bio7  for MaxOSX (64-bit) is available. This release comes with a plethora of new functions for MacOSX and R. (Screenshot with Bio7 Dark theme enabled and custom font colors of the R editor) Bio7 2.5 Release Notes Installation: Download and extract the installation file from http://bio7.org. If you start Bio7 […]
Recently we were building a Shiny App in which we had to load data from a very large dataframe. It was directly impacting the app initialization time, so we had to look into different ways of reading data from files to R (in our case customer provided ...
Many languages allow you to use a custom comparison function in sorting. R is not an exception, but it is not entirely straightforward – it requires you to define a new class and overload certain operators. Here is how to do it. Consider the following example. You have a certain number of paired values, for […]<img height="1" alt="" width="1" src="https://pixel.wp.com/b.gif?host=logfc.wordpress.com&blog=54433433&post=469&subd=logfc&ref=&feed=1" border="0">
Springtime and cherry blossoms
It is spring, and the flowers bloom. One tree in particular symbolises this: the Japanese cherry (sakura) tree. Every year, millions of Japanese enjoy hanami, jointly watching the cherry blossoms, philosophising abo...
<p>Hello R-users &lt;3 The 8th MilanoR Meeting was great! Thank you very much for your interest and participation! A short recap for those who weren't there: the meeting was last Wednesday evening at the Microsoft House (a very nice location, thanks @dr_mattia for your support!). We had two exceptional speakers: Stefano Iacus, member of the R […]</p>
<p>The post <a rel="nofollow" href="http://www.milanor.net/blog/8th-milanor-meeting-presentations-photos/">8th MilanoR Meeting - Presentations, photos and video!</a> appeared first on <a rel="nofollow" href="http://www.milanor.net/blog">MilanoR</a>.</p>
In case you missed them, here are some articles from March of particular interest to R users. A tutorial and comparison of the SparkR, sparklyr, rsparkling, and RevoScaleR packages for using R with Spark. An analysis of Scrabble games between AI players. The doAzureParallel package, a backend to &quot;foreach&quot; for parallel computations on Azure-based clusters. The UK government project to automate reporting of official statistics with R. Data science languages R and Python rank highly in the latest Redmonk popularity rankings. FiveThirtyEight used R to find clusters of similar subreddits. RTVS 1.0, which provides R support to Visual Studio, is...
I have just published a small package lspline on CRAN that implements linear splines using convenient parametrisations such that coefficients are slopes of consecutive segments coefficients capture slope change at consecutive knots Knot locations can be specified manually (with lspline()) at breaks dividing the range of x into q equal-frequency intervals (with qlspline()) at breaks […]
Again I was at the point, where I needed to store and save to external file all the R code that was executed through sp_execute_external_script. Soon, you will find out several interesting things. To show the example, I will start with following example: USE [WideWorldImporters]; GO EXEC sys.sp_execute_external_script      @language = N'R'     ,@script … <a href="https://tomaztsql.wordpress.com/2017/04/10/saving-input-and-output-with-sp_execute_external_script/">Continue reading <span>Saving input and output with sp_execute_external_script</span></a>
In this article we see why modelling transaction costs matters and how to do so using quantstrat.
I released version 1.4.12 of RSiteCatalyst before I wrote the release notes for version 1.4.11, so this blog post will treat both releases as one. Users should upgrade directly to version 1.4.12 as the releases are cumulative in nature.
Get* method ad...
R provides powerful tools for forecasting time series data such as sales volumes, population sizes, and earthquake frequencies. A number of those tools are also simple enough to be used without mastering sophisticated underlying theories. This set of exercises is the first in a series offering a possibility to practice in the use of such […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Stock Prices Analysis part 3 – Exercises" rel="bookmark" href="http://r-exercises.com/2016/08/09/stock-prices-analysis-part-3-exercises/">Stock Prices Analysis part 3 – Exercises </a></li>
<li><a title="zoo time series exercises" rel="bookmark" href="http://r-exercises.com/2016/05/30/zoo-time-series-exercises/">zoo time series exercises </a></li>
<li><a title="Correlation and Correlogram Exercises" rel="bookmark" href="http://r-exercises.com/2017/04/08/correlation-and-correlogram-exercises/">Correlation and Correlogram Exercises </a></li>
<li><a href="http://r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
Introduction Not so long ago RStudio released the R package ‘reticulate‘, it is an R interface to Python. Of course, it was already possible to execute python scripts from within R, but this integration takes it one step further. Imported … <a href="https://longhowlam.wordpress.com/2017/04/10/test-driving-python-integration-in-r-using-the-reticulate-package/">Continue reading <span>→</span></a><img height="1" alt="" width="1" src="https://pixel.wp.com/b.gif?host=longhowlam.wordpress.com&blog=76277277&post=2208&subd=longhowlam&ref=&feed=1" border="0">
Increasing amount of data is available on the web. Web scraping is a technique developed to extract data from web pages automatically and transforming it into a data format for further data analysis and insights. Applied clustering is an unsupervised learning technique that refers to a family of pattern discovery and data mining tools with […]<ul></ul><strong><p>Related Post</p></strong><ol><li><a title="Permanent Link toKey Phrase Extraction from Tweets" rel="bookmark" href="https://datascienceplus.com/key-phrase-extraction-from-tweets/">Key Phrase Extraction from Tweets</a></li><li><a title="Permanent Link toFinancial time series forecasting – an easy approach" rel="bookmark" href="https://datascienceplus.com/financial-time-series-forecasting-an-easy-approach/">Financial time series forecasting – an easy approach</a></li><li><a title="Permanent Link toOutlier detection and treatment with R" rel="bookmark" href="https://datascienceplus.com/outlier-detection-and-treatment-with-r/">Outlier detection and treatment with R</a></li><li><a title="Permanent Link toImplementing Apriori Algorithm in R" rel="bookmark" href="https://datascienceplus.com/implementing-apriori-algorithm-in-r/">Implementing Apriori Algorithm in R</a></li><li><a title="Permanent Link toR for Publication: Lesson 6, Part 2 – Linear Mixed Effects Models" rel="bookmark" href="https://datascienceplus.com/r-for-publication-by-page-piccinini-lesson-6-part-2-linear-mixed-effects-models-lmem/">R for Publication: Lesson 6, Part 2 – Linear Mixed Effects Models</a></li></ol>
Last year we launched R Course Finder, an online directory that helps you to find the right R course quickly. With so many R courses available online, we thought it was a good idea to offer a tool that helps people to compare these courses, before they decide where to spend their valuable time and […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Basic Tree 2 Exercises" rel="bookmark" href="http://r-exercises.com/2016/12/15/basic-tree-2/">Basic Tree 2 Exercises </a></li>
<li><a title="Multiple Regression (Part 3) Diagnostics" rel="bookmark" href="http://r-exercises.com/2017/03/11/multiple-regression-part-3-diagnostics/">Multiple Regression (Part 3) Diagnostics </a></li>
<li><a title="Intermediate Tree 2" rel="bookmark" href="http://r-exercises.com/2017/01/05/intermediate-tree-2/">Intermediate Tree 2 </a></li>
<li><a href="http://r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
This guide is part of a series on setting up your own private server running shiny apps. There are many guides out there with great advice on how to set up an R shiny server and related software. I try to make a comprehensive guide based in part on the...
A really nice function available in Python is walk(), which recursively descends a directory tree, calling a user-supplied function in each directory within the tree. It might be used, say, to count the number of files, or maybe to remove all small files and so on. I had students in my undergraduate class write such … <a href="https://matloff.wordpress.com/2017/04/08/a-python-like-walk-function-for-r/">Continue reading <span>A Python-Like walk() Function for R</span> <span>→</span></a>
Correlation analysis is one of the most popular techniques for data exploration. This set of exercises is intended to help you to extend, speed up, and validate your correlation analysis. It allows to practice in: – calculating linear and nonlinear correlation coefficients, – testing those coefficients for statistical significance, – creating correlation matrices to study […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Accessing Dataframe Objects Exercises" rel="bookmark" href="http://r-exercises.com/2016/05/20/accessing-dataframe-objects-exercises/">Accessing Dataframe Objects Exercises </a></li>
<li><a title="Cross Tabulation with Xtabs exercises" rel="bookmark" href="http://r-exercises.com/2016/05/12/cross-tabulation-with-xtabs-exercises/">Cross Tabulation with Xtabs exercises </a></li>
<li><a title="Merging Dataframes Exercises" rel="bookmark" href="http://r-exercises.com/2016/04/14/merging-dataframes-exercises/">Merging Dataframes Exercises </a></li>
<li><a href="http://r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
Recently a reader left a comment on this blog mentioning his cool blog post in which he mapped the spread of a migratory bird using Twitter. His data source was the Waxwings UK account which reports sightings of Bohemian waxwings in the UK. I decided t...
Nicolas Proellochs and Stefan Feuerriegel 2017-04-06 Introduction Reinforcement learning has recently gained a great deal of traction in studies that call for human-like learning. In settings where an explicit teacher is not available, this method teaches an agent via interaction with its environment without any supervision other than its own decision-making policy. In many cases, … <a href="http://www.rblog.uni-freiburg.de/2017/04/08/reinforcementlearning-a-package-for-replicating-human-behavior-in-r/">Continue reading<span> &quot;ReinforcementLearning: A package for replicating human behavior in R&quot;</span></a>
What Type of Data Visualization Do You Choose (if any)? Determining whether or not you need a visualization is step one. While it seems silly, this is probably something everyone (including myself) should be doing more often. A lot of times, it seems like a great way to showcase the amount of work you have […]
07.04.2017 A new release of Bio7 is available for Windows (64-bit) and Linux (64-bit). The MacOSX version will be released soon, too. This release comes with a plethora of new functions for R. General Bio7 is now based on Eclipse 4.6.3 Redesigned all Bio7 icons and created new icons, too Nearly all icons are now […]
We are happy to bring the slick JavaScript library to R. It is self-described as “the last carousel you’ll ever need”. This carousel is based on putting the elements of the carousel in a div HTML tag. This makes the carousel very versatile in what can be placed inside. Regular objects that are placed in … <a href="http://r-posts.com/slickr/">Continue reading <span>slickR</span></a>
<p>This week’s R bulletin will cover topics like how to read select columns, the difference between boolean operators, converting a factor to a numeric and changing memory available to R. We will also cover functions like data, format, tolower, toupper, and strsplit function. Hope you like this R weekly bulletin. Enjoy reading! Shortcut Keys 1. To change the working directory...</p>
<p>The post <a rel="nofollow" href="https://www.quantinsti.com/blog/r-weekly-bulletin-vol-iii/">R Weekly Bulletin Vol – III</a> appeared first on <a rel="nofollow" href="https://www.quantinsti.com/"></a>.</p>
Maëlle Salmon recently created a collage of profile pictures of people who use the #rstats hashtag in their Twitter bio to indicate their use of R. (I've included a detail below; click to see the complete version at Maëlle's blog.) Naturally, Maëlle created the collage using R itself. Matching Twitter bios were found using the search_users function in the rtweet package, which also provides the URL of the profile image to be downloaded using the httr package. From there, Maëlle used the magick package to resize the pictures and assemble the collage. Now, you'll notice that while many people use...
RStudio is a great way to work through analyses tasks, and I suspect most folks use the “desktop” version of the product on their local workstations. The fine folks at RStudio also make a server version (the codebase for RStudio is able to generate server or desktop and they are generally in 100% feature parity... <a href="https://rud.is/b/2017/04/07/r%E2%81%B6-rstudio-server-client-make-an-app-for-that/">Continue reading <span>→</span></a>
R Programming has various Data Structures for efficient manipulation of Data. Following are the list of data structures supported by R. 1. Vectors 2. Lists 3. Matrix 4. Data frame This exercise helps through various operations of R Data structures. Answers to the exercises are available here. Exercise 1 Create an atomic vector of Character […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Matrix exercises" rel="bookmark" href="http://r-exercises.com/2015/11/28/matrix-exercises/">Matrix exercises </a></li>
<li><a title="3D plotting exercises" rel="bookmark" href="http://r-exercises.com/2016/04/06/3d-plotting-exercises/">3D plotting exercises </a></li>
<li><a title="Basic Operations Exercises" rel="bookmark" href="http://r-exercises.com/2016/10/23/basic-operations/">Basic Operations Exercises </a></li>
<li><a href="http://r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
Consider the spam vs ham data from this site. Let us do some basic analysis on the data with R version 3.3.3, 64 bits on qn windows machine setwd(&quot;your directory&quot;) sms_data&lt;-read.csv(&quot;sms_spam.csv&quot;,stringsAsFactors = FALSE) Next, check the proportion of spam and ham in your data set prop.table(table(sms_data$type)) ham spam 0.8659849 0.1340151 As you can see, the […]<ul></ul><strong><p>Related Post</p></strong><ol><li><a title="Permanent Link toLogistic Regression Regularized with Optimization" rel="bookmark" href="https://datascienceplus.com/logistic-regression-regularized-with-optimization/">Logistic Regression Regularized with Optimization</a></li><li><a title="Permanent Link toAnalytical and Numerical Solutions to Linear Regression Problems" rel="bookmark" href="https://datascienceplus.com/analytical-and-numerical-solutions-to-linear-regression-problems/">Analytical and Numerical Solutions to Linear Regression Problems</a></li><li><a title="Permanent Link toHow to create a loop to run multiple regression models" rel="bookmark" href="https://datascienceplus.com/how-to-create-a-loop-to-run-multiple-regression-models/">How to create a loop to run multiple regression models</a></li><li><a title="Permanent Link toRegression model with auto correlated errors – Part 3, some astrology" rel="bookmark" href="https://datascienceplus.com/regression-model-with-auto-correlated-errors-part-3-some-astrology/">Regression model with auto correlated errors – Part 3, some astrology</a></li><li><a title="Permanent Link toRegression model with auto correlated errors – Part 2, the models" rel="bookmark" href="https://datascienceplus.com/regression-model-with-auto-correlated-errors-part-2-the-models/">Regression model with auto correlated errors – Part 2, the models</a></li></ol>
Welcome to the third post in the rarely relevant R recommendation series, or R4 for short.
Today will be brief, but of some importance. In order to know where R is going next, few places provide a better vantage point than the actual ongoing developm...
Measurement for improvement in healthcare with R and Qlik - My not so secret obsession
Anyone in the small subset of the Earth’s population who both read this blog AND follow me on Twitter will know that I spend a lot of time at work eithe...
Microsoft R Open (MRO), Microsoft's enhanced distribution of open source R, has been upgraded to version 3.3.3, and is now available for download for Windows, Mac, and Linux. This update upgrades the R language engine to R 3.3.3, upgrades the installer, and updates the bundled packages. R 3.3.3 makes just a few minor fixes compared to R 3.3.2 (see the full list of changes here), so you shouldn't encounter any compatibility issues when upgrading from MRO 3.3.2. For CRAN packages, MRO 3.3.3 points to CRAN snapshot taken on March 15, 2017 but as always, you can use the built-in checkpoint...
﻿ R has many powerful libraries to handle operations research. This exercise tries to demonstrate a few basic functionality of R while dealing with linear programming. Linear programming is a technique for the optimization of a linear objective function, subject to linear equality and linear inequality constraints. The lpsolve package in R provides a set […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Data science for Doctors: Inferential Statistics Exercises(Part-4)" rel="bookmark" href="http://r-exercises.com/2017/04/02/data-science-for-doctors-inferential-statistics-part4/">Data science for Doctors: Inferential Statistics Exercises(Part-4) </a></li>
<li><a title="Data Science for Doctors – Part 1 : Data Display" rel="bookmark" href="http://r-exercises.com/2017/01/29/data-science-for-doctors-part-1-data-display/">Data Science for Doctors – Part 1 : Data Display </a></li>
<li><a title="Data Science for Doctors – Part 2 : Descriptive Statistics" rel="bookmark" href="http://r-exercises.com/2017/02/05/data-science-for-doctors-part-2-descriptive-statistics/">Data Science for Doctors – Part 2 : Descriptive Statistics </a></li>
<li><a href="http://r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
Today and tomorrow, I am attending the Statlearn17 conference in Lyon, France. Which is a workshop with one-hour talks on statistics and machine learning. And which makes for the second workshop on machine learning in two weeks! Yesterday there were two tutorials in R, but I only took the train to Lyon this morning: it […]
by Srini Kumar, VP of Product Management and Data Science, LevaData; and Bob Horton, Senior Data Scientist, Microsoft A rational function is defined as the ratio of two functions. The [Padé Approximant](https://en.wikipedia.org/wiki/Pad%C3%A9_approximant) uses a ratio of polynomials to approximate functions: $$ R(x)= \frac{\sum_{j=0}^m a_j x^j}{1+\sum_{k=1}^n b_k x^k}=\frac{a_0+a_1x+a_2x^2+\cdots+a_mx^m}{1+b_1 x+b_2x^2+\cdots+b_nx^n} $$ Here we show a way to fit this type of function to a set of data points using the `lm` function in R. We'll use a data-simulating function based on a ratio of polynomials to generate a set of `y` values for some random `x` values, add some noise, then see...
The Plotly R package can now be used within nteract notebooks. Below are some examples. Visit below links for installation related information Visit Carson’s Plotly for R book for more details on plotly and its capabilities Visit nteract releases to download nteract Visit IRkernel to see details on how to install an R kernel for […]
<p>Using the R language to build a Tic Tac Toe War Games simulator. Teach your computer to play a perfect game of Naughts and Crosses. <a href="http://r.prevos.net/tic-tac-toe-war-games/">Continue reading <span>→</span></a></p>
<p>The post <a rel="nofollow" href="http://r.prevos.net/tic-tac-toe-war-games/">Tic Tac Toe War Games: The Intelligent Minimax Algorithm</a> appeared first on <a rel="nofollow" href="http://r.prevos.net/">The Devil is in the Data</a>.</p>
<p>By Milind Paradkar In recent years, machine learning has been generating a lot of curiosity for its profitable application to trading. Numerous machine learning models like Linear/Logistic regression, Support Vector Machines, Neural Networks, Tree-based models etc. are being tried and applied in an attempt to analyze and forecast the markets. Researchers have found that some...</p>
<p>The post <a rel="nofollow" href="https://www.quantinsti.com/blog/forecasting-markets-using-extreme-gradient-boosting-xgboost/">Forecasting Markets using eXtreme Gradient Boosting (XGBoost)</a> appeared first on <a rel="nofollow" href="https://www.quantinsti.com/"></a>.</p>
Shiny 1.0.1 is now available on CRAN! This release primarily includes bug fixes and minor new features. The most notable additions in this version of Shiny are the introduction of the reactiveVal() function (like reactiveValues(), but it only stores a single value), and that the choices of radioButtons() and checkboxGroupInput() can now contain HTML content […]
I am giving a pre-conference tutorial on JAGS at useR! 2017 in Brussels on 4 July. You can see the outline of the tutorial on the conference website along with the other tutorials being given the same day. This is … <a href="https://martynplummer.wordpress.com/2017/04/05/jags-tutorial-at-user-2017/">Continue reading <span>→</span></a>
Part of the reason why we have been somewhat silent at Citizen Statistician is that it’s DataFest season, and that means a few weeks (months?) of all consuming organization followed by a weekend of super fun data immersion and exhaustion… … <a href="http://citizen-statistician.org/2017/04/05/read-elsewhere-organizing-datafest-the-tidy-way/">Continue reading <span>→</span></a>
I was pleased to see the announcement yesterday of simmer 3.61. a discrete-event simulation (DES) package for R. I’ve long had an interest in DES, and as I will explain below, implementing DES in R brings up interesting issues about R that transcend the field of DES. I had been planning to discuss them in … <a href="https://matloff.wordpress.com/2017/04/05/discrete-event-simulation-in-r-and-why-r-is-different/">Continue reading <span>Discrete Event Simulation in R (and, Why R Is Different)</span> <span>→</span></a>
<p>Renthop is a New York based apartment listing website. It uses an innovative algorithm to sort and present the listings to the visitors. As part of […]</p>
<p>The post <a rel="nofollow" href="https://blog.nycdatascience.com/student-works/machine-learning/renthop-predicting-interest-level/">Renthop: predicting interest level for rental listings</a> appeared first on <a rel="nofollow" href="https://blog.nycdatascience.com/">NYC Data Science Academy Blog</a>.</p>
I spoke to our new crop of honours students this morning. Here are my slides, example files and links.   Managing References Mendeley Zotero Paperpile Data analysis and computation Download R Download Rstudio Online R tutorial R packages for time series R packages for econometrics R packages for finance Writing your thesis LaTeX Windows: Download MikTeX […]
When you write an ESRI Shapefile from R, writeOGR assumes your numeric fields are real numbers and so you get a lot of redundant zeros appended. This is misleading and distracting when you… <a href="https://scottishsnow.wordpress.com/2017/04/04/col-classes/">Continue reading <span>→</span></a>
If you've created an R function (say, a routine to clean up missing values in a data set, or a function to make forecasts using a machine learning model), and you want to make it easy for DBAs to use it, it's now possible to publish R functions as a SQL Server 2016 stored procedure. The sqlrutils package provides tools to convert an existing R function to a stored procedure which can then be executed by anyone with authenticated access to the database — even if they don't know any R. To use an R function as a stored procedure,...
The devil is in the details! - As I’ve said before, when it comes to programming I’m a firm believer in the “learn by doing” approach. exercism.io is a project which exemplifies this.
I came across exercism.io earlier this year while ex...
I’ve been having a more sustained play with R and GRASS together. I’ve previously used them, in tandem, for processing satellite images, but haven’t been much further. In this post I’ll look at… <a href="https://scottishsnow.wordpress.com/2017/04/04/r-grass-munros/">Continue reading <span>→</span></a>
I want to discuss a nice series of figures used to teach relational join semantics in R for Data Science by Garrett Grolemund and Hadley Wickham, O’Reilly 2016. Below is an example from their book illustrating an inner join: Please read on for my discussion of this diagram and teaching joins. Teaching joins In the … <a href="http://www.win-vector.com/blog/2017/04/visualizing-relational-joins/">Continue reading <span>Visualizing relational joins</span></a>
I’ve just updated the Competition Use section of The Popularity of Data Science Software. Here’s just that section for your convenience. Competition Use Kaggle.com is a web site that sponsors data science contests. People post problems there along the amount … <a href="http://r4stats.com/2017/04/04/kaggle/">Continue reading <span>→</span></a>
March has been a busy month here at DataCamp! We've released 7 courses, 4 DataChats, and 8 articles. Luckily, this round-up post will cover the highlights, in case you missed them.
Data Manipulation: Tidy Your Data!
We were very excited to relea...
For once and only because it is part of this competition, a geometric Le Monde mathematical puzzle: Given both diagonals of lengths p=105 and q=116, what is the parallelogram with the largest area? and when the perimeter is furthermore constrained to be L=290? This made me jump right away to the quadrilateral page on Wikipedia, […]
The results of the 2017 StackOverflow Survey of nearly 65,000 developers were published recently, and includes lots of interesting insights about their work, lives and preferences. The results include a cross-tabulation of the most popular languages amongst the &quot;Data Scientist/Engineer&quot; subset, and the results were ... well, surprising: When thinking about data scientists, it certainly makes sense to see SQL, Python and R in this list. (I've only included the top 10 above.) But it's a real surprise to see JavaScript at the top of the list, and the presence of PHP is just unfathomable to me. I think it...
In this post we look at using quantstrat and other stpackages for developing, testing, and benchmarking trading strategies with R.
A new patch release of simmer, the Discrete-Event Simulator for R, is on CRAN. Three months have passed since the last release. The last year was a period of intense development (one release per month). Now, the package has reached some level of maturity, so we intend to extend the release cycle. In this maintenance… <a href="https://www.enchufa2.es/archives/simmer-3-6-1.html">Continuar leyendo <span>simmer 3.6.1</span> <span>→</span></a>
In a previous post of mine published at DataScience+, I analyzed the text of the first presidential debate using relatively simple string manipulation functions to answer some high level questions from the available text. In this post, we leverage a few other NLP techniques to analyze another text corpus – A collection of tweets. Given […]<ul></ul><strong><p>Related Post</p></strong><ol><li><a title="Permanent Link toFinancial time series forecasting – an easy approach" rel="bookmark" href="https://datascienceplus.com/financial-time-series-forecasting-an-easy-approach/">Financial time series forecasting – an easy approach</a></li><li><a title="Permanent Link toOutlier detection and treatment with R" rel="bookmark" href="https://datascienceplus.com/outlier-detection-and-treatment-with-r/">Outlier detection and treatment with R</a></li><li><a title="Permanent Link toImplementing Apriori Algorithm in R" rel="bookmark" href="https://datascienceplus.com/implementing-apriori-algorithm-in-r/">Implementing Apriori Algorithm in R</a></li><li><a title="Permanent Link toR for Publication: Lesson 6, Part 2 – Linear Mixed Effects Models" rel="bookmark" href="https://datascienceplus.com/r-for-publication-by-page-piccinini-lesson-6-part-2-linear-mixed-effects-models-lmem/">R for Publication: Lesson 6, Part 2 – Linear Mixed Effects Models</a></li><li><a title="Permanent Link toR for Publication: Lesson 6, Part 1 – Linear Mixed Effects Models" rel="bookmark" href="https://datascienceplus.com/r-for-publication-by-page-piccinini-lesson-6-part-1-linear-mixed-effects-models-lmem/">R for Publication: Lesson 6, Part 1 – Linear Mixed Effects Models</a></li></ol>
A brown bag bug fix release 0.0.3 of RApiDatetime is now on CRAN.
RApiDatetime provides six entry points for C-level functions of the R API for Date and Datetime calculations. The functions asPOSIXlt and asPOSIXct convert between long and compact dat...
Data science enhances people’s decision making. Doctors and researchers are making critical decisions every day. Therefore, it is absolutely necessary for those people to have some basic knowledge of data science. This series aims to help people that are around medical field to enhance their data science skills. We will work with a health related […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Data Science for Doctors – Part 1 : Data Display" rel="bookmark" href="http://r-exercises.com/2017/01/29/data-science-for-doctors-part-1-data-display/">Data Science for Doctors – Part 1 : Data Display </a></li>
<li><a title="Data science for Doctors: Inferential Statistics Exercises (part-2)" rel="bookmark" href="http://r-exercises.com/2017/03/19/data-science-for-doctors-inferential-statistics-exercises-part-2/">Data science for Doctors: Inferential Statistics Exercises (part-2) </a></li>
<li><a title="Data science for Doctors: Inferential Statistics Exercises (part-3)" rel="bookmark" href="http://r-exercises.com/2017/03/27/data-science-for-doctors-inferential-statistics-exercises-part-3/">Data science for Doctors: Inferential Statistics Exercises (part-3) </a></li>
<li><a href="http://r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
@visualisingdata rebroadcast this tweet today: Wireless Passwords From Airports And Lounges Around The World https://t.co/OV0WJfwj8E— deb verhoeven (@bestqualitycrab) April 2, 2017 The Google Maps interface is a bit meh and the “formatted” data is also a bit meh but the data is useful when travelling (NOTE: always use a VPN in airports on both your... <a href="https://rud.is/b/2017/04/02/simple-offline-airport-wi-fi-tracker-in-r/">Continue reading <span>→</span></a>
To everyone learning R: Don’t save your workspace. When you exit an R session, you’re faced with the question of whether or not to save your workspace. You should almost never answer yes. Saving your workspace creates an image of your current variables and functions, and saves them to a file called ”.RData”. When you […]
In my last post, where I shared the code that I used to produce an example analysis to go along with my webinar on building meaningful models for disease prediction, I mentioned that it is advised to consider over- or under-sampling when you have unbal...
Objective if this post: alerting all users to double check case and spelling of all function parameters I am newbie in R and was trying RSNNS mlp function and wasted a lot of time due to some typos. RSNNS mlp function silently ignores misspelled keywords Example: I intentionally misspelled size as hize and maxit as … <a href="http://r-posts.com/r-function-call-with-ellipsis-trappitfall/">Continue reading <span>R Function Call with Ellipsis Trap/Pitfall</span></a>
To avoid “branding” confusion with R⁴ I’m superclassing it to R⁶ and encouraging others in the R community to don the moniker and do their own small, focused posts on topics that would help the R community learn things. Feel free to use R⁶ (I’ll figure out an acronym later). Feel free to tag your... <a href="https://rud.is/b/2017/04/01/superclassing-to-r%E2%81%B6/">Continue reading <span>→</span></a>
Back in 2014 I blogged about first snowfall dates for a given U.S. state. It’s April 1, 2017 and we’re slated to get 12-18″ of snow up here in Main and @mrshrbrmstr asked how often this — snow in May — has occurred near us. As with all of these “R⁴ posts, expository is minimal and... <a href="https://rud.is/b/2017/04/01/r%E2%81%B4-snow-day-facets/">Continue reading <span>→</span></a>
Shiny Dashboard Overview In this part we will “dig deeper” to discover the amazing capabilities that a Shiny Dasboard provides. Read the examples below to understand the logic of what we are going to do and then test yous skills with the exercise set we prepared for you. Lets begin! Answers to the exercises are […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Building Shiny App exercises part 1" rel="bookmark" href="http://r-exercises.com/2016/12/12/building-shiny-app-exercises-part-1/">Building Shiny App exercises part 1 </a></li>
<li><a title="Building Shiny App exercises part 3" rel="bookmark" href="http://r-exercises.com/2016/12/25/building-shiny-app-exercises-part-3/">Building Shiny App exercises part 3 </a></li>
<li><a title="Building Shiny App exercises part 2" rel="bookmark" href="http://r-exercises.com/2016/12/18/building-shiny-app-exercises-part-2/">Building Shiny App exercises part 2 </a></li>
<li><a href="http://r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
At the recent Strata conference in San Jose, several members of the Microsoft Data Science team presented the tutorial Using R for Scalable Data Analytics: Single Machines to Spark Clusters. The materials are all available online, including the presentation slides and hands-on R scripts. You can follow along with the materials at home, using the Data Science Virtual Machine for Linux, which provides all the necessary components like Spark and Microsoft R Server. (If you don't already have an Azure account, you can get $200 credit with the Azure free trial.) The tutorial covers many different techniques for training predictive...
Jonathan Sidi, Metrum Research Group We are pleased to announce the release of the ggedit package on CRAN. To install the package you can call the standard R command install.packages('ggedit') The source version is still tracked on github, which has been reorganized to be easier to navigate. To install the dev version: devtools::install_github('metrumresearchgroup/ggedit') What is … <a href="http://r-posts.com/ggedit-0-2-0-is-now-on-cran/">Continue reading <span>ggedit 0.2.0 is now on CRAN</span></a>
Whether you’re plotting a simple time series or building a predictive model for the next election, the R programming language’s flexibility will ensure you have all the capabilities you need to get the job done. In this blog we will take a look at ...
This post is about illustrating the concept of prospective ageing, a relatively fresh approach in demography to refine our understanding of population ageing. This visualization was created in collaboration with my colleague Michael Boissonneault: ...
Webinar for the ISDS R Group
This document presents the code I used to produce the example analysis and figures shown in my webinar on building meaningful machine learning models for disease prediction.
My webinar slides are available on Github
...
Finally, finally after months of pulling out my hair, the Delaporte project on CRAN passes all of its checks on Solaris SPARC. The last time it did that, it was still using serial C++. Now it uses OpenMP-based parallel Fortran 2003. What a relief! One of these days I should write up what I did<a href="http://www.avrahamadler.com/2017/03/31/delaporte-package-the-sparcmonster-is-sated/"> Read the full article...</a>
  While finishing up with R-rockstar Hadley Wickham’s book (Free Book – R for Data Science), the section on model building elaborates on something pretty cool that I had no idea about – list columns. Most of us have probably seen the following data frame column format: df &lt;- data.frame(&quot;col_uno&quot; = c(1,2,3),&quot;col_dos&quot; = c('a','b','c'), &quot;col_tres&quot; … <a href="https://realdataweb.wordpress.com/2017/03/31/take-your-data-frames-to-the-next-level/">Continue reading <span>Take your data frames to the next level.</span></a>
<p>Next Tuesday (April 4) at 9am PT I will be hosting a webinar with Kyle Walker about the tigris package in R. In addition to...</p>
<p>The post <a rel="nofollow" href="http://www.arilamstein.com/blog/2017/03/30/live-presentation-kyle-walker-tigris-package/">Live Presentation: Kyle Walker on the tigris Package</a> appeared first on <a rel="nofollow" href="http://www.arilamstein.com/">AriLamstein.com</a>.</p>
Mark Sellors Head of Data Engineering At Mango we work with a great many clients using the Shiny framework for R. Many of those use Shiny Server or Shiny Server Pro to publish their shiny apps within their organisations. Shiny … <a href="http://www.mango-solutions.com/wp/2017/03/customising-shiny-server-html-pages/">Continue reading <span>→</span></a>
While you might think of Scrabble as that game you play with your grandparents on a rainy Sunday, some people take it very seriously. There's an international competition devoted to Scrabble, and no end of guides and strategies for competitive play. James Curley, a psychology professor at Columbia University, has used an interesting method to collect data about what plays are most effective in Scrabble: by having robots play against each other, thousands of times. The data were generated with a Visual Basic script that automated two AI players completing a game in Quackle. Quackle emulates the Scrabble board, and...
<p>The R-Labs are monthly evening meetings where we co-work together on a real data science problem, hands on code. We are ready for the R-Lab#2, on April 11th!<br>
With the help of EarthCloud, we will try to map the earthquakes that happened over a specific fault, to study the fault evolution over time and provide qualitative and quantitative insights about it. To achieve this goal, we will review and use Shiny, the R framework for interactive visualization, and R packeges for maps as ggmap and Leaflet</p>
<p>The post <a rel="nofollow" href="http://www.milanor.net/blog/r-lab-shiny-maps-earthquakes-milan-april/">R-Lab #2: Shiny &amp; maps + earthquakes | Milan, April 11th</a> appeared first on <a rel="nofollow" href="http://www.milanor.net/blog">MilanoR</a>.</p>
<p>Do you want a data science job? You need to become fluent at writing data science code ...</p>
<p>The post <a rel="nofollow" href="http://sharpsightlabs.com/blog/are-you-fluent-r/">Are you fluent in R?</a> appeared first on <a rel="nofollow" href="http://sharpsightlabs.com/">SHARP SIGHT LABS</a>.</p>
<p>For the development of <a href="https://github.com/mlr-org/mlr">mlr</a> as well as for an “machine learning expert” it can be handy to know what are the most popular learners used.
Not necessarily to see, what are the top notch performing methods but to see what is used “out there” in the real world. Thanks to the nice little package <a href="https://github.com/metacran/cranlogs">cranlogs</a> from <a href="https://www.r-pkg.org/">metacran</a> you can at least get a slight estimate as I will show in the following…</p>
<p>This week’s R bulletin will cover functions calls, sorting data frame, creating time series object, and functions like is.na, na.omit, paste, help, rep, and seq function. Hope you like this R weekly bulletin. Enjoy reading! Shortcut Keys 1. To show files – Ctrl+5 2. To show plots – Ctrl+6 3. To show packages – Ctrl+7 Problem Solving Ideas...</p>
<p>The post <a rel="nofollow" href="https://www.quantinsti.com/blog/r-weekly-bulletin-vol-ii/">R Weekly Bulletin Vol – II</a> appeared first on <a rel="nofollow" href="https://www.quantinsti.com/"></a>.</p>
by Bryan Lewis R (https://www.r-project.org) is a premier system for statistical and scientific computing and data science. At its core, R is a very carefully curated high-level interface to low-level numerical libraries. True to this principle, R packages have greatly expanded the scope and number of these interfaces over the years, among them interfaces to […]
by JS Tan (Program Manager, Microsoft) For users of the R language, scaling up their work to take advantage of cloud-based computing has generally been a complex undertaking. We are therefore excited to announce doAzureParallel, a lightweight R package built on Azure Batch that allows you to easily use Azure’s flexible compute resources right from your R session. The doAzureParallel package complements Microsoft R Server and provides the infrastructure you need to run massively parallel simulations on Azure directly from R. The doAzureParallel package is a parallel backend for the popular foreach package, making it possible to execute multiple processes...
Authors: John Mount and Nina Zumel. Introduction It’s been our experience when teaching the data wrangling part of data science that students often have difficulty understanding the conversion to and from row-oriented and column-oriented data formats (what is commonly called pivoting and un-pivoting). Boris Artzybasheff illustration Real trust and understanding of this concept doesn’t fully … <a href="http://www.win-vector.com/blog/2017/03/coordinatized-data-a-fluid-data-specification/">Continue reading <span>Coordinatized Data: A Fluid Data Specification</span></a>
<p>Data science is a pretty serious occupation. What about data pseudoscience? This blog post shows how to calculate your biorhythm using R. <a href="http://r.prevos.net/data-pseudo-science-calculating-biorythm/">Continue reading <span>→</span></a></p>
<p>The post <a rel="nofollow" href="http://r.prevos.net/data-pseudo-science-calculating-biorythm/">Data Pseudo-Science: Developing a Biorhythm Calculator</a> appeared first on <a rel="nofollow" href="http://r.prevos.net/">The Devil is in the Data</a>.</p>
In this post, we’ll try to re-create Burtin’s antibiotics visualization using Plotly. The post follows Mike Bostock’s original re-creation in Protovis. See here. [crayon-58dc993934e8b225151869/]
Trying gradient descent for linear regression
The best way to learn an algorith is to code it. So here it is, my take on Gradient Descent Algorithm for simple linear regression.
First, we fit a simple linear model with lm for comparison with gradient...
A fast method to add annotations to a plot
Making professional looking plots in R can be fiddly. One task that I often spend ages doing is manually finding coordinates to add labels.
Wouldn’t it be nice if you could just send the coordinates directl...
Linear Support Vector Machine or linear-SVM(as it is often abbreviated), is a supervised classifier, generally used in bi-classification problem, that is the problem setting, where there are two classes. Of course it can be extended to multi-class problem. In this work, we will take a mathematical understanding of linear SVM along with R code to […]<ul></ul><strong><p>Related Post</p></strong><ol><li><a title="Permanent Link toHow to add a background image to ggplot2 graphs" rel="bookmark" href="https://datascienceplus.com/how-to-add-a-background-image-to-ggplot2-graphs/">How to add a background image to ggplot2 graphs</a></li><li><a title="Permanent Link toStreamline your analyses linking R to SAS: the workfloweR experiment" rel="bookmark" href="https://datascienceplus.com/streamline-your-analyses-linking-r-to-sas/">Streamline your analyses linking R to SAS: the workfloweR experiment</a></li><li><a title="Permanent Link toR Programming – Pitfalls to avoid (Part 1)" rel="bookmark" href="https://datascienceplus.com/r-programming-pitfalls-to-avoid-part-1/">R Programming – Pitfalls to avoid (Part 1)</a></li><li><a title="Permanent Link toEclipse – an alternative to RStudio – part 2" rel="bookmark" href="https://datascienceplus.com/eclipse-an-alternative-to-rstudio-part-2/">Eclipse – an alternative to RStudio – part 2</a></li><li><a title="Permanent Link toEclipse – an alternative to RStudio – part 1" rel="bookmark" href="https://datascienceplus.com/eclipse-an-alternative-to-rstudio-part-1/">Eclipse – an alternative to RStudio – part 1</a></li></ol>
Even most sophisticated machine learning methods, most beautiful visualisations and perfect datasets can be useless if you do your research carelessly and ignore the context of your code execution. In this article, you will read about a few situations ...
Like all governments, the UK government is responsible for producing reports of official statistics on an ongoing basis. That process has traditionally been a highly manual one: extract data from government systems, load it into a mainframe statistical analysis tool and run models and forecasts, extract the results to a spreadsheet to prepare data for presentation, and ultimately combine it all in a manual document editing tool to produce the final report. The process in the UK looks much like this today: Matt Upson, a Data Scientist at the UK Government Digital Service, is looking to modernize this process with...
My friend Jonathan Sidi and I (Tal Galili) are pleased to announce the release of shinyHeatmaply (0.1.0): a new Shiny application (and Shiny gadget) for creating interactive cluster heatmaps. shinyHeatmaply is based on the heatmaply R package which strives to make it easy as possible to create interactive cluster heatmaps. The app introduces a functionality that saves to disk a self … <a href="https://www.r-statistics.com/2017/03/shinyheatmaply-a-shiny-app-for-creating-interactive-cluster-heatmaps/">Continue reading<span> &quot;shinyHeatmaply – a shiny app for creating interactive cluster heatmaps&quot;</span></a>
We’re excited to announce the release of RStudio Connect: version 1.4.4.1. This release includes the ability to manage different versions of your work on RStudio Connect. Rollback / Roll Forward The most notable feature of this release is the ability to “rollback” to a previously deployed version of your work or “roll forward” to a […]
A new minor version of the nanotime package for working with nanosecond timestamps arrived yesterday on CRAN.
nanotime uses the RcppCCTZ package for (efficient) high(er) resolution time parsing and formatting up to nanosecond resolution, and the bit6...
My family and I love boardgames.  We are also on the lookout for new ones that would fit with the ones we already like to play.  So I decided to create a boardgame recommendation website<br><br><a href="https://larrydag.shinyapps.io/boardgame_reco/">https://larrydag.shinyapps.io/boardgame_reco/</a><br><br>I built it using R.  The recommendation engine uses a very simple collaborative filtering algortihm based on correlation scores from other boardgame players collection lists.  The collections are gathered using the API from <a href="http://boardgamegeek.com/">BoardgameGeek.com</a>.  It is very much in a beta project phase as I just wanted to get something built to get working. <br><br>I also wanted another project to build in <a href="http://shiny.rstudio.com/">Shiny</a>.  I really like how easy it is to publish R projects with Shiny. <br><br>Some of the features include:<br><br><ul><li>Ability to enter your own collection</li><li>Get recommendation on your collection</li><li>Amazon link to buy boardgame that is recommended</li></ul><div>Its a work in progress.  There is much to clean up and to make more presentable.  Please take a look and offer comments to help improve the website. </div>
Le Monde mathematical puzzle launched a competition to celebrate its 1000th puzzle! A fairly long-term competition as it runs over the 25 coming puzzles (and hence weeks). Starting with puzzle #1001. Here is the 1000th puzzle, not part of the competition: Alice &amp; Bob spend five (identical) vouchers in five different shops, each time buying […]
Redmonk have once again updated (a little later than usual) their bi-annual programming language report with their January 2017 rankings. If you haven't come across these rankings before, they are based on GitHub contributions and StackOverflow questions related to around 40 commonly-used programming languages. The raw data (as of January 2017) is shown below — as you might guess from the appearance of the chart, the analysis for the rankings is done in R. Languages used by data scientists rank highly in this metric. Python is ranked #3 (up from #4 in the June 2016 rankings). R is ranked #14,...
Data science enhances people’s decision making. Doctors and researchers are making critical decisions every day. Therefore, it is absolutely necessary for those people to have some basic knowledge of data science. This series aims to help people that are around medical field to enhance their data science skills. We will work with a health related […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Data science for Doctors: Inferential Statistics Exercises (part-2)" rel="bookmark" href="http://r-exercises.com/2017/03/19/data-science-for-doctors-inferential-statistics-exercises-part-2/">Data science for Doctors: Inferential Statistics Exercises (part-2) </a></li>
<li><a title="Data Science for Doctors – Part 4 : Inferential Statistics (1/5)" rel="bookmark" href="http://r-exercises.com/2017/02/20/data-science-for-doctors-part-4-inferential-statistics-15/">Data Science for Doctors – Part 4 : Inferential Statistics (1/5) </a></li>
<li><a title="Data Science for Doctors – Part 2 : Descriptive Statistics" rel="bookmark" href="http://r-exercises.com/2017/02/05/data-science-for-doctors-part-2-descriptive-statistics/">Data Science for Doctors – Part 2 : Descriptive Statistics </a></li>
<li><a href="http://r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
@eddelbuettel’s idea is a good one. (it’s a quick read…jump there and come back). I often wait for a complete example or new package announcement to blog something when a briefly explained snippet might have sufficient utility for many R users. Also, tweets are fleeting and twitter could end up on the island of misfit... <a href="https://rud.is/b/2017/03/27/all-in-on-r%E2%81%B4-progress-bars-on-first-post/">Continue reading <span>→</span></a>
<p>Speaking publicly about your data science projects is one of the best things you can do for your portfolio. Writing your presentation will help you refine...</p>
<p>The post <a rel="nofollow" href="http://www.arilamstein.com/blog/2017/03/27/reach-people-next-data-science-talk/">How to Reach More People with your Next Data Science Talk</a> appeared first on <a rel="nofollow" href="http://www.arilamstein.com/">AriLamstein.com</a>.</p>
This is my first article in a two-part series introducing stock data analysis using R.
So I had been toying with the idea of getting back to the blog and more regularly writing / posting little tips and tricks. I even starting taking some notes but because perfect is always the enemy of the good it never quite materialized.
But the rel...
<p>I’m happy to announce my first R package, called <code>brotools</code>. This is a package that contains functions that are specific to my needs but that you might find also useful. I blogged about some of these functions, so if you follow my blog you might already be familiar with some of them. It is not on CRAN and might very well never be. The code is hosted on <a href="https://bitbucket.org/b-rodrigues/brotools">bitbucket</a> and you can install the package with</p>
<pre><code>devtools::install_bitbucket(&quot;b-rodrigues/brotools&quot;)</code></pre>
<p>Hope you’ll find the <code>brotools</code> useful!</p>
A short post to alert the world that my modest Shiny application, showing Major League Baseball run scoring trends since 1901, has been updated to include the 2016 season. The application can be found here:<br><a href="https://monkmanmh.shinyapps.io/MLBrunscoring_shiny/">https://monkmanmh.shinyapps.io/MLBrunscoring_shiny/</a>.<br><br>In addition to the underlying data, the update removed some of the processing that was happening inside the application, and put it into the pre-processing stage. This processing needs to happen only the once, and is not related to the reactivity of the application. This will improve the speed of the application; in addition to reducing the processing, it also shrinks the size of the data table loaded into the application.<br><br>The third set of changes were a consequence of the updates to the Shiny and ggplot2 packages in the two years that have passed since I built the app. In Shiny, there was a deprecation for &quot;format&quot; in the <a href="https://shiny.rstudio.com/reference/shiny/latest/sliderInput.html">sliderInput widget</a>. And in ggplot2, it was a change in the quotes around the &quot;method&quot; specification in stat_smooth(). A little thing that took a few minutes to debug! Next up will be some formatting changes, and a different approach to one of the visualizations.<br><br> -30-
The Economics chapter of my Empirical software engineering book has been added to the draft pdf (download here). This is a slim chapter, it might grow a bit, but I suspect not by a huge amount. Reasons include lots of interesting data being confidential and me not having spent a lot of time on this […]
After a long lag (due to my missing the free copies distributed at Paris-Dauphine!), here is a Sudoku-like Le Monde mathematical puzzle: A grid of size (n,n) holds integer values such that any entry larger than 1 is the sum of one term in the same column and one term in the same row. What […]
Processing and modelling financial data with R - My Portuguese book about finance and R was
published
a couple of months ago and, given its positive feedback, I decided to
work on the english version immediately. You can find det...
On 22. March a first special R related meetup called R&lt;-Slovakia took place. As the name of the meetup group implies, it is based in Slovakia, in its capital - Bratislava. I am very happy to be the first speaker on this event ever. R&lt;-Slovakia ha...
The Yemeni civil war has received very little attention despite the growing humanitarian disaster. There is a lack of reliable figures on the extent of the human suffering in Yemen. The few data that is available suggests that it is immense. According to the UN, from March 2015 to August 2016, over 10,000 people have … <a href="http://freigeist.devmag.net/r/979-using-r-measuring-the-yemen-conflict-from-high-frequency-night-light-images.html">Continue reading <span>Using R to study the Yemen Conflict with night light images</span> <span>→</span></a>
Over the weekend I released a new webpage, connected to this blog, with forecasts for the New Zealand 2017 General Election. The aim is to go beyond poll aggregation to something that takes the uncertainty of the future into account, as well as relati...
The 2nd edition of both my books a) Cricket analytics with cricketr b) Beaten by sheer pace – Cricket analytics with yorkr is now available on Amazon, both as Paperback and Kindle versions. Pick up your copies today!!! A) Cricket analytics with cricketr: Second Edition B) Beaten by sheer pace: Cricket analytics with yorkr(2nd edition) … <a href="https://gigadom.wordpress.com/2017/03/26/more-book-more-cricket-2nd-edition-of-my-books-now-on-amazon/">Continue reading <span>More book, more cricket! 2nd edition of my books now on Amazon</span></a>
This post is the result of work performed in collaboration with my colleague Eleonora Paparelli (who actually did most of the work!). We wanted to compare several distributions using Wilcoxon test and summarize results (i.e. indicate the comparisons showing significant differences). R base includes pairwise.wilcox.test to perform Wilcoxon rank sum test between all pairs of […]
Two days after the initial 0.0.1 release, a new version of RApiDatetime has just arrived on CRAN.
RApiDatetime provides six entry points for C-level functions of the R API for Date and Datetime calculations. The functions asPOSIXlt and asPOSIXct conv...
Recently, I got a book by Brasilian writer  Júlio César de Mello e Souza (published under pen name Malba Tahan), titled The Man who counted. Book is a collection of mathematical stories very similar to Scheherazada’s 1001 Nights, where mathematical story-telling is the center of book.                                                In story 5“In so many words”, Malba describes … <a href="https://tomaztsql.wordpress.com/2017/03/25/linear-regression-in-the-man-who-counted/">Continue reading <span>Linear regression in “The Man who counted”</span></a>
This is a note on debugging magrittr pipelines in R using Bizarro Pipe and eager assignment. Pipes in R The magrittr R package supplies an operator called “pipe” which is written as “%>%“. The pipe operator is partly famous due to its extensive use in dplyr and use by dplyr users. The pipe operator is … <a href="http://www.win-vector.com/blog/2017/03/debugging-pipelines-in-r-with-bizarro-pipe-and-eager-assignment/">Continue reading <span>Debugging Pipelines in R with Bizarro Pipe and Eager Assignment</span></a>
Dirk Eddelbuettel quite rightly reminded us the other day that Suggests is not Depends. I am sorry to say that I am one of those who are using Suggests… “casually”. Mea culpa. I must say that this is restricted to vignettes: there are no tests nor examples using suggested packages. But I am not checking… <a href="https://www.enchufa2.es/archives/suggests-and-vignettes.html">Continuar leyendo <span>Suggests and Vignettes</span> <span>→</span></a>
FiveThirtyEight published a fascinating article this week about the subreddits that provided support to Donald Trump during his campaign, and continue to do so today. Reddit, for those not in the know, is an popular online social community organized into thousands of discussion topics, called subreddits (the names all begin with &quot;r/&quot;). Most of the subreddits are a useful forum for interesting discussions by like-minded people, and some of them are toxic. (That toxicity extends to some of the names, which is reflected in some of the screenshots below — apologies in advance.) The article looks at various popular and...
Transform your App into Dashboard Now that we covered the basic staff that you need to know in order to build your App it is time to enhance its appearance and its functionality. The interface is very important fot the user as it must not only be friendly but also easy to use. At this […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Building Shiny App exercises part 1" rel="bookmark" href="http://r-exercises.com/2016/12/12/building-shiny-app-exercises-part-1/">Building Shiny App exercises part 1 </a></li>
<li><a title="Building Shiny App exercises part 2" rel="bookmark" href="http://r-exercises.com/2016/12/18/building-shiny-app-exercises-part-2/">Building Shiny App exercises part 2 </a></li>
<li><a title="Building Shiny App exercises part 3" rel="bookmark" href="http://r-exercises.com/2016/12/25/building-shiny-app-exercises-part-3/">Building Shiny App exercises part 3 </a></li>
<li><a href="http://r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
Adnan Fiaz Conferences are an ideal platform to share your work with the wider community. However, as we all know, conferences require potential speakers to submit abstracts about their talk. And writing abstracts is not necessarily the most rewarding work … <a href="http://www.mango-solutions.com/wp/2017/03/writing-a-conference-abstract-the-data-science-way/">Continue reading <span>→</span></a>
by Joseph Rickert Few of us have enough time to read, and most of us already have depressingly deep stacks of material that we would like to get through. However, sometimes a random encounter with something interesting is all that it takes to regenerate enthusiasm. Just in case you are not going to get to […]
The collection of example flight data in json format available in part 2, described the libraries and the structure of the POST request necessary to collect data in a json object. Despite the process generated and transferred locally a proper response, the data collected were neither in a suitable structure for data analysis nor immediately … <a href="http://r-posts.com/web-data-acquisition-parsing-json-objects-with-tidyjson-part-3/">Continue reading <span>Web data acquisition: parsing json objects with tidyjson (Part 3)</span></a>
Superpixels are used in image segmentation as a pre-processing step. Instead of segmenting pixels directly, we first group similar pixels into “super-pixels”, which can then be processed further (and more cheaply). (image from Wikimedia) The current version of imager doesn’t implement them, but it turns out that SLIC superpixels are particularly easy to implement. SLIC […]
<p>We are starting with R weekly bulletins which will contain some interesting ways and methods to write codes in R and solve bugging problems. We will also cover R functions and shortcut keys for beginners. We understand that there can be more than one way of writing a code in R, and the solutions listed...</p>
<p>The post <a rel="nofollow" href="https://www.quantinsti.com/blog/r-weekly-bulletin-vol/">R Weekly Bulletin Vol – I</a> appeared first on <a rel="nofollow" href="https://www.quantinsti.com/"></a>.</p>
Ordnance Survey have a great OpenRoads dataset, but unfortunately it contains a column called ‘primary’, which is a keyword in SQL. This makes it challenging/impossible to import the OpenRoads dataset into a SQL… <a href="https://scottishsnow.wordpress.com/2017/03/24/r-colnames-spatial-dataframe/">Continue reading <span>→</span></a>
<div>I created a Twitter account which was inspired by a couple Twitter accounts that applied a particular type of machine learning technique to learn how two (at the time) presidential hopefuls spoke. I thought, why not see what a model like this could do with lyrics from my favorite rock n roll artist?</div><div>Long short term memory (LSTM) is a recurrent neural network (RNN) that can be used to produce sentences or phrases by learning from text. The two twitter accounts that inspired this were <a href="https://twitter.com/deeplearnbern?lang=en">‘<span>@deeplearnthebern</span>’</a> and <a href="https://www.twitter.com/deepdrumpf">‘<span>@deepdrumpf</span>’</a> which use this technique to produce phrases and sentences.</div><div>I scraped a little more than 300 of his songs and have fed them to a LSTM model using R and the mxnet library. Primarily I used the <a href="http://mxnet.io/">mxnet.io/</a> to build and train the model…great site and tools.  The tutorials on their site are very helpful and particularly <a href="http://mxnet.io/tutorials/r/charRnnModel.html">this one</a>.<br><br><div><a href="https://3.bp.blogspot.com/-Jbz1sAlq6po/WNQeKuzn5fI/AAAAAAAACsw/Dab5NqLi2cABLZ_K9L0mQn9xU6VYofXzwCLcB/s1600/Screen%2BShot%2B2017-03-23%2Bat%2B9.10.05%2BAM.png"></a></div><br><br>The repository is <a target="_blank" href="https://github.com/justlebeau/justlebeau.github.io/tree/master/brucebot">here</a> that contains the code for the scraper and other information.</div><div>Follow <a href="https://twitter.com/DeepLearn_Bruce">deeplearnbruce</a> for tweets that are hopefully entertaining for Springsteen fans or anyone else. </div>
by Shahrokh Mortazavi, Partner PM, Visual Studio Cloud Platform Tools at Microsoft I’m delighted to announce the general availability of R Tools 1.0 for Visual Studio 2015 (RTVS). This release will be shortly followed by R Tools 1.0 for Visual Studio 2017 in early May. RTVS is a free and open source plug-in that turns Visual Studio into a powerful and productive R development environment. Check out this video for a quick tour of its core features: Core IDE Features RTVS builds on Visual Studio, which means you get numerous features for free: from using multiple languages to word-class Editing...
<p>QR decomposition is another technique for decomposing a matrix into a form that is easier to work with in further applications. The QR decomposition technique decomposes a square or rectangular matrix, which we will denote as , into two components, , and . Where is an orthogonal matrix, and is...</p>
<p>The post <a rel="nofollow" href="http://www.aaronschlegel.com/qr-decomposition-gram-schmidt-algorithm/">QR Decomposition with the Gram-Schmidt Algorithm</a> appeared first on <a rel="nofollow" href="http://www.aaronschlegel.com/">Aaron Schlegel</a>.</p>
Creating a giant dot density map using R.
At the [R] Kenntnis-Tage 2017 on November 8 and 9, 2017 you will get the chance to benefit not only from the exchange about the programming language R in a business context and practical tutorials but also from the audience: use the [R] Kenntnis-Tage 2017 as your platform and hand in your topic for the … <a href="https://blog.eoda.de/2017/03/23/make-the-r-kenntnis-tage-2017-your-stage/"><span>„Make the [R] Kenntnis-Tage 2017 your stage“ </span>weiterlesen</a>
I’ve just finished a major overhaul to my widely read article, Why R is Hard to Learn. It describes the main complaints I’ve heard from the participants to my workshops, and how those complaints can often be mitigated. Here’s the only … <a href="http://r4stats.com/2017/03/23/the-tidyverse-curse/">Continue reading <span>→</span></a>
We at mlr are currently deciding on a new logo, and in the spirit of open-source, we would like to involve the community in the voting process!
You can vote for your favorite logo on GitHub by reacting to the logo with a +1.
Thanks to Hannah Atkin fo...
Published: 2016-11-30
Updated: 2017-03-23
&quot;Any bleeder knows that books are never finished, only abandoned.&quot;
Why Information Grows
About the book
You can find the book here.
This is a book that may look complete but changes in R package are al...
<p>A solution in the R language to Euler Problem 17: If all the numbers from 1 to 1000 inclusive were written out in words, how many letters would be used? <a href="http://r.prevos.net/euler-problem-17-number-letter-counts/">Continue reading <span>→</span></a></p>
<p>The post <a rel="nofollow" href="http://r.prevos.net/euler-problem-17-number-letter-counts/">Euler Problem 17: Number Letter Counts</a> appeared first on <a rel="nofollow" href="http://r.prevos.net/">The Devil is in the Data</a>.</p>
Pokémon Go is an augmented reality game where people with smartphones walk around and catch Pokémon. As in the classic games, players are
Pokémon “trainers” who have to travel around and collect creatures. Some types are rarer than others, som...
A Quick Overview of the ggplot2 Package in R While it will be important to focus on theory, I want to explain the ggplot2 package because I will be using it throughout the rest of this series. Knowing how it works will keep the focus on the results rather than the code. It’s an incredibly […]
I recently got back from Strata West 2017 (where I ran a very well received workshop on R and Spark). One thing that really stood out for me at the exhibition hall was Bokeh plus datashader from Continuum Analytics. I had the privilege of having Peter Wang himself demonstrate datashader for me and answer a … <a href="http://www.win-vector.com/blog/2017/03/datashader-is-a-big-deal/">Continue reading <span>Datashader is a big deal</span></a>
<p>With this post I want to show you how to benchmark several learners (or learners with different parameter settings) using several data sets in a structured and parallelized fashion.
For this we want to use <a href="https://mllg.github.io/batchtools/"><code>batchtools</code></a>.</p>
<p>The data that we will use here is stored on the open machine learning platform <a href="https://www.openml.org/">openml.org</a> and we can download it together with information on what to do with it in form of a task.</p>
by John-Mark Agosta, data scientist manager at Microsoft Let’s say you’ve built a model in R that is larger than you can conveniently run locally, and you want to take advantage of Azure’s resources simply to run it on a larger machine. This blog explains how to provision and run an Azure virtual machine (VM) for this, using the mrsdeploy library that comes installed with Microsoft’s R Server. We will work specifically with the Unbuntu Linux version of the VM, so I you’ll need to be familiar with working with superuser privileges at the command line in Linux, and of...
by Joseph Rickert One hundred and forty-five new packages were added to CRAN in February. Here are 47 interesting packages organized into five categories; Biostatistics, Data, Data Science, Statistics and Utilities. Biostatistics BaTFLED3D v0.1.7: Implements a machine learning algorithm to make predictions and determine interactions in data that varies along three independent modes. It was […]
<p>Many people who want to apply Bayesian optimization want to use it to optimize an algorithm that is not implemented in <strong>R</strong> but runs on the command line as a shell script or an executable.</p>
<p>We recently published <a href="http://mlr-org.github.io/mlrMBO/"><strong>mlrMBO</strong></a> on CRAN.
As a normal package it normally operates inside of R, but with this post I want to demonstrate how <strong>mlrMBO</strong> can be used to optimize an external application.
At the same time I will highlight some issues you can likely run into.</p>
We’re excited to announced the first round of gReat speakers for San Francisco EARL. Alongside our keynote speakers, Hilary Parker and Ricardo Bion, R Users from a range of industries will share their R stories. Take a look at our … <a href="http://www.mango-solutions.com/wp/2017/03/san-francisco-earl-first-round-of-speakers-announced/">Continue reading <span>→</span></a>
At my workplace, employees celebrate a month of Data Analysis for Societal good, every year. During this time, we try to help NPOs (Non-Profit Organisations) in gaining insights from their data, for free. Whilst we are engaged in this practice at workp...
Financial time series analysis and their forecasting have an history of remarkable contributions. It is then quite hard for the beginner to get oriented and capitalize from reading such scientific literature as it requires a solid understanding of basic statistics, a detailed study of the ground basis of time series analysis tools and the knowledge […]<ul></ul><strong><p>Related Post</p></strong><ol><li><a title="Permanent Link toOutlier detection and treatment with R" rel="bookmark" href="https://datascienceplus.com/outlier-detection-and-treatment-with-r/">Outlier detection and treatment with R</a></li><li><a title="Permanent Link toImplementing Apriori Algorithm in R" rel="bookmark" href="https://datascienceplus.com/implementing-apriori-algorithm-in-r/">Implementing Apriori Algorithm in R</a></li><li><a title="Permanent Link toR for Publication: Lesson 6, Part 2 – Linear Mixed Effects Models" rel="bookmark" href="https://datascienceplus.com/r-for-publication-by-page-piccinini-lesson-6-part-2-linear-mixed-effects-models-lmem/">R for Publication: Lesson 6, Part 2 – Linear Mixed Effects Models</a></li><li><a title="Permanent Link toR for Publication: Lesson 6, Part 1 – Linear Mixed Effects Models" rel="bookmark" href="https://datascienceplus.com/r-for-publication-by-page-piccinini-lesson-6-part-1-linear-mixed-effects-models-lmem/">R for Publication: Lesson 6, Part 1 – Linear Mixed Effects Models</a></li><li><a title="Permanent Link toCross-Validation: Estimating Prediction Error" rel="bookmark" href="https://datascienceplus.com/cross-validation-estimating-prediction-error/">Cross-Validation: Estimating Prediction Error</a></li></ol>
<p>
Eighteen months ago <a href="http://www.fromthebottomoftheheap.net/2016/12/15/simultaneous-interval-revisited/">I screwed up</a>! I’d written a <a href="http://www.fromthebottomoftheheap.net/2014/06/16/simultaneous-confidence-intervals-for-derivatives/">post</a> in which I described the use of simulation from the posterior distribution of a fitted GAM to derive simultaneous confidence intervals for the derivatives of a penalized spline. It was a nice post that attracted some interest. It was also wrong. In December I corrected the first part of that mistake by illustrating one approach to compute an actual simultaneous interval, but only for the fitted smoother. At the time I thought that the approach I outlined would translate to the derivatives but I was being lazy then Christmas came and went and I was back to teaching — you know how it goes. Anyway, in this post I hope to finally rectify my past stupidity and show how the approach used to generate simultaneous intervals from the December 2016 post can be applied to the derivatives of a spline.
</p>
A bugfix release of the anytime package arrived at CRAN earlier today. This is tenth release since the inaugural version late last summer, and the second (bugfix / feature) release this year.
anytime is a very focused package aiming to do just one th...
From the days of actual research papers (before the digital age), to now where research papers are posted online first, not much has really changed in the way we communicate. We still use static images, formulas and a bunch of text to show what we have...
The EARL (Enterprise Applications of R) conference is one of my favourite events to go to. As the name of the conference suggests, the focus of the conference is where the rubber of the R language meets the road of it being used to solve real-world problems. Prior conferences have included presentations on how Maersk uses R to optimize capacity for its shipping lines, how Investec has deployed R to support investment and risk teams, how Verizon uses R to analyze cybersecurity data, and how AstraZeneca uses R to design clinical trials. This years conferences, to be held in San...
<p>The most important factor for mastering data science is ...</p>
<p>The post <a rel="nofollow" href="http://sharpsightlabs.com/blog/one-thing-master-data-science/">The one thing you need to master data science</a> appeared first on <a rel="nofollow" href="http://sharpsightlabs.com/">SHARP SIGHT LABS</a>.</p>
This post is one of a series leading up to a purely data-driven probabilistic prediction model for the New Zealand general election in 2017. No punditry will be indulged in (if only to avoid complications with my weekday role as an apolitical public s...
I was invited to deliver a session for Belgium User Group on SQL Server and R integration. After the session – which we did online using web based Citrix  – I got an interesting question: “Is it possible to use RevoScaleR performance computational functions within Power BI?“. My first answer was,  a sceptical yes. But … <a href="https://tomaztsql.wordpress.com/2017/03/20/is-it-possible-to-use-revoscaler-package-in-power-bi/">Continue reading <span>Is it possible to use RevoScaleR package in Power BI?</span></a>
You can now use Alteryx Designer, the data science workflow tool from Alteryx, as a drag-and-drop interface for many of the big-data statistical modeling tools included with Microsoft R. Alteryx v11.0 includes expanded support for Microsoft SQL Server 2016, Microsoft R Server, Azure SQL Data Warehouse, and Microsoft Analytics Platform System (APS), with new workflow tools to access functionality without having to write R code manually. Alteryx V11 adds a new XDF Input tool (and corresponding XDF Output tool) to bring data into Alteryx using the Microsoft R out-of-memory file format. In addition, you can use several other new tools...
Last week, I was reading through Warren Buffett's most recent letter to Berkshire Hathaway shareholders. Every year, he writes a letter that he makes publicly available on the Berkshire Hathaway website. In the letters he talks about the performance of...
In this tutorial, you explore a number of data visualization methods and their underlying statistics. Particularly with regard to identifying trends and relationships between variables in a data frame.
That’s right, you’ll focus on concepts suc...
Version 2.0 of my data set validation package assertr hit CRAN just this weekend. It has some pretty great improvements over version 1. For those new to the package, what follows is a short and new introduction. For those who… <p><a href="http://www.onthelambda.com/2017/03/20/data-validation-with-the-assertr-package/">Continue reading <span>→</span></a></p>
<p>MilanoR is a free event, open to all R users and enthusiasts or those who wish to learn more about R. The meeting consists of two talks (this time one about big data and and one about statistical learning) + a free buffet and networking time</p>
<p>The post <a rel="nofollow" href="http://www.milanor.net/blog/8th-milanor-meeting-april-5th/">8th MilanoR Meeting: April 5th</a> appeared first on <a rel="nofollow" href="http://www.milanor.net/blog">MilanoR</a>.</p>
I found recently, that in addition to a great list of cheatsheets designed by RStudio, one can also download a template for new cheatsheets from RStudio Cheat Sheets webpage. With this template you can design your own cheatsheet, and submit it to the collection of Contributed Cheatsheets (Garrett Grolemund will help to improve the submission … <a href="http://smarterpoland.pl/index.php/2017/03/diy-cheat-sheets/">Czytaj dalej <span>DIY – cheat sheets</span></a>
Like I mentioned in my last blog post, I am contributing to a session at userR 2017 this coming July that will focus on discovering and learning about R packages. This is an increasingly important issue for R users as we all decide which of the 10,000+...
Two months ago padr was introduced, followed by an improved version that allowed for applying pad on group level. See the introduction blogs or the vignette(&quot;padr&quot;) for more package information. In this blog I give four more elaborate examples on how to go from raw data to insight with padr, dplyr and ggplot2. They might serve as recipes for time series problems you want to solve. The dataset emergency is available in padr, and contains about a year of emergency data in Montgomery County, PA. For this blog I only use the twelve most prevalent emergencies.
A story about one of the retail chains (J.C. Penny) releasing their list of stores closing in 2017 crossed paths with my Feedly reading list today and jogged my memory that there were a number of chains closing many of their doors this year, and I wanted to see the impact that might have on... <a href="https://rud.is/b/2017/03/19/exploring-2017-retail-store-closings-with-r/">Continue reading <span>→</span></a>
Today I’m very pleased to introduce the new Quandl API integration that is available in the development version of tidyquant. Normally I’d introduce this feature during the next CRAN release (v0.5.0 coming soon), but it’s really useful and honest...
The plotly R package will soon release version 4.6.0 which includes new features that are over a year in the making. The NEWS file lists all the new features and changes. This webinar highlights the most important new features including animations and multiple linked views. Concrete examples with code that you can run yourself will […]
Our book Practical Data Science with R has just been reviewed in Association for Computing Machinery Special Interest Group on Algorithms and Computation Theory (ACM SIGACT) News by Dr. Allan M. Miller (U.C. Berkeley)! The book is half off at Manning form March 21st 2017 using the following code (please share/Tweet): Deal of the Day … <a href="http://www.win-vector.com/blog/2017/03/practical-data-science-with-r-acm-sigact-news-book-review-and-discount/">Continue reading <span>Practical Data Science with R: ACM SIGACT News Book Review and Discount!</span></a>
Data science enhances people’s decision making. Doctors and researchers are making critical decisions every day. Therefore, it is absolutely necessary for those people to have some basic knowledge of data science. This series aims to help people that are around medical field to enhance their data science skills. We will work with a health related […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Data Science for Doctors – Part 4 : Inferential Statistics (1/5)" rel="bookmark" href="http://r-exercises.com/2017/02/20/data-science-for-doctors-part-4-inferential-statistics-15/">Data Science for Doctors – Part 4 : Inferential Statistics (1/5) </a></li>
<li><a title="Data Science for Doctors – Part 2 : Descriptive Statistics" rel="bookmark" href="http://r-exercises.com/2017/02/05/data-science-for-doctors-part-2-descriptive-statistics/">Data Science for Doctors – Part 2 : Descriptive Statistics </a></li>
<li><a title="Data Science for Doctors – Part 3 : Distributions" rel="bookmark" href="http://r-exercises.com/2017/02/13/data-science-for-doctors-part-3-distributions/">Data Science for Doctors – Part 3 : Distributions </a></li>
<li><a href="http://r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
Two months ago padr was introduced, followed by an improved version that allowed for applying pad on group level. See the introduction blogs or the vignette(&quot;padr&quot;) for more package information. In this blog I give four more elaborate examples on how to go from raw data to insight with padr, dplyr and ggplot2. They might serve as recipes for time series problems you want to solve. The dataset emergency is available in padr, and contains about a year of emergency data in Montgomery County, PA. For this blog I only use the twelve most prevalent emergencies.
This week I was impressed by this tweet where Daniel Pett, Digital Humanities Lead at the British Museum, presented a collage of Twitter profile pics of all his colleagues. He made this piece of art using R (for collecting the usernames) and Python. I?...
When we’re working for clients we mostly come across the statistical programming languages SAS, SPSS, R and Python. Of these SAS and SPSS are probably the most used. However, the interest for the open source languages R and Python is increasing. In recent years, some of our clients migrated from using SAS or SPSS to […]
<p>Some weeks ago I had a presentation at my work place about “R for data science” that I’d like to share with you. I’ve written the slides in R and rmarkdown and uploaded them to rpubs.com. I chose to use rmarkdown for my slides although we have great company PowerPoint templates, because I wanted to … <a href="http://blog.haunschmid.name/presentation-r-data-science/">Continue reading <span>Presentation “R for Data Science”</span></a></p>
<p>The post <a rel="nofollow" href="http://blog.haunschmid.name/presentation-r-data-science/">Presentation “R for Data Science”</a> appeared first on <a rel="nofollow" href="http://blog.haunschmid.name/">verenahaunschmid</a>.</p>
In this post I include my  3 video presentations on the topic “Essential R”. In these 3 presentations I cover the entire landscape of R. I cover the following R Language – The essentials Key R Packages (dplyr, lubridate, ggplot2, etc.) How to create R Markdown and share reports A look at Shiny apps How … <a href="https://gigadom.wordpress.com/2017/03/18/my-3-video-presentations-on-essential-r/">Continue reading <span>My 3 video presentations on “Essential R”</span></a>
Jonathan Carroll had a an interesting R language idea: to use @-notation to request value substitution in a non-standard evaluation environment (inspired by msyql User-Defined Variables). He even picked the right image: The idea is kind of reverse from some Lisp ideas (&quot;evaled unless ticked&quot;), but an interesting possibility. We can play along with it … <a href="http://www.win-vector.com/blog/2017/03/another-r-non-standard-evaluation-idea/">Continue reading <span>Another R [Non-]Standard Evaluation Idea</span></a>
If you want to see a great example of how data science can inform every stage of a business process, from product concept to operations, look no further than Stitch Fix's Algorithms Tour. Scroll down through this explainer to see how this personal styling service uses data and statistical inference to suggest clothes their customers will love, ship them from a nearby warehouse (already stocked thanks to demand modeling), and incorporate customer feedback and designer trends into the next round of suggestions. The design of the Tour is interactive and elegant, and clearly someone put a lot of work into...
In ANOVA our interest lies in knowing if one continuous dependent variable is affected by one or more categorical independent variables. MANOVA is an extension of ANOVA where we are now able to understand how several dependent variables are affected by independent variables. For example consider an investigation where a medical investigator has developed 3 […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="One Way Analysis of Variance Exercises" rel="bookmark" href="http://r-exercises.com/2016/09/30/one-way-analysis-of-variance-exercises/">One Way Analysis of Variance Exercises </a></li>
<li><a title="Two Way ANOVA in R Exercises" rel="bookmark" href="http://r-exercises.com/2016/10/17/two-way-anova-in-r-exercises/">Two Way ANOVA in R Exercises </a></li>
<li><a title="Paired t-test in R Exercises" rel="bookmark" href="http://r-exercises.com/2016/09/21/paired-t-test-in-r/">Paired t-test in R Exercises </a></li>
<li><a href="http://r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
A couple of days ago, I spotted a post by Oli Hawkins on Visualising migration between the countries of the UK which linked to a Sankey diagram demo of Internal migration flows in the UK. One of the things that interests me about the Jupyter and RStudio centred reproducible research ecosystems is their support for […]
A Reproducible Finance with R Post by Jonathan Regenstein Welcome to another installment of Reproducible Finance with R. Today we are going to shift focus in recognition of the fact that there’s more to Finance than stock prices, and there’s more to data download than quantmod/getSymbols. In this post, we will explore commodity prices using […]
Hola! We just released episode 14 of our DataChats video series, you'll like this one.
In this episode, we interview Hank Roark. Hank is a Senior Data Scientist at Boeing and a long time user of the R language. Prior to his current role, he led the C...
For a while now, I have been looking for ways to incorporate pretty D3 graphics into R markdown reports or shiny apps. Why? I like R for the ability to be able to do data handling, stats, ML all very easily with minimal code. But when you want to prese...
Introduction Because it is Friday, another ‘playful and frivolous‘ data exercise 🙂 IKEA is more than a store, it is a very nice experience to go through. I can drop of my two kids at smàland, have some ‘quality time’ … <a href="https://longhowlam.wordpress.com/2017/03/17/because-its-friday-the-ikea-billy-index/">Continue reading <span>→</span></a>
<p>FIND YOUR BIRTHDAY IN PI, IN THREE DIFFERENT FORMATS It was Pi Day (March 14, like 3/14, like 3.14, get it?) recently and Time Magazine did a fun interactive app in which you can find your birthday inside the digits of pi. However: 1) They only used one format of birthday, in which July 4th […]</p>
<p>The post <a rel="nofollow" href="http://www.decisionsciencenews.com/2017/03/17/many-digits-pi-need-go-find-birthday/">How many digits into pi do you need to go to find your birthday?</a> appeared first on <a rel="nofollow" href="http://www.decisionsciencenews.com/">Decision Science News</a>.</p>
“I was just thinking that there might be a magic trick to simulate directly from this distribution without having to go for less efficient methods.” In a simple question on X validated a few days ago [about simulating from x²φ(x)] popped up the remark that the person asking the question wanted a direct simulation method […]
When it comes to getting things right in data science, most of the focus goes to the data and the statistical methodology used. But when a misplaced parenthesis can throw off your results entirely, ensuring correctness in your programming is just as important. A new book published by CRC Press, Testing R Code by Richard (Richie) Cotton, provides all the guidance you’ll need to write robust, correct code in the R language. This is not a book exclusively for package developers: data science, after all, is a combination of programming and statistics, and this book provides lots of useful advice...
NUTS
In my ongoing quest to track The Popularity of Data Science Software, I’ve updated the discussion of the annual report from Forrester, which I repeat here to save you from having to read through the entire document. If your organization … <a href="http://r4stats.com/2017/03/16/forrester/">Continue reading <span>→</span></a>
Today, I want to show how I use Thomas Lin Pederson’s awesome ggraph package to plot decision trees from Random Forest models.
I am very much a visual person, so I try to plot as much of my results as possible because it helps me get a better feel f...
What is my home worth?  Many homeowners in America ask themselves this question, and many have an answer.  What does the market think, though?  The best way to estimate a property’s value is by looking at other, similar properties that have sold recently in the same area – the comparable sales approach.  In an effort … <a href="https://realdataweb.wordpress.com/2017/03/16/mapping-housing-data-with-r/">Continue reading <span>Mapping Housing Data with R</span></a><img height="1" alt="" width="1" src="https://pixel.wp.com/b.gif?host=realdataweb.wordpress.com&blog=121626920&post=296&subd=realdataweb&ref=&feed=1" border="0">
Many asset management firms are happily enjoying record revenue and profits driven not by inorganic growth or skillful portfolio management but by a seemingly endless increase in US equity prices. These firms are effectively commodity producers entirel...
This entry is part 21 of 21 in the series Using RLast August, in Python-style Logging in R, we described using an R script as a wrapper around the futile.logger package to generate log files for an operational R data processing … <a href="http://mazamascience.com/WorkingWithData/?p=1759">  read more ... </a>
I have new short screencast up: using R and RStudio to install and experiment with Apache Spark.
More material from my recent Strata workshop Modeling big data with R, sparklyr, and Apache Spark can be found here.
MRAN currently holds 7520 R Packages. We can see this with usage of following command (stipulating that you are using MRAN R version. ): library(tools) df_ap &lt;- data.frame(available.packages()) head(df_ap) With importing package tools, we get many useful functions to find additional information on packages. Function package.dependencies() parses and check dependencies of a package in current … <a href="https://tomaztsql.wordpress.com/2017/03/15/revoscaler-package-dependencies-with-graph-visualization/">Continue reading <span>RevoScaleR package dependencies with graph visualization</span></a>
<p>Ensemble methods By ensemble methods, I (Bob, not Andrew) mean approaches that scatter points in parameter space and then make moves by inteprolating or extrapolating among subsets of them. Two prominent examples are: Ter Braak’s differential evolution   Goodman and Weare’s walkers There are extensions and computer implementations of these algorithms. For example, the Python […]</p>
<p>The post <a rel="nofollow" href="http://andrewgelman.com/2017/03/15/ensemble-methods-doomed-fail-high-dimensions/">Ensemble Methods are Doomed to Fail in High Dimensions</a> appeared first on <a rel="nofollow" href="http://andrewgelman.com/">Statistical Modeling, Causal Inference, and Social Science</a>.</p>
A new version of imager is now available on CRAN. This release brings a lot of new features, including a whole new set of functions dealing with pixel sets, better support for videos, new and faster reduction functions. The most significant change is the introduction of a “pixset” class, which deals with sets of pixels […]<img height="1" alt="" width="1" src="https://pixel.wp.com/b.gif?host=dahtah.wordpress.com&blog=28888192&post=412&subd=dahtah&ref=&feed=1" border="0">
<p>A solution in the R language to Euler Problem 16. What is the sum of the digits of the number 2^1000? This post provides a solution using basic r code. <a href="http://r.prevos.net/euler-problem-16-power-digit-sum/">Continue reading <span>→</span></a></p>
<p>The post <a rel="nofollow" href="http://r.prevos.net/euler-problem-16-power-digit-sum/">Euler Problem 16: Power Digit Sum</a> appeared first on <a rel="nofollow" href="http://r.prevos.net/">The Devil is in the Data</a>.</p>
I decided to submit a manuscript using only R with knitr, pandoc and make. Actually, it went quite well. Certainly, revisions of manuscript with complex figures did not require much of manual work once the R code for the figures has been created. The manuscript ended up as a Word file (for the sake of […]
There are 5 important basic data structures in R: vector, matrix, array, list and dataframe. They can be 1-dimensional (vector and list), 2-dimensional (matrix and data frame) or multidimensional (array). They also differ according to homogeneity of elements they can contain: while all elements contained in vector, matrix and array must be of the same […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Matrix exercises" rel="bookmark" href="http://r-exercises.com/2015/11/28/matrix-exercises/">Matrix exercises </a></li>
<li><a title="Array exercises" rel="bookmark" href="http://r-exercises.com/2015/12/01/array-exercises/">Array exercises </a></li>
<li><a title="Mode exercises" rel="bookmark" href="http://r-exercises.com/2016/02/14/mode-exercises/">Mode exercises </a></li>
<li><a href="http://r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
by Bob Horton, Senior Data Scientist, Microsoft The area under an ROC curve (AUC) is commonly used in machine learning to summarize the performance of a predictive model with a single value. But you might be surprised to learn that the AUC is directly connected to the Mann-Whitney U-Statistic, which is commonly used in a robust, non-parametric alternative to Student’s t-test. Here I’ll use ‘literate analysis’ to demonstrate this connection and illustrate how the two measures are related. In previous posts on ROC curves and AUC I described some simple ways to visualize and calculate these objects. Here is the...
Hi there - today we're launching a new machine learning course on Unsupervised Learning in R by Hank Roark!
Many times in machine learning, the goal is to find patterns in data without trying to make predictions. This is called unsupervised learning. ...
by Nathan Stephens Note: R Notebooks requires RStudio Version 1.0 or later I’m a big fan of the R console. During my early years with R, that’s all I had, so I got very comfortable with pasting my code into the console. Since then I’ve used many code editors for R, but they all followed […]
To post your R job on the next post Just visit this link and post a new R job to the R community. You can post a job for free (and there are also two “featured job” options available for extra exposure). Current R jobs Job seekers: please follow the links below to learn more and apply for your R job of interest: Featured Jobs Full-Time R Shiny Developer Summit Consulting LLC – Posted by jdieterle Washington District of Columbia, United States 14 Mar2017 Full-Time Quantitative Research Associate The Millburn Corporation – Posted by themillburncorporation New York New York, United States 6 Mar2017 Part-Time Big Data Discovery Automation in Digital Health (5-10 hours per week) MedStar Institutes for Innovation – Posted by Praxiteles Anywhere 1 Mar2017 Full-Time Applied Research Statistician/Methodologist Congressional Research Service – Posted by egonzalez@crs.loc.gov Washington District of Columbia, United States 28 Feb2017 Full-Time Post-doctoral researcher in single cell computational genomics Lister lab, The University of Western Australia – Posted by ryanlister Perth Western Australia, Australia 21 Feb2017 Freelance Senior Data Scientist – Freelance Data Science Talent – Posted by datasciencetalent Frankfurt am Main Hessen, Germany 15 Feb2017 More New Jobs Full-Time R Shiny Developer Summit Consulting LLC – Posted by jdieterle Washington District of Columbia, […]
A new maintenance release 0.3.2.9.1 of RcppEigen, still based on Eigen 3.2.9 is now on CRAN and is now going into Debian soon.
This update ensures that RcppEigen and the Matrix package agree on their #define statements for the CholMod / SuiteSparse l...
Ava Yang You may drop your weapons, this is not going to be about SAS vs R. If you work with a large amount of SAS legacy code, sasMap, an R package with a Shiny app, is for you. It … <a href="http://www.mango-solutions.com/wp/2017/03/sasmap-static-code-analysis-for-sas/">Continue reading <span>→</span></a>
Just pushed an updated version of my nhmrcData R package to Github. A quick summary of the changes: In response to feedback, added the packages required for vignette building as dependencies (Imports) – commit Added 8 new datasets with funding outcomes by gender for 2003 – 2013, created from a spreadsheet that I missed first … <a href="https://nsaunders.wordpress.com/2017/03/15/an-update-to-the-nhmrcdata-r-package/">Continue reading <span>An update to the nhmrcData R package</span></a>
Carson Sievert, the lead developer of the Plotly package for R will be hosting a workshop at https://plotcon.plot.ly/. Here’s an outline of the material he will be covering during the workshop. More details here. The workshop will be based on Carson’s Plotly for R book. Broad Topic Details A tale of 2 interfaces Converting ggplot2 […]
With the current focus on deep learning, neural networks are all the rage again. (Neural networks have been described for more than 60 years, but it wasn't until the the power of modern computing systems became available that they have been successfully applied to tasks like image recognition.) Neural networks are the fundamental predictive engine in deep learning systems, but it can be difficult to understand exactly what they do. To help with that, Brandon Rohrer has created this from-the-basics guide to how neural networks work: In R, you can train a simple neural network with just a single hidden...
[…]
Software testing describes several means to investigate program code regarding its quality. The underlying approaches provides means to handle errors once they occur. Furthermore, software testing also show techniques to reduce the probability of that. R is becoming a increasingly promiment programming language. This not only includes pure statistical settings but also machine learning, dashboards … <a href="http://www.rblog.uni-freiburg.de/2017/03/14/unit-testing-in-r/">Continue reading<span> &quot;Unit Testing in R&quot;</span></a>
Happy pi day!
For aaaagggggggeeeeeeesssssss now, I’ve been wittering on about how just publishing “open data” is okay insofar as it goes, but it’s often not that helpful, or at least, not as useful as it could be. Yes, it’s a Good Thing when a dataset is published in support of a report; but have you ever tried […]
Introduction to Data Visualization – Theory, R &amp; ggplot2 The topic of data visualization is very popular in the data science community. The market size for visualization products is valued at $4 Billion and is projected to reach $7 Billion by the end of 2022 according to Mordor Intelligence. While we have seen amazing advances […]
<p>Projects can be great for mastering data science, but you have to choose your projects carefully.</p>
<p>This article will give you tips on how to choose a project that's appropriate for your skill level (and tell you some pitfalls to watch out for).</p>
<p>The post <a rel="nofollow" href="http://sharpsightlabs.com/blog/choose-project-practice-data-science/">How to choose a project to practice data science</a> appeared first on <a rel="nofollow" href="http://sharpsightlabs.com/">SHARP SIGHT LABS</a>.</p>
FSelectorRcpp - Rcpp (free of Java/Weka) implementation of FSelector entropy-based feature selection algorithms with a sparse matrix support, has finally arrived on CRAN after a year of development. It is also equipped with a parallel backend.
Big th...
The Bureau of Labor Statistics projects that jobs for statisticians will grow by 34% between 2014 and 2024. However, according to the nation’s largest job web site, the number of companies looking for “statisticians” is actually in sharp decline. Those … <a href="http://r4stats.com/2017/03/13/jobs-for-data-science-up-7-fold-for-statistician-down-by-half/">Continue reading <span>→</span></a>
Intro and setup
This is a simple explanation of how to write a manuscript in RStudio. Writing a manuscript in RStudio is not ideal, but it has gotten better over time. It is now relatively easy to add citations to documents in RStudio.
**The goal...
If you’ve been doing exciting things in your organisation with the help of R and you’ve been thinking about submitting an abstract, now’s the time to put yours together! Based on the abstracts received so far, EARL Conferences this year … <a href="http://www.mango-solutions.com/wp/2017/03/earl-abstract-submissions-close-in-two-weeks/">Continue reading <span>→</span></a>
<p>My abstract was recently accepted for the 2017 ACS Data Users Conference, and on May 12 I will be giving a talk titled Mapping ACS Data in...</p>
<p>The post <a rel="nofollow" href="http://www.arilamstein.com/blog/2017/03/13/upcoming-talk-2017-acs-data-users-conference/">Upcoming Talk: 2017 ACS Data Users Conference</a> appeared first on <a rel="nofollow" href="http://www.arilamstein.com/">AriLamstein.com</a>.</p>
<p>We are happy to finally announce the first release of <a href="https://cran.r-project.org/package=mlrMBO"><strong>mlrMBO</strong> on cran</a> after a quite long development time.
For the theoretical background and a nearly complete overview of mlrMBOs capabilities you can check our <a href="https://arxiv.org/abs/1703.03373">paper on <strong>mlrMBO</strong> that we presubmitted to arxiv</a>.</p>
<p>The key features of <strong>mlrMBO</strong> are:</p>
<ul><li>Global optimization of expensive Black-Box functions.</li>
<li>Mulit-Criteria Optimization.</li>
<li>Parallelization through multi-point proposals.</li>
<li>Support for optimization over categorical variables using random forests as a surrogate.</li>
</ul><p>For examples covering different scenarios we have Vignettes that are also available as an <a href="https://mlr-org.github.io/mlrMBO/">online documentation</a>.
For <strong>mlr</strong> users <strong>mlrMBO</strong> is especially interesting for hyperparameter optimization.</p>
The MicrosoftML package introduced with Microsoft R Server 9.0 added several new functions for high-performance machine learning, including rxNeuralNet. Tomaz Kastrun recently applied rxNeuralNet to the MNIST database of handwritten digits to compare its performance with two other machine learning packages, h2o and xgboost. The results are summarized in the chart below: In addition to having the best performance (for both the CPU-enabled and GPU-enabled modes), rxNeuralNetwork did not have to sacrifice accuracy. In fact, rxNeuralNetwork had the best accuracy of the three algorithms: 97.8%, compared to 95.3% for h2o and 94.9% for xgBoost. The same training and validation set...
I discuss, with stories, why programming language choice matters and provide guidelines, along with an infographic of popular 2017 languages.
This Thursday Warsaw R Enthusiasts Group (in polish Spotkania Entuzjastów R - SER - cheese) celebrated it’s 3rd birthday! Check this post to find out what we have prepared for this special occasion.
Summary of three years of the group activity
...
<p>Tic Tac Toe might be a futile children’s game but it can also teach us about artificial intelligence. Tic Tac Toe, or Naughts and Crosses, is a zero-sum game with perfect information. Both players know exactly what the other did and when nobody … <a href="http://r.prevos.net/tic-tac-toe-simulation/">Continue reading <span>→</span></a></p>
<p>The post <a rel="nofollow" href="http://r.prevos.net/tic-tac-toe-simulation/">Tic Tac Toe Simulation — Random Moves</a> appeared first on <a rel="nofollow" href="http://r.prevos.net/">The Devil is in the Data</a>.</p>
Every system needs continuous improvement. Feedback, positive or negative, plays an important role in that improvement. Humans are fairly instinctive in interpreting the tone of the feedback. But, to teach a machine to understand the same, is highly complex. Various algorithms and tools are available today to automatically identify and categorize opinions of any textual feedback. The […]
testthat is a testing framework developed by Hadley Wickham, which makes unit testing easy for developers. Test scripts developed can be re-run after debugging or making changes to the functions without the hassle of developing the code for testing again. testthat has a heirarchical structure made up of expectations, tests and contexts. Visit this link […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Mode exercises" rel="bookmark" href="http://r-exercises.com/2016/02/14/mode-exercises/">Mode exercises </a></li>
<li><a title="Advanced Base Graphics Exercises" rel="bookmark" href="http://r-exercises.com/2016/09/23/advanced-base-graphics-exercises/">Advanced Base Graphics Exercises </a></li>
<li><a title="Complex Tables – Exercises" rel="bookmark" href="http://r-exercises.com/2016/04/26/complex-tables-exercises/">Complex Tables – Exercises </a></li>
<li><a href="http://r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
We have updated the errata for Practical Data Science with R to reflect that it is no longer worth the effort to use the Java version of SQLScrewdriver as described. We are very sorry for any confusion, trouble, or wasted effort bringing in Java software (something we are very familiar with, but forget not everybody … <a href="http://www.win-vector.com/blog/2017/03/practical-data-science-with-r-errata-update-java-sqlscrewdriver-replaced-by-r-procedures-and-article/">Continue reading <span>Practical Data Science with R errata update: Java SQLScrewdriver replaced by R procedures and article</span></a>
Mazama Science has just released the PWFSLSmoke package. Source code is available on GitHub. Here is the package description: Utilities for working with air quality monitoring data with a focus on small particulates (PM2.5) generated by wildfire smoke. Functions are provided for … <a href="http://mazamascience.com/WorkingWithData/?p=1755">  read more ... </a>
In our first post on the useR! 2016 survey we discussed the responses from the demographic section, finding in particular that:
The useR! 2016 attendees were predominately men, typically under 40, White/Caucasian and employed full-time.
Women attend...
Just heard the sad news that Peter Lee, British Bayesian and author of Bayesian Statistics: An Introduction, has passed away yesterday night. While I did not know him, I remember meeting him at a few conferences in the UK and spending an hilarious evening at the pub. When the book came out, I thought it […]
Plotly.js now supports candlestick charts as a chart-type and in this post we’ll highlight how to use this feature in R. We’ll use the quantmod package to retrieve data as well as generate some technical trading signals. Don’t forget to install the latest version of plotly from github: [crayon-58c48d1e6864e758973839/] Syntax The syntax is straightforward: [crayon-58c48d1e68658304936321/] […]
In the exercises below we cover some more material on multiple regression diagnostics in R. This includes added variable (partial-regression) plots, component+residual (partial-residual) plots, CERES plots, VIF values, tests for heteroscedasticity (nonconstant variance), tests for Normality, and a test for autocorrelation of residuals. These are perhaps not as common as what we have seen in […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Multiple Regression (Part 2) – Diagnostics" rel="bookmark" href="http://r-exercises.com/2017/01/26/multiple-regression-part-2-diagnostics/">Multiple Regression (Part 2) – Diagnostics </a></li>
<li><a title="Model Evaluation 2" rel="bookmark" href="http://r-exercises.com/2016/12/22/model-evaluation-2/">Model Evaluation 2 </a></li>
<li><a title="Multiple Regression (Part 1)" rel="bookmark" href="http://r-exercises.com/2017/01/15/multiple-regression-part-1/">Multiple Regression (Part 1) </a></li>
<li><a href="http://r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
Twas brillig, and the slithy toves Did gyre and gimble in the wabe: All mimsy were the borogoves, And the mome raths outgrabe. Jabberwocky by Lewis Carroll No analysis of cricket is complete, without determining how players would perform in the host country. Playing Test cricket on foreign pitches, in the host country, is a … <a href="https://gigadom.wordpress.com/2017/03/11/cricketr-flexes-new-muscles-the-final-analysis/">Continue reading <span>cricketr flexes new muscles: The final analysis</span></a><img height="1" alt="" width="1" src="https://pixel.wp.com/b.gif?host=gigadom.wordpress.com&blog=14647342&post=5335&subd=gigadom&ref=&feed=1" border="0">
The R qgraph Package: Using R to Visualize Complex Relationships Among Variables in a Large Dataset, Part One A Tutorial by D. M. Wiig, Professor of Political Science, Grand View University In my most recent tutorials I have discussed the use of the tabplot() package to visualize multivariate mixed data types in large datasets. This … <a href="https://dmwiig.net/2017/03/10/the-r-qgraph-package-using-r-to-visualize-complex-relationships-among-variables-in-a-large-dataset-part-one/">Continue reading <span>The R qgraph Package: Using R to Visualize Complex Relationships Among Variables in a Large Dataset, Part One</span> <span>→</span></a>
Polling data and other goodies ready for download
A new version, 0.3.0, of the nzelect R package is now available on CRAN.
historical polling data from 2002 to February 2017, sourced from Wikipedia
some small functions to help convert voting numb...
This is a brief (and likely obvious, for some folks) post on the dplyr::case_when() function. Part of my work-work is dealing with data from internet scans. When we’re performing a deeper inspection of a particular internet protocol or service we try to capture as much system and service metadata as possible. Sifting through said metadata... <a href="https://rud.is/b/2017/03/10/making-a-case-for-case_when/">Continue reading <span>→</span></a>
by Carlos Ortega (Editors note: A Spanish verison of the post follows the English text) In the first meeting we were 5, now we are consistently over 60. It was not difficult for us to start up the group of users of R of Madrid. Gregorio Serrano, Carlos Gil Bellosta, Pedro Concejero and I started […]
The Data Science Virtual Machine (DSVM) is a virtual machine image on the Azure Marketplace assembled for data scientists. The goal of the DSVM is provide a broad array of popular data-oriented tools in a single environment, and make data scientists and developers highly productive in their work. It's available for both Windows and Linux, and the Linux edition has just received a major update. (The Windows edition was also updated recently.) This latest update adds local standalone instances of Hadoop, YARN and Spark: ideal for prototyping code in your DSVM instance before deploying to a large cluster for production-level...
One of the core features of RDocumentation.org is its search functionality. From the start, we wanted to have a super simple search bar that finds what you are looking for, without a complex form asking for a package name, function name, versions or an...
<p>By Milind Paradkar “Prediction is very difficult, especially about the future”. Many of you must have come across this famous quote by Neils Bohr, a Danish physicist. Prediction is the theme of this blog post. In this post, we will cover the popular ARIMA forecasting model to predict returns on a stock and demonstrate a step-by-step process of...</p>
<p>The post <a rel="nofollow" href="https://www.quantinsti.com/blog/forecasting-stock-returns-using-arima-model/">Forecasting Stock Returns using ARIMA model</a> appeared first on <a rel="nofollow" href="https://www.quantinsti.com/"></a>.</p>
<p>Hierarchical clustering is a widely used and popular tool in statistics and data mining for grouping data into ‘clusters’ that exposes similarities or dissimilarities in the data. There are many approaches to hierarchical clustering as it is not possible to investigate all clustering possibilities. One set of approaches to hierarchical...</p>
<p>The post <a rel="nofollow" href="http://www.aaronschlegel.com/hierarchical-clustering-nearest-neighbors-algorithm-r/">Hierarchical Clustering Nearest Neighbors Algorithm in R</a> appeared first on <a rel="nofollow" href="http://www.aaronschlegel.com/">Aaron Schlegel</a>.</p>
R has many powerful libraries to handle spatial data, and the things that R can do with maps can only grow. This exercise tries to demonstrate a few basic functionalities of the ggmap package in R while dealing with raster images. The ggmap package can be used to access maps from the Google Maps API […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Working with Shapefiles in R Exercises" rel="bookmark" href="http://r-exercises.com/2017/01/03/working-with-shapefiles-in-r-exercises/">Working with Shapefiles in R Exercises </a></li>
<li><a title="Descriptive Analytics-Part 5: Data Visualisation (Spatial data)" rel="bookmark" href="http://r-exercises.com/2016/12/26/descriptive-analytics-part-5-data-visualisation-spatial/">Descriptive Analytics-Part 5: Data Visualisation (Spatial data) </a></li>
<li><a title="Lattice exercises – part 2" rel="bookmark" href="http://r-exercises.com/2016/05/24/lattice-exercises-part-2/">Lattice exercises – part 2 </a></li>
<li><a href="http://r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
(… on my blog, that is.) For a long time, my correlation heatmap with ggplot2 was the most viewed post on this blog. It still leads the overall top list, but by far the most searched and visited post nowadays is this one about dplyr (followed by it’s sibling about plyr). I fully support this, […]
This post concludes our mini-series of Win-Vector open source R packages. We end with WVPlots, a collection of ready-made ggplot2 plots we find handy. Please read on for list of some of the Win-Vector LLC open-source R packages that we are pleased to share. For each package we have prepared a short introduction, so you … <a href="http://www.win-vector.com/blog/2017/03/some-win-vector-r-packages/">Continue reading <span>Some Win-Vector R packages</span></a>
This animation by geographer James Cheshire shows something at once simple and profound: the founding and growth of the cities of the world since the dawn of civilization. Dr Cheshire created the animation using R and the rworldmap package, using data from this Nature dataset. The complete R code is provided in the blog post linked below, and you can easily tweak the code to change the projection of the map. Check out the complete post below to see two other versions of the animation: one focusing on the birth of civilization in the Old World, and another depicting the...
When data science success stories meet practical R tutorials, the result is a one of a kind event for data analysts with a business background. On November 8 and 9, the [R] Kenntnis-Tage 2017 will be the platform for exchanging everyday challenges and solutions when working with the programming language R. Diverse program and inspiring … <a href="https://blog.eoda.de/2017/03/09/r-kenntnis-tage-2017-save-the-date-save-your-ticket-save-your-talk/"><span>„[R] Kenntnis-Tage 2017: Save the date, save your ticket, save your talk“ </span>weiterlesen</a>
Achieving a good score on a Kaggle competition is typically quite difficult. This blog post outlines 7 tips for beginners to improve their ranking on the Kaggle leaderboards. For this purpose, I also created a Kernel for the Kaggle bike sharing comp...
The survey-package from Thomas Lumley is a great toolkit when analyzing complex samples. It provides svyglm(), to fit generalised linear models to data from a complex survey… <span><a rel="bookmark" href="https://strengejacke.wordpress.com/2017/03/09/negative-binomial-regression-for-complex-samples-surveys-rstats/">Read more <span>&quot;Negative Binomial Regression for Complex Samples (Surveys) #rstats&quot;</span></a></span><img height="1" alt="" width="1" src="https://pixel.wp.com/b.gif?host=strengejacke.wordpress.com&blog=10592659&post=1257&subd=strengejacke&ref=&feed=1" border="0">
<p>Solution in the R language to project Euler Problem 15. The problem asks to calculate the number of pathways through a 20 by 20 grid. <a href="http://r.prevos.net/euler-problem-15-lattice-paths/">Continue reading <span>→</span></a></p>
<p>The post <a rel="nofollow" href="http://r.prevos.net/euler-problem-15-lattice-paths/">Euler Problem 15: Pathways Through a Lattice</a> appeared first on <a rel="nofollow" href="http://r.prevos.net/">The Devil is in the Data</a>.</p>
A collaborator posed an interesting R question to me today. She wanted to do several regressions using different outcomes, with models being computed on different strata defined by a combination of experimental design variables. She then just wanted to extract the p-values for the slopes for each of the models, and then filter the strata […]
Do you like R? Information about Australian biomedical research funding outcomes? Tidy data? If the answers to those questions are “yes”, then you may also like nhmrcData, a collection of datasets derived from funding statistics provided by the Australian National Health &amp; Medical Research Council. It’s also my first R package (more correctly, R data … <a href="https://nsaunders.wordpress.com/2017/03/09/the-nhmrcdata-package-nhmrc-funding-outcomes-data-made-tidy/">Continue reading <span>The nhmrcData package: NHMRC funding outcomes data made tidy</span></a>
by Le Zhang (Data Scientist, Microsoft) and Graham Williams (Director of Data Science, Microsoft) Employee retention has been and will continue to be one of the biggest challenges of a company. While classical tactics such as promotion, competitive perks, etc. are practiced as ways to retain employees, it is now a hot trend to rely on machine learning technology to discover behavioral patterns with which a company can understand their employees better. Employee demographic data has been studied and used for analyzing employees’ inclination towards leaving a company. Nowadays, with the proliferation of the Internet, employees’ behavior can better be...
Update: Slides click here. Stream processing with R in AWS by Gergely Daróczi Abstract: R...
by Jonathan Regenstein In this post, I’ll describe a Shiny app to support the Emerging Markets ETF Country Exposure analysis developed in a previous post I have done some additional work and updated the analysis to include five ETFs in the app, whereas we originally imported data on 1 ETF. The new notebook is available […]
On Thursday, March 23rd, I will give the third lecture of the PhD course on advanced tools for econometrics, on model selection and variable selection, where we will focus on ridge and lasso regressions . Slides are available online.
The first part w...
  Corinne Riddell posted this on Twitter. It’s one version of multiple time series that she tried out, one for each USA state. It’s not the finished article, but is really nice for its combination of that recognisable shape (I … <a href="https://robertgrantstats.wordpress.com/2017/03/08/dataviz-of-the-week-8317/">Continue reading <span>→</span></a><img height="1" alt="" width="1" src="https://pixel.wp.com/b.gif?host=robertgrantstats.wordpress.com&blog=36132336&post=4741&subd=robertgrantstats&ref=&feed=1" border="0">
<p>In database theory, a view is a table that actively depend on a data frame and on a query on it, so that if you change something in the data frame, the view will change accordingly. To have something similar to a view in R here we propose the ‘%>>%’ operator, friendly to use and coherent with dplyr structure</p>
<p>The post <a rel="nofollow" href="http://www.quantide.com/building-views-with-r/">Building views with R</a> appeared first on <a rel="nofollow" href="http://www.quantide.com/">Quantide - R training &amp; consulting</a>.</p>
Last October I gave a 3-day masterclass on “Forecasting with R” in Eindhoven, Netherlands. There is a follow-up event planned for Tuesday 18 April 2017. It is particularly designed for people who attended the 3-day class, but if anyone else wants to attend they would be welcome. Please register here if you want to attend. The preliminary […]
<p>A few days ago, I was inspired by a set of photographs of Earth from space, at night. </p>
<p>The images are amazing, so I decided to try to replicate them using R.</p>
<p>The post <a rel="nofollow" href="http://sharpsightlabs.com/blog/mapping-france-night/">Mapping “France at night” with the new sf package</a> appeared first on <a rel="nofollow" href="http://sharpsightlabs.com/">SHARP SIGHT LABS</a>.</p>
In case you missed them, here are some articles from February of particular interest to R users. Public policy researchers use R to predict neighbourhoods in US cities subject to gentrification. The ggraph package provides a grammar-of-graphics framework for visualizing directed and undirected graphs. Facebook has open-sourced the &quot;prophet&quot; package they use for forecasting time series at scale. A preview of features coming soon to R Tools for Visual Studio 1.0. On the differences between using Excel and R for data analysis. A data scientist suggests a &quot;Gloom Index&quot; for identifying the most depressing songs by the band Radiohead. Catterplots...
“The best thing to do with missing values is not to have any” (Gertrude Mary Cox) Unfortunately, missing values are ubiquitous and occur for plenty of reasons. One solution is single imputation which consists in replacing missing entries with plausible values. It leads to a complete dataset that can be analyzed by any statistical methods. Based on dimensionality reduction […]
sigr is a simple R package that conveniently formats a few statistics and their significance tests. This allows the analyst to use the correct test no matter what modeling package or procedure they use. Model Example Let’s take as our example the following linear relation between x and y: library('sigr') set.seed(353525) d &lt;- data.frame(x= rnorm(5)) … <a href="http://www.win-vector.com/blog/2017/03/sigr-simple-significance-reporting/">Continue reading <span>sigr: Simple Significance Reporting</span></a>
  The starting point of this post is a simple question: can we use R to analyze punk bands ? And, as a result: what can we learn from applying data analytics methods to punk music ?   Whether we like it or not “punk rock is arguably the most <a href="http://r-blog.salvaggio.net/?p=521">Read More ...</a>
The RVowpalWabbit package update is the third of four upgrades requested by CRAN, following RcppSMC 0.1.5 and RcppGSL 0.3.2.
This package being somewhat raw, the change was simple and just meant converting the single entry point to using Rcpp Attribu...
Previous research in data mining has devised numerous different algorithms for learning tasks. While an individual algorithm might already work decently, one can usually obtain a better predictive by combining several. This approach is referred to as ensemble learning. Common examples include random forests, boosting and AdaBost in particular. Our slide deck is positioned at … <a href="http://www.rblog.uni-freiburg.de/2017/03/07/ensemble-learning-in-r/">Continue reading<span> &quot;Ensemble Learning in R&quot;</span></a>
This weekend I released version 0.3.0 of the Icarus package to CRAN. Icarus provides tools to help perform calibration on margins, which is a very important method in sampling. One of these days I’ll write a blog post explaining calibration on margins! In the meantime if you want to learn more, you can read our … <a href="http://nc233.com/2017/03/announcing-icarus-v0-3/">Continue reading <span>Announcing Icarus v0.3</span></a>
Last week I showed how to build a deep neural network with h2o and rsparkling. As we could see there, it is not trivial to optimize the hyper-parameters for modeling. Hyper-parameter tuning with grid search allows us to test different combinations of h...
R 3.3.3 (codename “Another Canoe”) was released yesterday You can get the latest binaries version from here. (or the .tar.gz source code from here). The full list of bug fixes and new features is provided below. A quick summary by David Smith: R 3.3.3 fixes an issue related to attempting to use download.file on sites that automatically redirect from http … <a href="https://www.r-statistics.com/2017/03/r-3-3-3-is-released/">Continue reading<span> &quot;R 3.3.3 is released!&quot;</span></a>
Remember me, remember me, but ah! forget my fate (Dido’s Lament, Henry Purcell) A Voronoi diagram divides a plane based on a set of original points. Each polygon, or Voronoi cell, contains an original point and all that are closer to that point than any other. This is a nice example of a Voronoi tesselation. You … <a href="https://fronkonstin.com/2017/03/07/frankenstein/">Continue reading <span>Frankenstein</span> <span>→</span></a>
<p>Two weeks ago I had the honor of giving a talk about my open source work at the CDC. Last week I gave the talk...</p>
<p>The post <a rel="nofollow" href="http://www.arilamstein.com/blog/2017/03/06/slides-talk-cdc/">Slides from my Talk at the CDC</a> appeared first on <a rel="nofollow" href="http://www.arilamstein.com/">AriLamstein.com</a>.</p>
I recently stumbled upon a great dataset. It’s the first to provide comprehensive data for world city sizes as far back as 3700BC. The authors (Meredith Reba, Femke Reitsma &amp; Karen Seto) write: How were cities distributed globally in the past? How many people lived in these cities? How did cities influence their local and regional […]
When describing a sample, researchers in my field often show proportions of specific characteristics as description. For instance, proportion of female persons, proportion of persons with higher… <span><a rel="bookmark" href="https://strengejacke.wordpress.com/2017/03/06/descriptive-summary-proportions-of-values-in-a-vector-rstats/">Read more <span>&quot;Descriptive summary: Proportions of values in a vector #rstats&quot;</span></a></span>
<p>Create Air Travel Route Maps that look like airline route maps you find in aeroplane magazines using ggplot. Spatially visualise your travel diary. <a href="http://r.prevos.net/create-air-travel-route-maps/">Continue reading <span>→</span></a></p>
<p>The post <a rel="nofollow" href="http://r.prevos.net/create-air-travel-route-maps/">Create Air Travel Route Maps in ggplot: A Visual Travel Diary</a> appeared first on <a rel="nofollow" href="http://r.prevos.net/">The Devil is in the Data</a>.</p>
In this screencast we demonstrate how to easily and effectively step-debug magrittr/dplyr pipelines in R using wrapr and replyr. Some of the big issues in trying to debug magrittr/dplyr pipelines include: Pipelines being large expressions that are hard to line-step into. Visibility of intermediate results. Localizing operations (in time and code position) in the presence … <a href="http://www.win-vector.com/blog/2017/03/step-debugging-magrittrdplyr-pipelines-in-r-with-wrapr-and-replyr/">Continue reading <span>Step-Debugging magrittr/dplyr Pipelines in R with wrapr and replyr</span></a>
The R core group announced today the release of R 3.3.3 (code-name: &quot;Another Canoe&quot;). As the wrap-up release of the R 3.3 series, this update mainly contains minor bug-fixes. (Bigger changes are planned for R 3.4.0, expected in mid-April.) Binaries for the Windows version are already up on the CRAN master site, and binaries for all platforms will appear on your local CRAN mirror within the next couple of days. R 3.3.3 fixes an issue related to attempting to use download.file on sites that automatically redirect from http to https: now, R will re-attempt to download the secure link rather...
I am participating in a session at userR 2017 this coming July focusing on discovering and learning about R packages. How do R users find packages that meet their needs? Can we make this process easier? As somebody who is relatively new to the R world ...
Short version: if RStudio on Windows 7 crashes when viewing vignettes in HTML format, it may be because those packages specify knitr::rmarkdown as the vignette engine, instead of knitr::knitr and you’re using rmarkdown v1. Longer version with details – read on. update: looks like this issue relates to the installed version of rmarkdown (1.3 in my … <a href="https://nsaunders.wordpress.com/2017/03/06/html-vignettes-crashing-your-rstudio-this-may-be-the-reason/">Continue reading <span>HTML vignettes crashing your RStudio? This may be the reason</span></a>
RcppSMC provides Rcpp-based bindings to R for them Sequential Monte Carlo Template Classes (SMCTC) by Adam Johansen described in his JSS article.
RcppSMC release 0.1.5 is one of several maintenance releases this weekend to fix an issue flagged by CRA...
Mark Sellors Head of Data Engineering Turn a shiny application into a tablet or desktop app Since we first demoed it at our really successful trip to Strata London last year, a few people have asked us how we made … <a href="http://www.mango-solutions.com/wp/2017/03/shiny-based-tablet-or-desktop-app/">Continue reading <span>→</span></a>
replyr is an R package that contains extensions, adaptions, and work-arounds to make remote R dplyr data sources (including big data systems such as Spark) behave more like local data. This allows the analyst to more easily develop and debug procedures that simultaneously work on a variety of data services (in-memory data.frame, SQLite, PostgreSQL, and … <a href="http://www.win-vector.com/blog/2017/03/replyr-get-a-grip-on-big-data-in-r/">Continue reading <span>replyr: Get a Grip on Big Data in R</span></a>
The RcppGSL package provides an interface from R to the GNU GSL using the Rcpp package.
RcppGSL release 0.3.2 is one of several maintenance releases this weekend to fix an issue flagged by CRAN: calls to .Call() sometimes used package= where PACKAGE=...
- Facebook recently released a API package allowing access to its
forecasting model called
prophet.
According to the underling post:
It's not your traditional ARIMA-style time series model. It's closer in spirit to a Bayesian-...
A new update of my sjPlot-package was just released on CRAN. Thanks to @c_schwemmer, it’s now possible to easily integrate the HTML-ouput of all table-functions into knitr-rmarkdown-documents.… <span><a rel="bookmark" href="https://strengejacke.wordpress.com/2017/03/05/direct-integration-of-sjplot-tables-in-knitr-rmarkdown-documents-rstats/">Read more <span>&quot;Direct integration of sjPlot-tables in knitr-rmarkdown-documents #rstats&quot;</span></a></span>
While the previous posts on [crayon-58bb8f9870904801159552-i/] function contained two parts: theory of ETS and then the implementation – this post will cover only the latter. We won’t discuss anything new, we will mainly look into several parameters that the exponential smoothing function has and what they allow us to do. We start with initialisation of […]
  We have 2 legends, Biggie Smalls and Nas. At the 1:00 mark, Nasty Nas receives a Nasty Rubdown. Pretty sure this was the inspiration for Boosie’s Wipe Me Down. I made a .gif version using a pen, a tablet, and command line ‘ImageMagick‘. But the resulting FPS was slow, so I decided to try out Jeroen’s R package, magick , to […]
I’m excited to announce the release of tidyquant version 0.4.0!!! The release is yet again sizable. It includes integration with the PerformanceAnalytics package, which now enables full financial analyses to be performed without ever leaving the “t...
Introduction In this post I create RMarkdown templates for end-to-end analysis of IPL T20 matches, that are available on Cricsheet based on my R package yorkr.  With these templates you can convert all IPL data which is in yaml format to R dataframes. Further I create data and the necessary templates for analyzing IPL matches, teams … <a href="https://gigadom.wordpress.com/2017/03/04/analysis-of-ipl-t20-matches-with-yorkr-templates/">Continue reading <span>Analysis of IPL T20 matches with yorkr templates</span></a>
At the OZCOTS (Australian Conference on Teaching Statistics) in late 2016 George Cobb gave a great talk entitled “Ask not what data science can do for the Humanities. Ask rather, what the Humanities can do for data science.”
“George Cobb of M...
@mrshrbrmstr hinted that she would like this post by @RickWicklin translated into R for her stats class. She’s quite capable of cranking out the translation of the core component of that post — a call to chisq.test — but she wanted to show the entire post (in R) and really didn’t have time (she’s teaching... <a href="https://rud.is/b/2017/03/03/candy-coated-confidence-intervals/">Continue reading <span>→</span></a>
Hi R enthusiasts, we've released episode 12 of our DataChats video series.
In this episode, we interview David Stoffer. David is a Professor of Statistics at the University of Pittsburgh. He is member of the editorial board of the Journal of Time Ser...
<p>The iterated principal factor method is an extension of the principal factor method that seeks improved estimates of the communality. As seen in the previous post on the principal factor method, initial estimates of or are found to obtain from which the factors are computed. In the iterated principal factor...</p>
<p>The post <a rel="nofollow" href="http://www.aaronschlegel.com/iterated-principal-factor-method-factor-analysis-r/">Iterated Principal Factor Method of Factor Analysis with R</a> appeared first on <a rel="nofollow" href="http://www.aaronschlegel.com/">Aaron Schlegel</a>.</p>
by Sean Lopp If you spend time with an excellent programmer, one thing that immediately jumps out is how quickly she can write code. It often appears to be magic, the number of keystrokes simply can’t equal the number of characters on the screen. The secret: it doesn’t! Most programmers use a series of tricks […]
While R's base graphics library is almost limitlessly flexible when it comes to create static graphics and data visualizations, new Web-based technologies like d3 and webgl open up new horizons in high-resolution, rescalable and interactive charts. Graphics built with these libraries can easily be embedded in a webpage, can be dynamically resized while maintaining readable fonts and clear lines, and can include interactive features like hover-over data tips or movable components. And thanks to htmlwidgets for R, you can easily create a variety of such charts using R data and functions, explore them in an interactive R session, and include...
This article is on preparing data for modeling in R using vtreat. Our example Suppose we wish to work with some data. Our example task is to train a classification model for credit approval using the ranger implementation of the random forests method. We will take our data from John Ross Quinlan's re-processed &quot;credit approval&quot; … <a href="http://www.win-vector.com/blog/2017/03/vtreat-prepare-data/">Continue reading <span>vtreat: prepare data</span></a>
So it has been a while since my previous post on some data taken from the UNHCR database. This post we’ll bring it back to the topic of infectious diseases (check out my other posts on the SIR model and MRSA typing). For this post, as similar to previous ones, I give a guide through the … <a href="https://eugejjoh.wordpress.com/2017/03/03/who-tuberculosis-data-ggplot2/">Continue reading<span> &quot;WHO Tuberculosis Data &amp; ggplot2&quot;</span></a>
I’ve written several posts about the Adobe Analytics Analytics (née Clickstream) Data Feed (links: 1,2,3) over the past several years. The Analytics Data Feed is an invaluable tool for moving beyond aggregate-level reporting information about your c...
MongoDB is a NoSQL database program which uses JSON-like documents with schemas. It is free and open-source cross-platform database. MongoDB, top NoSQL database engine in use today, could be a good data storage alternative when analyzing large volume data. To use MongoDB with R, first, we have to download and install MongoDB Next, start MongoDB. […]<ul></ul><strong><p>Related Post</p></strong><ol><li><a title="Permanent Link toFinding Optimal Number of Clusters" rel="bookmark" href="https://datascienceplus.com/finding-optimal-number-of-clusters/">Finding Optimal Number of Clusters</a></li><li><a title="Permanent Link toAnalyzing the first Presidential Debate" rel="bookmark" href="https://datascienceplus.com/analyzing-the-first-presidential-debate/">Analyzing the first Presidential Debate</a></li><li><a title="Permanent Link toGoodReads: Machine Learning (Part 3)" rel="bookmark" href="https://datascienceplus.com/goodreads-machine-learning-part-3/">GoodReads: Machine Learning (Part 3)</a></li><li><a title="Permanent Link toMachine Learning for Drug Adverse Event Discovery" rel="bookmark" href="https://datascienceplus.com/machine-learning-for-drug-adverse-event-discovery/">Machine Learning for Drug Adverse Event Discovery</a></li><li><a title="Permanent Link toGoodReads: Exploratory data analysis and sentiment analysis (Part 2)" rel="bookmark" href="https://datascienceplus.com/exploratory-data-analysis-and-sentiment-analysis/">GoodReads: Exploratory data analysis and sentiment analysis (Part 2)</a></li></ol>
The which() function will return the position of the elements(i.e., row number/column number/array index) in a logical vector which are TRUE.
The acquisition of data in json structure presented in part 1 clearly showed the functioning of the client-server connection and the possibility to collect the data of interest. However, the json output appeares as a set of raw data in a json string that needs to be structured and stored in a suitable form for … <a href="http://r-posts.com/web-data-acquisition-the-structure-of-rcurl-request-part-2/">Continue reading <span>Web data acquisition: the structure of RCurl request (Part 2)</span></a>
Preliminars
Usually (mainly at work) I made a chart and when I present it nobody cares
about the style, if the chart comes from an excel spreadsheet, paint or
intercative chart, or colors, labels, font, or things I like to care.
That’s sad f...
I haven't been admitted to hospital many times in my life, but every time the only thing I really cared about was: when am I going to get out? It's also a question that weighs heavily on hospital managers: by knowing ahead of time how long each patient's stay is likely to be, they can better manage facilities and staff, and know whether the hospital is likely to reach maximum capacity in the near future. To help hospital administrators better predict how long patients are likely to stay, Microsoft has published the Predicting Length of Stay in Hospitals solution on...
After the short presentation here, let’s start using R seriously, i.e. with every day data. Being a frequent flyer, I often search the web to book flights and organise my trip. Being a data analyst, it’s natural to look at price data with interest, especially the most convenient, most expensive and “average” flights. Being a … <a href="http://r-posts.com/web-data-acquisition-understanding-rcurl-from-the-command-line-part-1/">Continue reading <span>Web data acquisition: understanding RCurl from the command line (Part 1)</span></a>
If you make the error which I did, you will try to use the data (say, “pckgdata”) from another package (say, “pckg”) naively like this: This will result in an error: Here is the solution (thanks to the comments from stackexchange:
What is OpenML?
Conducting research openly and reproducibly is becoming the gold standard in academic research. Practicing open and reproducible research, however, is hard. OpenML.org (Open Machine Learning) is an online platform that aims at making t...
To post your R job on the next post Just visit this link and post a new R job to the R community. You can post a job for free (and there are also two “featured job” options available for extra exposure). Current R jobs Job seekers: please follow the links below to learn more and apply for your R job of interest: Featured Jobs Part-Time Big Data Discovery Automation in Digital Health (5-10 hours per week) MedStar Institutes for Innovation – Posted by Praxiteles Anywhere 1 Mar2017 Full-Time Applied Research Statistician/Methodologist Congressional Research Service – Posted by egonzalez@crs.loc.gov Washington District of Columbia, United States 28 Feb2017 Full-Time Post-doctoral researcher in single cell computational genomics Lister lab, The University of Western Australia – Posted by ryanlister Perth Western Australia, Australia 21 Feb2017 Freelance Senior Data Scientist – Freelance Data Science Talent – Posted by datasciencetalent Frankfurt am Main Hessen, Germany 15 Feb2017 Full-Time R and C++ programmer NIMBLE project at UC Berkeley – Posted by pdevalpine Berkeley California, United States 1 Feb2017 More New Jobs Full-Time (Senior) Data Scientist @ München, Bayern, Germany Stylight GmbH – Posted by StylightGmbH München Bayern, Germany 2 Mar2017 Part-Time Big Data Discovery Automation in Digital Health (5-10 hours per week) MedStar Institutes […]
The match() function returns a vector of the position of first occurrence of the vector1 in vector2. If the element of the vector1 does not exist in vector2, NA is returned.
This article is on writing sweet R code using the wrapr package. The problem Consider the following R puzzle. You are given: a data.frame, the name of a column that you wish to find missing values (NA) in, and the name of a column to land the result. For instance: d &lt;- data.frame(x = c(1, … <a href="http://www.win-vector.com/blog/2017/03/wrapr-for-sweet-r-code/">Continue reading <span>wrapr: for sweet R code</span></a>
While representation of women and minorities at last year's useR! conference was the highest it's ever been, there is always room for more diversity. To encourage more underrepresented individuals to attend, the useR! committee has taken several steps, including asking attendees to adhere to a supportive code of conduct and by providing childcare at the conference venue in Brussels. The R Forwards taskforce is also offering diversity scholarships to under-represented individuals (such as, but not limited to, LGBTQ people, women, ethnic minorities, or those with disabilities) who might not otherwise be able to attend. If you qualify and think a...
R’s model formula infrastructure was discussed in my previous post. Despite the elegance and convenience of the formula method, there are some aspects that are limiting. Limitations to Extensibility The model formula interface does have some limitations: It can be kludgy with many operations on many variables (e.g., log transforming 50 variables via a formula […]
<p>Euler Problem 14 looks at the Collatz Conjecture. These playful sequences, named after German mathematician Lothar Collatz (1910–1990), cause mathematicians a lot of headaches. This video introduces the problem much better than I can describe it. Euler Problem 14 Definition The following iterative … <a href="http://r.prevos.net/euler-problem-14-collatz-sequence/">Continue reading <span>→</span></a></p>
<p>The post <a rel="nofollow" href="http://r.prevos.net/euler-problem-14-collatz-sequence/">Euler Problem 14: Longest Collatz Sequence</a> appeared first on <a rel="nofollow" href="http://r.prevos.net/">The Devil is in the Data</a>.</p>
When there is increased social activity, trash cans can get full quicker. On the contrary, during very cold weather, trash cans can take one or a couple of more days to get full. Therefore, knowing when trash cans are full is important to pick them up right away rather than waiting for a specific day […]<ul><li><a href="https://www.youtube.com/watch?v=LVL-CP7NDYk">PostgreSQL and shiny with a dynamic leaflet map</a></li></ul><strong><p>Related Post</p></strong><ol><li><a title="Permanent Link toVisualizing Streaming Data And Alert Notification with Shiny" rel="bookmark" href="https://datascienceplus.com/visualizing-streaming-data-with-shiny/">Visualizing Streaming Data And Alert Notification with Shiny</a></li><li><a title="Permanent Link toMetro Systems Over Time: Part 3" rel="bookmark" href="https://datascienceplus.com/metro-systems-over-time-part-3/">Metro Systems Over Time: Part 3</a></li><li><a title="Permanent Link toMetro Systems Over Time: Part 2" rel="bookmark" href="https://datascienceplus.com/metro-systems-over-time-part-2/">Metro Systems Over Time: Part 2</a></li><li><a title="Permanent Link toMetro Systems Over Time: Part 1" rel="bookmark" href="https://datascienceplus.com/metro-systems-over-time-part-1/">Metro Systems Over Time: Part 1</a></li><li><a title="Permanent Link toOutlier App: An Interactive Visualization of Outlier Algorithms" rel="bookmark" href="https://datascienceplus.com/outlier-app-an-interactive-visualization-of-outlier-algorithms/">Outlier App: An Interactive Visualization of Outlier Algorithms</a></li></ol>
<p>Great news for the MilanoR community: we are launching R-Lab, a monthly R project of co-working with R on real data science projects.<br>
Either if you are an R expert, a beginner, or you just curious, you are welcome to join us! The first event will be on March 14th, in Mikamai, Milano. We will introduce the R-Lab project and then go to the theme of the day: &quot;RStudio addins: a shortcut to your favourite functionalities&quot; </p>
<p>The post <a rel="nofollow" href="http://www.milanor.net/blog/r-lab-hands-on-r-code-milan/">R-Lab #1: hands on R code! | Milan, March 14th</a> appeared first on <a rel="nofollow" href="http://www.milanor.net/blog">MilanoR</a>.</p>
In this tutorials sequence, we are going to see three tricks to do the following in a Shiny app: Add Next and Previous buttons to navigate in a tabBox Build a non completely collapsible sidebar to keep the icon visible on collapse Add button on a datatable output to delete/modify/ do an action on a […]<img height="1" alt="" width="1" src="https://pixel.wp.com/b.gif?host=antoineguillot.wordpress.com&blog=113378294&post=1190&subd=antoineguillot&ref=&feed=1" border="0">
One of the most popular posts on this blog has been my attempt to create Kaplan-Meier plots with an aligned table of persons-at-risk below it under the ggplot paradigm. That post was last updated 3 years ago. In the interim, Chris Dardis has built upon these attempts to create a much more stable and feature-rich […]<img height="1" alt="" width="1" src="https://pixel.wp.com/b.gif?host=statbandit.wordpress.com&blog=6850228&post=576&subd=statbandit&ref=&feed=1" border="0">
<p>Today in class, I taught some fundamentals of API consumption in R. As it was aligned to some Microsoft content, we first used HaveIBeenPwned.com‘s API and then played with Microsoft Cognitive Services‘ Text Analytics API. This brief post overviews what you need to get started, and how you can chain consecutive calls to these APIs … </p>
<p><a href="http://itsalocke.com/microsoft-cognitive-services-text-analytics-api/">Continue reading<span> &quot;R Quick tip: Microsoft Cognitive Services’ Text Analytics API&quot;</span></a></p>
<p>The post <a rel="nofollow" href="http://itsalocke.com/microsoft-cognitive-services-text-analytics-api/">R Quick tip: Microsoft Cognitive Services’ Text Analytics API</a> appeared first on <a rel="nofollow" href="http://itsalocke.com/">Locke Data</a>.</p>
When I saw this title among the CRC Press novelties, I immediately ordered it as I though it fairly exciting. Now that I have gone through the book, the excitement has died. Maybe faster than need be as I read it while being stuck in a soulless Schipol airport and missing the only ice-climbing opportunity […]
I work in an ecosystem that uses Outlook for e-mail. When I have to communicate results with collaborators one of the most frequent tasks I face is to take a tabular output in R (either a summary table or some sort of tabular output) and send it to collaborators in Outlook. One method is certainly […]
I’ve just updated another section of The Popularity of Data Science Software. It is reproduced below to save you the trouble of reading the entire article. If your organization is looking for training in the R language, you might consider my … <a href="http://r4stats.com/2017/02/28/r-passes-sas/">Continue reading <span>→</span></a>
It’s the second time I write a post about the blog aggregator R-bloggers, probably because I’m all about R blogs now that I have one. My husband says my posts are so meta. My first post was about R blogs names, in this one I shall focus on the last...
Explore the intersection of concepts like dimension reduction, clustering, data preparation, PCA, HDBSCAN, k-NN, SOM, deep learning...and Carl Sagan!
If you've lived in a big city, you're likely familiar with the impact of gentrification. For longtime residents of a neighbourhood, it can represent a decline in the culture and vibrancy of your community; for recent or prospective residents, it can represent a financial opportunity in rising home prices. For those that live in a gentrifying neighbourhood, it's one of those you-know-it-when-you-see-it things, but for economists and urban planners it can be difficult to identify. So a team of analysts at Urban Spatial to build a longitudinal model based on census tract data to quantify gentrification. Their motivation? Neighborhoods change...
<p>After you master the basics of R and ggplot2, you need to learn the little details.</p>
<p>A great example of this is plot annotation.</p>
<p>Adding little details like plot annotations help you communicate more clearly and &quot;tell a story&quot; with your plots.</p>
<p>The post <a rel="nofollow" href="http://sharpsightlabs.com/blog/simple-annotate-plot-ggplot2/">How to annotate a plot in ggplot2</a> appeared first on <a rel="nofollow" href="http://sharpsightlabs.com/">SHARP SIGHT LABS</a>.</p>
In what is now a roughly annual event, the forecast package has been updated on CRAN with a new version, this time 8.0. A few of the more important new features are described below. Check residuals A common task when building forecasting models is to check that the residuals satisfy some assumptions (that they are […]
A graph, a collection of nodes connected by edges, is just data. Whether it's a social network (where nodes are people, and edges are friend relationships), or a decision tree (where nodes are branch criteria or values, and edges decisions), the nature of the graph is easily represented in a data object. It might be represented as a matrix (where rows and columns are nodes, and elements mark whether an edge between them is present) or as a data frame (where each row is an edge, with columns representing the pair of connected nodes). The trick comes in how you...
ggedit is a package that lets users interactively edit ggplot layer and theme aesthetics. In a previous post we showed you how to use it in a collaborative workflow using standard R scripts. More importantly, we highlighted that ggedit outputs to the user, after editing, updated: gg plots, layers, scales and themes as both self-contained … <a href="http://r-posts.com/ggedit-0-1-1-shiny-module-to-interactvely-edit-ggplots-within-shiny-applications/">Continue reading <span>ggedit 0.1.1: Shiny module to interactvely edit ggplots within Shiny applications</span></a>
<p>Last Thursday I had the honor of giving a talk about my open source work to the CDC’s R Users Group. A big thank you...</p>
<p>The post <a rel="nofollow" href="http://www.arilamstein.com/blog/2017/02/27/live-presentation-talk-cdc/">Live Presentation: My Talk at the CDC</a> appeared first on <a rel="nofollow" href="http://www.arilamstein.com/">AriLamstein.com</a>.</p>
Early in my science career I believed that any good piece of software included a graphical user interface (GUI).
That was many years ago, and during that time I delved deep into the art of Tcl/Tk programming;
using the tcltk package to create GUI’s ...
<p>A big part of why I’ve launched Locke Data is so that I can give back more to my communities. I want to give more time and more support to others. One of the first steps is doing some activities that give financial support to community groups without damaging my startup cashflow! Community R workshops … </p>
<p><a href="http://itsalocke.com/community-r-workshops/">Continue reading<span> &quot;Announcing community R workshops&quot;</span></a></p>
<p>The post <a rel="nofollow" href="http://itsalocke.com/community-r-workshops/">Announcing community R workshops</a> appeared first on <a rel="nofollow" href="http://itsalocke.com/">Locke Data</a>.</p>
Last week, I introduced how to run machine learning applications on Spark from within R, using the sparklyr package. This week, I am showing how to build feed-forward deep neural networks or multilayer perceptrons. The models in this example are built ...
A few months ago we launched R Course Finder, an online directory that helps you to find the right R course quickly. With so many R courses available online, we thought it was a good idea to offer a tool that helps people to compare these courses, before they decide where to spend their valuable […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Plotly : Advanced plots and features" rel="bookmark" href="http://r-exercises.com/2017/01/19/plotly-advanced-plots-and-features/">Plotly : Advanced plots and features </a></li>
<li><a title="List exercises" rel="bookmark" href="http://r-exercises.com/2015/12/31/list-exercises/">List exercises </a></li>
<li><a title="Data table exercises: keys and subsetting" rel="bookmark" href="http://r-exercises.com/2016/03/21/data-table-exercises-keys-and-subsetting/">Data table exercises: keys and subsetting </a></li>
<li><a href="http://r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
Make your R simulation models 20 times faster
R can be frustratingly slow if you use its loops. However, you can speed
it up significantly (e.g. 20 times!) using the Rcpp package. That
could turn a day long simulation into an hour long simulation.
I ...
Reinforcement learning has gained considerable traction as it mines real experiences with the help of trial-and-error learning to model decision-making. Thus, this approach attempts to imitate the fundamental method used by humans of learning optimal behavior without the requirement of an explicit model of the environment. In contrast to many other approaches from the domain … <a href="http://www.rblog.uni-freiburg.de/2017/02/26/reinforcement-learning-in-r/">Continue reading<span> &quot;Reinforcement Learning in R&quot;</span></a>
I recently read an interesting thread on unexpected behavior in R when creating a list of functions in a loop or iteration. The issue is solved, but I am going to take the liberty to try and re-state and slow down the discussion of the problem (and fix) for clarity. The issue is: are references … <a href="http://www.win-vector.com/blog/2017/02/iteration-and-closures-in-r/">Continue reading <span>Iteration and closures in R</span></a>
I’m pleased to announce the inaugural release of my hrbrthemes (0.1.0) package on CRAN The primary goal of said package is to provide opinionated typographical and other aesthetic defaults for ggplot2 charts. Two core themes are included: theme_ipsum() – an Arial Narrow-based theme theme_ipsum_rc() – a Roboto Condensed-based theme. The Roboto Condensed Google Font comes... <a href="https://rud.is/b/2017/02/26/hrbrthemes-0-1-0-is-now-on-cran/">Continue reading <span>→</span></a>
Why Sweden?
In the chaos of the last month or so of United States of America governance, one item that grabbed my attention was the claim by President Trump that 80% of appeals decided by the Ninth Circuit Court of Appeal are overturned by the Supreme Court of the...
Logistic regression predicts the probability of the outcome being true. In this exercise, we will implement a logistic regression and apply it to two different data sets. The file ex2data1.txt contains the dataset for the first part of the exercise and ex2data2.txt is data that we will use in the second part of the exercise. […]<ul></ul><strong><p>Related Post</p></strong><ol><li><a title="Permanent Link toAnalytical and Numerical Solutions to Linear Regression Problems" rel="bookmark" href="https://datascienceplus.com/analytical-and-numerical-solutions-to-linear-regression-problems/">Analytical and Numerical Solutions to Linear Regression Problems</a></li><li><a title="Permanent Link toHow to create a loop to run multiple regression models" rel="bookmark" href="https://datascienceplus.com/how-to-create-a-loop-to-run-multiple-regression-models/">How to create a loop to run multiple regression models</a></li><li><a title="Permanent Link toRegression model with auto correlated errors – Part 3, some astrology" rel="bookmark" href="https://datascienceplus.com/regression-model-with-auto-correlated-errors-part-3-some-astrology/">Regression model with auto correlated errors – Part 3, some astrology</a></li><li><a title="Permanent Link toRegression model with auto correlated errors – Part 2, the models" rel="bookmark" href="https://datascienceplus.com/regression-model-with-auto-correlated-errors-part-2-the-models/">Regression model with auto correlated errors – Part 2, the models</a></li><li><a title="Permanent Link toRegression model with auto correlated errors – Part 1, the data" rel="bookmark" href="https://datascienceplus.com/fitting-a-simple-regression-model-with-auto-correlated-errors-an-astrological-example-part-1-the-data/">Regression model with auto correlated errors – Part 1, the data</a></li></ol>
Introduction In this post I create yorkr templates for International T20 matches that are available on Cricsheet. With these templates you can convert all T20 data which is in yaml format to R dataframes. Further I create data and the necessary templates for analyzing. All of these templates can be accessed from Github at yorkrT20Template. The … <a href="https://gigadom.wordpress.com/2017/02/25/analysis-of-international-t20-matches-with-yorkr-templates/">Continue reading <span>Analysis of International T20 matches with yorkr templates</span></a>
Facebook is a famously data-driven organization, and an important goal in any data science activity is forecasting. Now, Facebook has released Prophet, an open-source package for R and Python that implements the time-series methodology that Facebook uses in production for forecasting at scale. Prophet has a very simple interface: you pass it a column of dates and a column of numbers, and is produces a forecast for the time series, like this: The black dots are the number of views of Peyton Manning's Wikipedia page through the end of 2016; the blue region is a forecast (with uncertainty interval) into...
Make Power Fun (Again?)
Brandon LeBeau
University of Iowa
Overview
(G)LMMs
Power
simglm package
Shiny Demo - Broken!
Linear Mixed Model (LMM)
Power
Power is the ability to statistically detect a true effect (i.e. non-ze...
<p>Contributed by Sharan Naribole. He is currently undertaking the part-time online bootcamp organized by NYC Data Science Academy (Dec 2016- April 2017). This blog is based […]</p>
<p>The post <a rel="nofollow" href="http://blog.nycdatascience.com/student-works/h-1b-visa-petitions-exploratory-data-analysis/">H-1B Visa Petitions Exploratory Data Analysis</a> appeared first on <a rel="nofollow" href="http://blog.nycdatascience.com/">NYC Data Science Academy Blog</a>.</p>
by Joseph Rickert In a recent post, I highlighted several new packages that arrived on CRAN in January that provided R users with access to data. In this post, I present additional selections for interesting January packages, organized into the categories Miscellaneous, Machine Learning, Statistics and Utilities. Miscellaneous rcss v1.2: Provides functions for Solving Control […]
Categorical variables in regression models are often included by dummy variables. In R, this is done with factor variables with treatment coding. Typically, the difference and significance of each category are tested against a preselected ...
I am absolutely thrilled to announce that ggraph has finally been released
on CRAN. ggraph is my most ambitious package to date and its very early genesis has been described in a prior post.
If any mention of ggraph is completely new to you, then in s...
After more than a year in preview R Tools for Visual Studio, the open-source extension to the Visual Studio IDE for R programming, is nearing its official release. RTVS Release Candidate 1 is now available for download, giving you the opportunity to try out the new features ahead of the official announcement. We'll cover the features in detail with the general availability release of RTVS 1.0, but in summary the new features include: Remote Execution: type R code in your local RTVS instance, but have the computations performed on a remote R server. You can also switch between local and...
A simply worded riddle this week on The Riddler, about four ropes having non-uniform and unknown burning rates, the only constraint being they all burn completely in one hour. With the help of a lighter (or even a single match), what are the possible units of time one can measure by burning them? While I […]
I’ve been threatening to do a series on “data science community security” for a while and had cause to issue this inaugural post today. It all started with this: Hey #rstats folks: don't do this. Srsly. Don't do this. Pls. Will blog why. Just don't do this. https://t.co/qkem5ruEBi— boB Rudis (@hrbrmstr) February 23, 2017 Let... <a href="https://rud.is/b/2017/02/23/on-watering-holes-trust-defensible-systems-and-data-science-community-security/">Continue reading <span>→</span></a>
In my ongoing quest to track The Popularity of Data Analysis Software, I’ve finally decided to change the title to use the newer term “data science”. The 2017 version of Gartner’s Magic Quadrant for Data Science Platforms was just published, … <a href="http://r4stats.com/2017/02/23/gartners-2017-take-on-data-science-software/">Continue reading <span>→</span></a>
<p>As discussed in a previous post on the principal component method of factor analysis, the term in the estimated covariance matrix , , was excluded and we proceeded directly to factoring and . The principal factor method of factor analysis (also called the principal axis method) finds an initial estimate...</p>
<p>The post <a rel="nofollow" href="http://www.aaronschlegel.com/factor-analysis-principal-factor-method-r/">Factor Analysis with the Principal Factor Method and R</a> appeared first on <a rel="nofollow" href="http://www.aaronschlegel.com/">Aaron Schlegel</a>.</p>
Earlier this week, I spent a day chatting to folk from the House of Commons Library as a part of a bit of temporary day-a-week-or-so bit of work I’m doing with the Parliamentary Digital Service. During one of the conversations on matters loosely geodata-related with Carl Baker, Carl mentioned an NHS Digital data set describing […]
Guest Post by Enjie (Jane) LI I have been using bdvis package (version 0.2.9) to visualize the iNaturalist records of RAScals project (http://www.inaturalist.org/projects/rascals). Initially, the mapgrid function in the bdvis version 0.2.9 was written to map the number of records, number of species and completeness in a 1-degree cell grid (~111km x 111km resolution). I applied this […]
<p>Euler Problem 13 asks to add one hundred numbers with fifty digits. This seems like a simple problem where it not that most computers are not designed to deal with numbers with a lot of integers. For example:   When asking … <a href="http://r.prevos.net/euler-problem-13/">Continue reading <span>→</span></a></p>
<p>The post <a rel="nofollow" href="http://r.prevos.net/euler-problem-13/">Euler Problem 13: Large Sum of 1000 Digits</a> appeared first on <a rel="nofollow" href="http://r.prevos.net/">The Devil is in the Data</a>.</p>
If you're an Excel user (or any other spreadsheet, really), adapting to learn R can be hard. As this blog post by Gordon Shotwell explains, one of the reasons is that simple things can be harder to do in R than Excel. But it's worth perservering, because complex things can be easier. While Excel (ahem) excels at things like arithmetic and tabulations (and some complex things too, like presentation), R's programmatic focus introduces concepts like data structures, iteration, and functions. Once you've made the investment in learning R, these abstractions make reducing complex tasks into discrete steps possible, and automating...
<p>One of the nifty things about using R is that you can use it for many different purposes and even other languages! If you want to use Python in your knitr docs or the newish RStudio R notebook functionality, you might encounter some fiddliness getting all the moving parts running on Windows. This is a … </p>
<p><a href="http://itsalocke.com/quick-tip-knitr-python-windows-setup-checklist/">Continue reading<span> &quot;Quick tip: knitr Python Windows setup checklist&quot;</span></a></p>
<p>The post <a rel="nofollow" href="http://itsalocke.com/quick-tip-knitr-python-windows-setup-checklist/">Quick tip: knitr Python Windows setup checklist</a> appeared first on <a rel="nofollow" href="http://itsalocke.com/">Locke Data</a>.</p>
by Garrett Grolemund Would you like to teach people to use R? If so, I would like to jump-start your efforts. I’m one half of RStudio’s education team, and I’ve taught thousands of people to use R, usually in face-to-face workshops. Over time, I’ve come to appreciate that teaching R in a short workshop is […]
Leaflet 1.1.0 is now available on CRAN! The Leaflet package is a tidy wrapper for the Leaflet.js mapping library, and makes it incredibly easy to generate interactive maps based on spatial data you have in R. This release was nearly a year in the making, and includes many important new features. Easily add textual labels on […]
Yesterday, I had the pleasure to give a talk at the 8th Hamburg R User-Group meeting. I talked about data wrangling and data transformation, and how the… <span><a rel="bookmark" href="https://strengejacke.wordpress.com/2017/02/22/data-transformation-in-r-the-tidyverse-approach-of-organizing-data-rstats/">Read more <span>&quot;Data Transformation in R: The #Tidyverse-Approach of Organizing Data #rstats&quot;</span></a></span>
<p>Raccoon is a free web-book about Statistical Models with R. This chapter tackles two Anova special cases: Unbalanced Anova and Nested Anova . </p>
<p>The post <a rel="nofollow" href="http://www.quantide.com/raccoon-ch-2-5-unbalanced-nested-anova/">Raccoon | Ch 2.5 – Unbalanced and Nested Anova</a> appeared first on <a rel="nofollow" href="http://www.quantide.com/">Quantide - R training &amp; consulting</a>.</p>
Radiohead is known for having some fairly maudlin songs, but of all of their tracks, which is the most depressing? Data scientist and R enthusiast Charlie Thompson ranked all of their tracks according to a &quot;gloom index&quot;, and created the following chart of gloominess for each of the band's nine studio albums. (Click for the interactive version, crated with with highcharter package for R, which allows you to explore individual tracks.) If you're familiar with the albums, this looks pretty reasonable. Radiohead's debut, &quot;Honey Pablo&quot; was fairly poppy musically, but contained some pretty dark lyrics (especially in the break-out hit,...
EDIT: Actually there is a much easier way to do so, by just adding the code below to the UI: tags$script(HTML(“$(‘body’).addClass(‘sidebar-mini’);”)) Thanks at @_pvictorr for suggesting it! Original post: In this tutorials sequence, we are going to see three tricks to do the following in a Shiny app: Add Next and Previous buttons to navigate […]
I am going to write about an insidious statistical, data analysis, and presentation fallacy I call “the zero bug” and the habits you need to cultivate to avoid it. The zero bug Here is the zero bug in a nutshell: common data aggregation tools often can not “count to zero” from examples, and this causes … <a href="http://www.win-vector.com/blog/2017/02/the-zero-bug/">Continue reading <span>The Zero Bug</span></a>
Announcing: DataCamp for the classroom, a new free plan for Academics.
We want to support every student that wants to learn Data Science. That is why, as of today, professors/teachers/TA’s/… can give their students 6 months of FREE access to the f...
Have you ever tried to return a NULL with the ifelse() function? This function is a simple vectorized workflow for conditional statements. However, one can’t just return a NULL value as a result of this evaluation. Check a tricky workaround solution...
<p>In this post, I want to walk you through the logic of building a map, step by step ...</p>
<p>The post <a rel="nofollow" href="http://sharpsightlabs.com/blog/map-talent-competitiveness/">How to make a global map in R, step by step</a> appeared first on <a rel="nofollow" href="http://sharpsightlabs.com/">SHARP SIGHT LABS</a>.</p>
This government is committed to introducing posthumous pardons for people with certain historical sexual offence convictions who would be innocent of any crime now (British Government Spokesperson, September 2016) Last September, the British government announced its intention to pursue what has become known as the Alan Turing law, offering exoneration to the tens of thousands … <a href="https://fronkonstin.com/2017/02/21/who-is-alan-turing/">Continue reading <span>Who is Alan Turing?</span> <span>→</span></a>
Current research in finance and the social sciences utilizes sentiment analysis to understand human decisions in response to textual materials. While sentiment analysis has received great traction lately, the available tools are not yet living up to the needs of researchers. Especially R has not yet capabilities that most research desires. Our package “SentimentAnalysis” performs … <a href="http://www.rblog.uni-freiburg.de/2017/02/21/sentiment-analysis-in-r/">Continue reading<span> &quot;Sentiment Analysis in R&quot;</span></a>
Once thought of as the ‘little programming language that could’, R has fundamentally transformed the way data scientists and organisations use their data. It gives businesses the power to leverage big data and develop predictive models that enable action, not … <a href="http://www.mango-solutions.com/wp/2017/02/yes-you-can-run-r-in-the-cloud-securely/">Continue reading <span>→</span></a>
As I discovered (!) the Annals of Applied Statistics in my mailbox just prior to taking the local train to Dauphine for the first time in 2017 (!), I started reading it on the way, but did not get any further than the first discussion paper by Pengsheng Ji and Jiashun Jin on coauthorship and […]
I am pleased to announce my package strcode, a package that should make structuring code easier. You can install it from GitHub, a CRAN submission is planned at a later stage.
During my Monday morning ritual of avoiding work,  I found this publication that is written in R, for people who use R – R Weekly.  The authors do a pretty awesome job of aggregating useful, entertaining, and informative content about what’s happening surrounding our favorite programming language.  Check it out, give the authors some love on GitHub, and leave … <a href="https://realdataweb.wordpress.com/2017/02/20/r-weekly/">Continue reading <span>R Weekly</span></a>
Recently, I did a session at local user group in Ljubljana, Slovenija, where I introduced the new algorithms that are available with MicrosoftML package for Microsoft R Server 9.0.3. For dataset, I have used two from (still currently) running sessions from Kaggle. In the last part, I did image detection and prediction of MNIST dataset … <a href="https://tomaztsql.wordpress.com/2017/02/20/rxneuralnet-vs-xgboost-vs-h2o/">Continue reading <span>rxNeuralNet vs. xgBoost vs. H2O</span></a>
Principal component methods such as PCA (principal component analysis) or MCA (multiple correspondence analysis) can be used as a pre-processing step before clustering. But principal component methods give also a framework to visualize data. Thus, the clustering methods can be represented onto the map provided by the principal component method. In the figure below, the hierarchical tree […]
Data science enhances people’s decision making. Doctors and researchers are making critical decisions every day. Therefore, it is absolutely necessary for those people to have some basic knowledge of data science. This series aims to help people that are around medical field to enhance their data science skills. We will work with a health related […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Data Science for Doctors – Part 2 : Descriptive Statistics" rel="bookmark" href="http://r-exercises.com/2017/02/05/data-science-for-doctors-part-2-descriptive-statistics/">Data Science for Doctors – Part 2 : Descriptive Statistics </a></li>
<li><a title="Data Science for Doctors – Part 1 : Data Display" rel="bookmark" href="http://r-exercises.com/2017/01/29/data-science-for-doctors-part-1-data-display/">Data Science for Doctors – Part 1 : Data Display </a></li>
<li><a title="Data Science for Doctors – Part 3 : Distributions" rel="bookmark" href="http://r-exercises.com/2017/02/13/data-science-for-doctors-part-3-distributions/">Data Science for Doctors – Part 3 : Distributions </a></li>
<li><a href="http://r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
This week, we return to our “Getting Started With R” series. Today we are going to look at some tools from the “dplyr” package. Hadley Wickham, the creator of dplyr, calls it “A Grammar of Data Manipulation.” filter() Use filter() for […]
<p>Time series data is an important area of analysis, especially if you do a lot of web analytics. To be able to analyse time series effectively, it helps to understand how the interaction between general seasonality in activity and the underlying trend. The interactions between trend and seasonality are typically classified as either additive or … </p>
<p><a href="http://itsalocke.com/is-my-time-series-additive-or-multiplicative/">Continue reading<span> &quot;Is my time series additive or multiplicative?&quot;</span></a></p>
<p>The post <a rel="nofollow" href="http://itsalocke.com/is-my-time-series-additive-or-multiplicative/">Is my time series additive or multiplicative?</a> appeared first on <a rel="nofollow" href="http://itsalocke.com/">Locke Data</a>.</p>
future 1.3.0 is available on CRAN. With futures, it is easy to write R code once, which the user can choose to evaluate in parallel using whatever resources s/he has available, e.g. a local machine, a set of local machines, a set of remote machines, a...
A few weeks ago padr was introduced on CRAN, allowing you to quickly get datetime data ready for analysis. If you have missed this, see the introduction blog or vignette(&quot;padr&quot;) for a general introduction. In v0.2.0 the pad function is extended with a group argument, which makes your life a lot easier when you want to do padding within groups.
SatRday
From the 16th to the 18th of February, satRday was held in the City of Cape Town in South Africa. The programme kicked off with two days of workshops and then the conference on Saturday. The workshops were divided up into three large sections:...
This week I want to show how to run machine learning applications on a Spark cluster. I am using the sparklyr package, which provides a handy interface to access Apache Spark functionalities via R.
The question I want to address with machine learning ...
You might have heard of the “bar bar plots” movement whose goal is to prevent using (let’s use ggplot2 language shall we) geom_bar when you could have used e.g. geom_boxplot or geom_histogram because the bar plot hides the variability of the dist...
Connect widgets &amp; plots In the seventh part of our journey we are ready to connect more of the widgets we created before with our k-means plot in order to totally control its output. Of cousre we will also reform the plot itself properly in order to make it a real k-means plot. Read the […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Building Shiny App exercises part 6" rel="bookmark" href="http://r-exercises.com/2017/02/07/building-shiny-app-exercises-part-6/">Building Shiny App exercises part 6 </a></li>
<li><a title="Building Shiny App exercises part 1" rel="bookmark" href="http://r-exercises.com/2016/12/12/building-shiny-app-exercises-part-1/">Building Shiny App exercises part 1 </a></li>
<li><a title="Building Shiny App exercises part 2" rel="bookmark" href="http://r-exercises.com/2016/12/18/building-shiny-app-exercises-part-2/">Building Shiny App exercises part 2 </a></li>
<li><a href="http://r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
Background
When we started the Rcpp Gallery in late 2012, a few of us spent the next four weeks diligently
writing articles ensuring that at least one new article would be posted per day. Two early articles
covered the then-budding support for C++11. ...
This exercise focuses on linear regression with both analytical (normal equation) and numerical (gradient descent) methods. We will start with linear regression with one variable. From this part of the exercise, we will create plots that help to visualize how gradient descent gets the coefficient of the predictor and the intercept. In the second part, […]<ul></ul><strong><p>Related Post</p></strong><ol><li><a title="Permanent Link toHow to create a loop to run multiple regression models" rel="bookmark" href="https://datascienceplus.com/how-to-create-a-loop-to-run-multiple-regression-models/">How to create a loop to run multiple regression models</a></li><li><a title="Permanent Link toRegression model with auto correlated errors – Part 3, some astrology" rel="bookmark" href="https://datascienceplus.com/regression-model-with-auto-correlated-errors-part-3-some-astrology/">Regression model with auto correlated errors – Part 3, some astrology</a></li><li><a title="Permanent Link toRegression model with auto correlated errors – Part 2, the models" rel="bookmark" href="https://datascienceplus.com/regression-model-with-auto-correlated-errors-part-2-the-models/">Regression model with auto correlated errors – Part 2, the models</a></li><li><a title="Permanent Link toRegression model with auto correlated errors – Part 1, the data" rel="bookmark" href="https://datascienceplus.com/fitting-a-simple-regression-model-with-auto-correlated-errors-an-astrological-example-part-1-the-data/">Regression model with auto correlated errors – Part 1, the data</a></li><li><a title="Permanent Link toLinear Regression from Scratch in R" rel="bookmark" href="https://datascienceplus.com/linear-regression-from-scratch-in-r/">Linear Regression from Scratch in R</a></li></ol>
Armadillo is very versatile C++ library for linear algebra, brough
to R via the RcppArmadillo package. It
has proven to be very useful and popular, and is (as of February 2017) used by well over 300 CRAN
packages as indicated by the reverse depends / ...
The kind folks over at @RStudio gave a nod to my recently CRAN-released epidata package in their January data package roundup and I thought it might be useful to give it one more showcase using the recent CRAN update to ggalt and the new hrbrthemes (github-only for now) packages. Labor force participation rate The U.S.... <a href="https://rud.is/b/2017/02/18/putting-it-all-together/">Continue reading <span>→</span></a>
In these terrible times, we R people have more important subjects to debate/care about than ggplot2 vs. base R graphics (isn’t even worth discussing anyway, ggplot2 is clearly the best alternative). Or so I thought until I saw CatterPlots trending on...
My books – Cricket Analytics with cricketr – Beaten by sheer pace!: Cricket analytics with yorkr are now available on Amazon in both Paperback and Kindle versions The cricketr and yorkr packages are written in R, and both are available in CRAN. The books contain details on how to use these R packages to analyze … <a href="https://gigadom.wordpress.com/2017/02/18/cricketr-and-yorkr-books-paperback-now-in-amazon/">Continue reading <span>cricketr and yorkr books – Paperback now in Amazon</span></a>
<p>Recently I have been starting to use dplyr for handling my data in R. It makes everything a lot smoother! My previous workflow – running an SQL query, storing the results as CSV, loading it in RStudio – is now history. With dplyr you can directly query data from many different databases in a very … <a href="http://blog.haunschmid.name/accessing-mssql-server-r-rsqlserver-dplyr/">Continue reading <span>Accessing MSSQL Server with R (RSQLServer with dplyr)</span></a></p>
<p>The post <a rel="nofollow" href="http://blog.haunschmid.name/accessing-mssql-server-r-rsqlserver-dplyr/">Accessing MSSQL Server with R (RSQLServer with dplyr)</a> appeared first on <a rel="nofollow" href="http://blog.haunschmid.name/">verenahaunschmid</a>.</p>
A new release 0.3.1 of the RPushbullet package, following the recent 0.3.0 release is now on CRAN. RPushbullet is interfacing the neat Pushbullet service for inter-device messaging, communication, and more. It lets you easily send alerts like the on...
Introduction A very useful machine learning method which, for its simplicity, is incredibly successful in many real world applications is the Naive Bayes classifier. I am currently taking a machine learning module as part of my data science college course and this week’s practical work involved a classification problem using the Naive Bayes method. I… <a href="https://sw23993.wordpress.com/2017/02/17/naive-bayes-classification-in-r-part-1/">Continue reading <span>Naive Bayes Classification in R (Part 1)</span> <span>→</span></a>
Moving around sparse matrices of text data - the limitations of as.h2o
This post is the resolution of a challenge I first wrote about in late 2016, moving large sparse data from an R environment onto an H2O cluster for machine learning purposes. In th...
Authors: Stefan Feuerriegel and Joscha Märkle-Huß R is widely taught in business courses and, hence, known by most data scientists with business background. However, when it comes to optimization and Operations Research, many other languages are used. Especially for optimization, solutions range from Microsoft Excel solvers to modeling environments such as Matlab and GAMS. Most … <a href="http://www.rblog.uni-freiburg.de/2017/02/17/optimization-and-operations-research-in-r/">Continue reading<span> &quot;Optimization and Operations Research in R&quot;</span></a>
Exploratory multivariate data analysis is studied and has been taught in a “French-way” for a long time in France. You can enroll in a MOOC (completely free) on Exploratory Multivariate Data Analysis. The MOOC will start the 27th of February. This MOOC focuses on 4 essential and basic methods, those with the largest potential in terms of applications: […]
by Joseph Rickert As forecast, the number of R packages hosted on CRAN exceeded 10,000 in January. Dirk Eddelbuettel, who tracks what’s happening on CRAN with his CRANberries site, called hurricaneexposure the 10,000th package in a tweet on January 27th. hurricaneexposure was one of two hundred and six new packages that arrived on CRAN in […]
As a devotee of Tufte, I'm generally against chartjunk. Graphical elements that obscure interpretation of the data occasionally have a useful role to play, but more often than not that role is to entertain the expense of enlightenment, or worse, to actively mislead. So it's with mixed feelings that I refer you to catterplots, an R package by David Gibbs to create scatterplots using outlines of cats as the symbols. But hey, it's the Friday before a long weekend, so here's a poorly annotated catterplot of households with dogs vs households with cats in the 48 continental US states (plus...
Following on from Part 1 of this two-part post, I would now like to explain how the Naive Bayes classifier works before applying it to a classification problem involving breast cancer data. The dataset is sourced from Matjaz Zwitter and Milan Soklic from the Institute of Oncology, University Medical Center in Ljubljana, Slovenia (formerly Yugoslavia) and… <a href="https://sw23993.wordpress.com/2017/02/17/naive-bayes-classification-in-r-part-2/">Continue reading <span>Naive Bayes Classification in R (Part 2)</span> <span>→</span></a>
This post shows how to perform PCA with R and the package FactoMineR. If you want to learn more on methods such as PCA, you can enroll in this MOOC (everyting is free): MOOC on Exploratory Multivariate Data Analysis Dataset Here is a wine dataset, with 10 wines and 27 sensory attributes (like sweetness, bitterness, […]
Some friends and I got into a conversation about rookies in the NFL and how much their salaries were. We eventually started guessing how much more the first overall pick makes compared to, Mr. Irrelevant, the last pick of the NFL draft. It’s a pretty steep drop from number 1 to number 256 (7 rounds <a rel="nofollow" href="http://jessepiburn.com/2017/02/the-steep-slide-of-nfl-draft-salaries/"><span>Read more about The Steep Slide of NFL Draft Salaries</span>[…]</a>
Still about this allocation riddle of the past week, and still with my confusion about the phrasing of the puzzle, when looking at a probabilistic interpretation of the game, rather than for a given adversary’s y, the problem turns out to search for the maximum of where the Y’s are Binomial B(100,p). Given those p’s, […]
Tomaž Kaštrun is developer and data analyst working for the IT group at SPAR (the ubiquitous European chain of convenience stores) in Austria. He blogs regularly about using Microsoft R and SQL Server for data analyis, and recently published a roundup of his articles about R and SQL Server. Follow the link below for the an overview of the articles, which cover: using Microsoft R in enterprise environments, an introduction to SQL Server R Services, how to install R packages in SQL Server R Services, a tutorial on using SQL Server R Services to analyze sales data, using R to...
<p>In the first post on factor analysis, we examined computing the estimated covariance matrix of the rootstock data and proceeded to find two factors that fit most of the variance of the data using the principal component method. However, the variables in the data are not on the same scale...</p>
<p>The post <a rel="nofollow" href="http://www.aaronschlegel.com/factor-analysis-principal-component-method-part-two/">Factor Analysis with the Principal Component Method Part Two</a> appeared first on <a rel="nofollow" href="http://www.aaronschlegel.com/">Aaron Schlegel</a>.</p>
My experience and some advices about the process - Many people, including my university colleagues and friends, have asked
me about the process of writing a book and self publishing it in Amazon.
You can find the details about the...
Should I learn R or Python for data science? I am asked this question regularly, both online and in person. There is a simple answer: it doesn’t matter. There are pros and cons to both which have been written about extensively so I reinvent the wheel by making a list here (do a quick search […]
We the moody Gucci, Louis and Pucci men Escada, Prada The chopper it got the Uzi lens Bird’s-eye view The birds I knew, flip birds Bird gangs, it was birds I flew Say you use the base #rstats lm() command lm(data=dat_foo[,c('y','x1','x2')],y ~ x1 + x2 + x1:x2) I want to be able to map the […]
A beautiful graph tells more than a lenghtly speach!! So it is crucial to improve the graphs obtained by Principal Component Analysis or (Multiple) Correspondence Analysis. The package Factoshiny allows us to easily improve these graphs interactively. The package Factoshiny makes interacting with R and FactoMineR simpler, thus facilitating selection and addition of supplementary information. The main advantage […]
by Nic Crane After hearing about tidytext from colleagues who went to the RStudio conference last month, I decided to try it out. If you want to try out tidy text mining for yourself, check out the official website at … <a href="http://www.mango-solutions.com/wp/2017/02/tidy-text-mining-of-david-bowies-lyrics/">Continue reading <span>→</span></a>
RDSTK is a very versatile package. It includes functions to help you convert IP address to geo locations and derive statistics from them. It also allows you to input a body of text and convert it into sentiments. This is a continuation from the last exercise RDSTK 2 We are going to use the function […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Data Hacking with RDSTK 2" rel="bookmark" href="http://r-exercises.com/2017/02/11/rdstk2/">Data Hacking with RDSTK 2 </a></li>
<li><a title="Data Hacking with RDSTK (part 1)" rel="bookmark" href="http://r-exercises.com/2017/01/31/rdstk1/">Data Hacking with RDSTK (part 1) </a></li>
<li><a title="Descriptive Analytics-Part 4 : Data Manipulation" rel="bookmark" href="http://r-exercises.com/2016/11/21/descriptive-analytics-part-4-data-manipulation/">Descriptive Analytics-Part 4 : Data Manipulation </a></li>
<li><a href="http://r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
Introduction of Parameterized dplyr expression
The usefullness of any small function you write will eventually be judged upon its ability to be generically applied across any arbitrary data. As I explored a blog post from Dec 2016, I became a lot more...
This is the third post in my series of ggraph introductions. The first post introduced
the concept of layouts, which is simply a specification on how nodes should be
placed on a plane. The second
explained how to draw nodes using the geom_node_*() fam...
<p>Raccoon is a free web-book about Statistical Models with R. It's the collection of twenty years of notes, exercises and concepts working with statistics and R. This is the fifth section of the second chapter, about unbalanced Anova with one obs dropped.</p>
<p>The post <a rel="nofollow" href="http://www.quantide.com/raccoon-ch-2-5-unbalanced-anova-one-obs-dropped/">Raccoon | Ch 2.5 – Unbalanced Anova with one obs dropped</a> appeared first on <a rel="nofollow" href="http://www.quantide.com/">Quantide - R training &amp; consulting</a>.</p>
Things to know about Lorne in the state of Victoria, Australia. It’s situated on the Great Ocean Road, a major visitor attraction and a great way to see the scenic coastline of the region It’s home to a number of life science conferences including Lorne Genome 2017 This week’s project then: use R to analyse … <a href="https://nsaunders.wordpress.com/2017/02/16/twitter-coverage-of-the-lorne-genome-conference-2017/">Continue reading <span>Twitter Coverage of the Lorne Genome Conference 2017</span></a>
I’m uncontainably excited to report that the ggplot2 extension package ggalt is now on CRAN. The absolute best part of this package is the R community members who contributed suggestions and new geoms, stats, annotations and integration features. This release would not be possible without the PRs from: Ben Bolker Ben Marwick Jan Schulz Carson... <a href="https://rud.is/b/2017/02/15/ggalt-0-4-0-now-on-cran/">Continue reading <span>→</span></a>
Writing reversible jump MCMC samplers in NIMBLE Writing reversible jump MCMC samplers in NIMBLE Introduction Reversible jump Markov chain Monte Carlo (RJMCMC) is a powerful method for drawing posterior samples over multiple models by jumping between models as part of the sampling. For a simple example that I’ll use below, think about a regression model […]
R 3.3.3 (codename: &quot;Another Canoe&quot;) is scheduled for release on March 6. This is the &quot;wrap-up&quot; release of the R 3.3 series, which means it will include minor bug fixes and improvements, but eschew major new features. Major changes are coming though, with the subsequent release of R 3.4.0. While the NEWS file announcing updates in 3.4.0 is still subject to change, it indicates several major changes aimed at improving the performance of R in various ways: A &quot;just-in-time&quot; JIT compiler will be included. While the core R packages have been byte-compiled since 2011, and package authors also have the...
<p>Some time ago I wrote an article on how to use a simple neural network in R with the neuralnet package to tackle a regression task.<br>
A few weeks ago, however, I was asked how to use the neuralnet package for making a multilabel classifier. I wrote a quick script as an example and thought I could write a short article on it, furthermore I think a classification tutorial using the neuralnet package could be complementary to the one I did on regression.</p>
<p>The post <a rel="nofollow" href="http://www.quantide.com/multilabel-classification-neuralnet-package/">Multilabel classification with neuralnet package</a> appeared first on <a rel="nofollow" href="http://www.quantide.com/">Quantide - R training &amp; consulting</a>.</p>
Couldn’t make it to Orlando in January?  We’re excited to bring you the next best thing. Whether you missed the conference, missed a talk, or just want to refresh your memory, you can find all the recordings from the first ever conference about All Things R &amp; RStudio at https://www.rstudio.com/resources/webinars/#rstudioconf. Just click on +rstudio::conf 2017 when […]
by Joseph Rickert I have always been attracted to the capricious. So, it was no surprise that I fell for the Cauchy distribution at first sight. I had never seen such unpredictability! You might say that every distribution has its moments of unpredictability, but the great charm of Cauchy is that it has no moments. […]
<p>Proposed solution for Euler Problem 12 in the R language. What is the value of the first triangle number to have over five hundred divisors? <a href="http://r.prevos.net/euler-problem-12-triangular-number/">Continue reading <span>→</span></a></p>
<p>The post <a rel="nofollow" href="http://r.prevos.net/euler-problem-12-triangular-number/">Euler Problem 12: Highly Divisible Triangular Number</a> appeared first on <a rel="nofollow" href="http://r.prevos.net/">The Devil is in the Data</a>.</p>
This post will introduce John Ehlers’s Autocorrelation Periodogram mechanism–a mechanism designed to dynamically find a lookback period. That is, the … <span><a href="https://quantstrattrader.wordpress.com/2017/02/15/ehlerss-autocorrelation-periodogram/">Continue reading <span>→</span></a></span>
My day job as a real estate agent requires a myriad of skills, ranging from accounting to negotiation to business analysis.  Frequently (about every three months) I whip out my marketing skills to advertise my business.  This time I decided to send out postcards to an entire neighborhood in which I had sold homes recently. … <a href="https://realdataweb.wordpress.com/2017/02/15/creating-a-mailing-list-in-qgis-and-r/">Continue reading <span>Creating a Mailing List in QGIS and R</span></a>
Today we are going to digress from our ongoing “Intro to R” series, and talk about a subject that’s been on my mind lately: sample sizes. An important question when designing an experiment is “How big a sample do I […]
In this tutorials serie, we are going to see three tricks to do the following in a Shiny app: Add Next and Previous buttons to navigate in a tabBox Build a non completely collapsible sidebar to keep the icon visible on collapse Add button on a datatable output to delete/modify/ do an action on a […]
Lately I notice a sharp increase in my coffee consumption (reading Howard Schultz’s Starbucks book, which is actually quite good by the way, does not help either :grimacing:). Having recently transitioned into a new PhD program I started wondering wh...
Intro In an earlier post I talked about Spark and sparklyR and did some experiments. At my work here at RTL Nederland we have a Spark cluster on Amazon EMR to do some serious heavy lifting on click and video-on-demand … <a href="https://longhowlam.wordpress.com/2017/02/15/r-formulas-in-spark-and-un-nesting-data-in-sparklyr-nice-and-handy/">Continue reading <span>→</span></a>
Lately I notice a sharp increase in my coffee consumption (reading Howard Schultz’s Starbucks book, which is actually quite good by the way, does not help either :grimacing:). Having recently transitioned into a new PhD program I started wondering wh...
Presented without exposition (since it’s a silly Geom) This particular ❤️ math pilfered this morning from @dmarcelinobr:
Predominately data science projects deal with descriptive statistics. The common theme (especially on this blog) is to gather a dataset, visualize and describe it. The toolset consists of a combination of machine learning, descriptive statistics and (...
One of the major &quot;wow!&quot; moments in the keynote where SQL Server 2016 was first introduced was a demo that automated the process classifying images of galaxies in a huge database of astronomical images. The SQL Server Blog has since published a step-by-step tutorial on implementing the galaxy classifier in SQL Server (and the code is also available on GitHub). This updated version of the demo uses the new MicrosoftML package in Microsoft R Server 9, and specifically the rxNeuralNet function for deep neural networks. The tutorial recommends using the Azure NC class of virtual machines, to take advantage of...
<p>Data science, artificial intelligence, automation, and other advanced technologies are reshaping the world. </p>
<p>As the world changes who's likely to succeed?</p>
<p>The post <a rel="nofollow" href="http://sharpsightlabs.com/blog/human-capital-map/">One thing critical for success in the age of AI (and who has it)</a> appeared first on <a rel="nofollow" href="http://sharpsightlabs.com/">SHARP SIGHT LABS</a>.</p>
splashr has gained some new functionality since the introductory post. First, there’s a whole new Docker image for it that embeds a local web server. Why? The main request for it was to enable rendering of htmlwidgets: But if you use the new Docker image and the add_tempdir=TRUE parameter it can render any local HTML... <a href="https://rud.is/b/2017/02/14/spelunking-xhrs-xmlhttprequests-with-splashr/">Continue reading <span>→</span></a>
In this post I introduce ‘Inswinger’ an interactive Shiny app to analyze International T20 players, matches and teams. This app was a natural consequence to my earlier Shiny app ‘GooglyPlus’. Most of the structure for this app remained the same, I only had to work with a different dataset, so to speak. The Googly Shiny … <a href="https://gigadom.wordpress.com/2017/02/14/inswinger-yorkr-swings-into-international-t20s/">Continue reading <span>Inswinger: yorkr swings into International T20s</span></a>
<p>According to NYC Health, “Each year, thousands of New York City residents become sick from consuming foods or drinks that are contaminated with harmful bacteria, viruses […]</p>
<p>The post <a rel="nofollow" href="http://blog.nycdatascience.com/student-works/r-shiny/eat-not-eat-question/">To Eat, or Not to Eat...WHERE is the question</a> appeared first on <a rel="nofollow" href="http://blog.nycdatascience.com/">NYC Data Science Academy Blog</a>.</p>
No matter how many jobs are promised, Barak Obama’s administration will be nearly impossible to beat when it comes to employment growth. The following code uses the blcrapeR package, which is available on CRAN. Politicians talk a lot about jobs and unemployment, even though the actual power they have over the labor market is up <a href="https://www.datascienceriot.com/labor-market-analysis-with-r-will-obama-ever-be-beat/kris/">Read More</a>
<br> <ul><li>&quot;MODIStsp&quot; is a R package allowing automatic download and preprocessing of MODIS Land Products time series, available at this <a href="https://github.com/lbusett/MODIStsp">https://github.com/lbusett/MODIStsp</a> github page (See also <a href="http://lbusettspatialr.blogspot.it/2016/09/modistsp-new-r-package-for-modis-land.html">here</a> for additional information) </li></ul><br><ul><li> v1.3.1 adds functionality for processing of MODIS snow cover products, accelerated download, processing of specified portions of years, plus various bug fixing and improvements.</li></ul><br><br><table align="center" cellpadding="0" cellspacing="0"><tr><td><a href="https://2.bp.blogspot.com/-5ve1R5HhggI/WKHlxQhsfhI/AAAAAAAAB3s/1EY38ZsbWH0rUAp0NGlcdzusLpJIeYlxQCEw/s1600/Figure_2_new.png"></a></td></tr><tr><td>MODIStsp: the main processing GUI</td></tr></table><div><br></div><br><br>See <a href="https://github.com/lbusett/MODIStsp/releases/tag/v1.3.1">here</a> for a detailed description of introduced changes <br><br>We hope you will find the new version useful and that we didn't introduce too many bugs ! Please report any problems in our <a href="https://github.com/lbusett/MODIStsp/issues">issues</a> GitHub page !
If big data is your thing, you use R, and you’re headed to Strata + Hadoop World in San Jose March 13 &amp; 14th, you can experience in person how easy and practical it is to analyze big data with R and Spark. In a beginner level talk by RStudio’s Edgar Ruiz and an intermediate […]
<p>Introduction This post is about the first of the four projects we are supposed to deliver at the NYC Data Science Academy Data Science Bootcamp program. The […]</p>
<p>The post <a rel="nofollow" href="http://blog.nycdatascience.com/student-works/r-shiny/graphic-look-bay-area-bike-share/">A Graphic Look at Bay Area Bike Share</a> appeared first on <a rel="nofollow" href="http://blog.nycdatascience.com/">NYC Data Science Academy Blog</a>.</p>
Looking at winning records of ATP top players and Brazilian tennists - In the previous post about tennis, we studied how changes in ball’s composition in hard and grass courts affected the game back in 2000. In this post, we wil...
Data science enhances people’s decision making. Doctors and researchers are making critical decisions every day. Therefore, it is absolutely necessary for those people to have some basic knowledge of data science. This series aims to help people that are around medical field to enhance their data science skills. This is the third part of the […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Data Science for Doctors – Part 1 : Data Display" rel="bookmark" href="http://r-exercises.com/2017/01/29/data-science-for-doctors-part-1-data-display/">Data Science for Doctors – Part 1 : Data Display </a></li>
<li><a title="Data Science for Doctors – Part 2 : Descriptive Statistics" rel="bookmark" href="http://r-exercises.com/2017/02/05/data-science-for-doctors-part-2-descriptive-statistics/">Data Science for Doctors – Part 2 : Descriptive Statistics </a></li>
<li><a title="Generating Data Exercises" rel="bookmark" href="http://r-exercises.com/2016/11/17/generating-data-exercises/">Generating Data Exercises </a></li>
<li><a href="http://r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
Oksana Kutina and Stefan Feuerriegel fom University of Freiburg recently published an in-depth comparison of four R packages for deep learning. The packages reviewed were: MXNet: The R interface to the MXNet deep learning library. (The blog post refers to an older name for the package, MXNetR.) darch: An R package for deep architectures and restricted Boltzmann machines. deepnet: An R package implementing feed-forward neural networks, restricted Boltzmann machines, deep belief networks, and stacked autoencoders. h2o: The R interface to the H2O deep-learning framework. The blog post goes into detail about the capabilities of the packages, and compares them in...
<p>We are happy to announce that we applied for a another <a href="https://developers.google.com/open-source/gsoc/">Google Summer of Code</a> project in 2017.</p>
Streaming Data is data that is generated continuously and it includes various sources such as sensors, log files, geospatial services, etc. The data may come at regular intervals and we may want to have a dashboard which updates by itself and incorporates the newly added data so that we can use it for deta driven […]<ul><li><a href="https://www.youtube.com/watch?v=0xZZC8SAxAQ">Email and Text Alerts Based on Streaming Sensor Data</a></li></ul><strong><p>Related Post</p></strong><ol><li><a title="Permanent Link toMetro Systems Over Time: Part 3" rel="bookmark" href="https://datascienceplus.com/metro-systems-over-time-part-3/">Metro Systems Over Time: Part 3</a></li><li><a title="Permanent Link toMetro Systems Over Time: Part 2" rel="bookmark" href="https://datascienceplus.com/metro-systems-over-time-part-2/">Metro Systems Over Time: Part 2</a></li><li><a title="Permanent Link toMetro Systems Over Time: Part 1" rel="bookmark" href="https://datascienceplus.com/metro-systems-over-time-part-1/">Metro Systems Over Time: Part 1</a></li><li><a title="Permanent Link toOutlier App: An Interactive Visualization of Outlier Algorithms" rel="bookmark" href="https://datascienceplus.com/outlier-app-an-interactive-visualization-of-outlier-algorithms/">Outlier App: An Interactive Visualization of Outlier Algorithms</a></li><li><a title="Permanent Link toCreating an animation using R" rel="bookmark" href="https://datascienceplus.com/creating-an-animation-using-r/">Creating an animation using R</a></li></ol>
Mark Sellors Head of Data Engineering I’ve recently been working at the Office for National Statistics, under the very broad umbrella of a SAS to R transition project. As you might imagine, ONS, as the UK’s largest producer of official … <a href="http://www.mango-solutions.com/wp/2017/02/production-r-at-ons/">Continue reading <span>→</span></a>
  In the previous post (mostly based on EDA principles) I highlighted the main features of 1,720 Venture Capital deals that took place in 2016 in 50 different countries. It is of a central importance to once again underline that the dataset that I used is not a representative sample <a href="http://r-blog.salvaggio.net/?p=443">Read More ...</a>
<p>mlr 2.10 is now on CRAN. Please update your package if you haven’t done so in a while.</p>
<p>Here is an overview of the changes:</p>
Here’s to the ones who dream foolish, as they may seem (The Fools Who Dream, ‘La La Land’ OST) One of the key points of The Meeting Point Locator is to obtain an orthogonal great circle to the bearing defined by any two given locations on Earth. A great circle is the intersection of the … <a href="https://fronkonstin.com/2017/02/13/how-to-find-equidistant-coordinates-between-two-locations-on-earth/">Continue reading <span>How to Find Equidistant Coordinates Between Two Locations on Earth</span> <span>→</span></a>
The [then current now past] riddle of the week is a sort of multiarmed bandits optimisation. Of sorts. Or rather a generalised knapsack problem. The question is about optimising the allocation of 100 undistinguishable units to 10 distinct boxes against a similarly endowed adversary, when the loss function is and the distribution q of the […]
A Brief Introduction Linear regression is a classic supervised statistical technique for predictive modelling which is based on the linear hypothesis: y = mx + c where y is the response or outcome variable, m is the gradient of the linear trend-line, x is the predictor variable and c is the intercept. The intercept is… <a href="https://sw23993.wordpress.com/2017/02/12/implementing-the-gradient-descent-algorithm-in-r/">Continue reading <span>Implementing the Gradient Descent Algorithm in R</span> <span>→</span></a><img height="1" alt="" width="1" src="https://pixel.wp.com/b.gif?host=sw23993.wordpress.com&blog=55595436&post=692&subd=sw23993&ref=&feed=1" border="0">
The data frame is the primary structure for working with data in R. Whenever you have data that is arranged in a spreadsheet-like fashion, the default receptacle for that data in R is the data frame. In a data frame, […]
After exploring my study population of Wikipedia deaths, I want to analyse the time series of monthly counts of notable deaths. This is not a random interest of mine, my PhD thesis was about monitoring time series of count, the application being weekly...
A participant in the R course I’m teaching showed me a case where a tbl_df (the new flavour of data frame provided by the tibble package; standard in new RStudio versions) interacts badly with the t.test function. I had not seen this happen before. The reason is this: Interacting with legacy code A handful of […]
When running an analysis, I am usually combining functions from multiple packages. Most of these packages come with their own plotting functions. And while they are certainly convenient in that they allow me to get a quick glance at the data or the out...
<p>Contributed by Thomas Kassel. He is currently enrolled in the NYC Data Science Academy 17-week remote bootcamp program taking place from January-April 2017. This post is based on his second class project, R […]</p>
<p>The post <a rel="nofollow" href="http://blog.nycdatascience.com/student-works/tracking-exercise-trends-nhanes/">Tracking Exercise Trends with NHANES</a> appeared first on <a rel="nofollow" href="http://blog.nycdatascience.com/">NYC Data Science Academy Blog</a>.</p>
RDSTK is a very versatile package. It includes functions to help you convert IP address to geo locations and derive statistics from them. It also allows you to input a body of text and convert it into sentiments. This is a continuation from the last exercise RDSTK 1 This package provides an R interface to […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Data Hacking with RDSTK (part 1)" rel="bookmark" href="http://r-exercises.com/2017/01/31/rdstk1/">Data Hacking with RDSTK (part 1) </a></li>
<li><a title="Functions exercises vol. 2" rel="bookmark" href="http://r-exercises.com/2016/12/05/functions-exercises-vol-2/">Functions exercises vol. 2 </a></li>
<li><a title="Scripting Loops In R" rel="bookmark" href="http://r-exercises.com/2016/06/01/scripting-loops-in-r/">Scripting Loops In R </a></li>
<li><a href="http://r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
Authors: Christof Naumzik &amp; Stefan Feuerriegel Caffe (http://caffe.berkeleyvision.org) provides a powerful framework for deep learning. It is developed and maintained by the Berkeley Vision and Learning Center (BVLC) and has received a great deal of traction lately. Caffe enables users to define and train custom-made neural networks without hard-coding. Furthermore, it allows users to execute … <a href="http://www.rblog.uni-freiburg.de/2017/02/11/caffer-an-r-wrapper-for-caffe/">Continue reading<span> &quot;caffeR: an R wrapper for ‘caffe’&quot;</span></a>
Recently Dirk Eddelbuettel pointed out that our R function debugging wrappers would be more convenient if they were available in a low-dependency micro package dedicated to little else. Dirk is a very smart person, and like most R users we are deeply in his debt; so we (Nina Zumel and myself) listened and immediately moved … <a href="http://www.win-vector.com/blog/2017/02/announcing-the-wrapr-packge-for-r/">Continue reading <span>Announcing the wrapr packge for R</span></a>
by Merav Yuravlivker, CEO of Data Society “I’m not a coder” or “I was never good at math” is a frequent refrain I hear when I ask professionals about their data analysis skills. Through popular culture and stereotypes, most people who don’t have a background in programming automatically underestimate their ability to create amazing things […]
On January 31, the R Consortium presented a webinar with updates on various projects that have been funded (thanks to the R Consortium member dues) and are underway. Each project was presented by the project leader, a member of the R community. You can watch the recording of the webinar here, but here's a brief summary of what was covered, grouped by infrastructure projects (R packages and support systems) and community projects (events and groups). Infrastructure projects R-hub [Gabor Csardi]: As one of the first projects funded by the R Consortium, the R-hub project is nearing completion. This R package-building...
Serving book exercises in the web with Shiny and Exams - As you may know, I recently published a R book in amazon.
I decided to keep R exercises out of the book and serve them freely over the web. This was not a difficult decision...
Model results can be thought of as a reward for the many hours of model design, troubleshooting, re-design, etc. that analyses often require. Following the potentially exhausting mental exercise to acquire these results, I think we’d all like the interpretation … <a href="https://lynchlab.com/2017/02/10/visualizing-and-wrangling-mcmc-output-in-r-with-mcmcvis/">Continue reading <span>→</span></a>
On Thursday, March 2nd, I will give the first lecture of the PhD course on advanced tools for econometrics, on nonlinearities. Slides are available online.
Statisticians have long known that the use of p-values has major problems. Some of us have long called for reform, weaning the profession away from these troubling beasts. At one point, I was pleased to see Frank Harrell suggest that R should stop computing them. That is not going to happen, but last year the … <a href="https://matloff.wordpress.com/2017/02/09/any-forward-progress-on-p-values/">Continue reading <span>Any Forward Progress on p-Values?</span> <span>→</span></a>
<p>Demonstrating the various ways percentile calculations can be undertaken in R and specifically with respect to measuring turbidity in water supplies. <a href="http://r.prevos.net/percentile-calculations/">Continue reading <span>→</span></a></p>
<p>The post <a rel="nofollow" href="http://r.prevos.net/percentile-calculations/">Percentile Calculations in Water Quality Regulations</a> appeared first on <a rel="nofollow" href="http://r.prevos.net/">The Devil is in the Data</a>.</p>
When we last looked at job trends from indeed.com, job listings for &quot;R statistics&quot; were on the rise but were still around half the volume of listings for &quot;SAS statistics&quot;. Three-and-a-half years later, R has overtaken SAS in job listings for &quot;statistics&quot;. I added Python to the search this time; job listings for &quot;Python statistics&quot; have risen at a similar rate to those for R, but with a somewhat higher volume for R. Since data science is popular job role these days, let's do the same search for &quot;data scientist&quot;: For &quot;data scientist&quot; jobs, R and Python track very closely,...
We’re excited to announce the latest release of RStudio Connect: version 1.4.2. This release includes a number of notable features including an overhauled interface for parameterized R Markdown reports. The most notable feature in this release is the ability to publish parameterized R Markdown reports that are easier for anyone to customize. If you’re unfamiliar, […]<img height="1" alt="" width="1" src="https://pixel.wp.com/b.gif?host=blog.rstudio.org&blog=18843819&post=4060&subd=rstudioblog&ref=&feed=1" border="0">
In this post we are going to have a look at one of the problems while applying clustering algorithms such as k-means and expectation maximization that is of determining the optimal number of clusters. The problem of determining what will be the best value for the number of clusters is often not very clear from […]<ul></ul><strong><p>Related Post</p></strong><ol><li><a title="Permanent Link toAnalyzing the first Presidential Debate" rel="bookmark" href="https://datascienceplus.com/analyzing-the-first-presidential-debate/">Analyzing the first Presidential Debate</a></li><li><a title="Permanent Link toGoodReads: Machine Learning (Part 3)" rel="bookmark" href="https://datascienceplus.com/goodreads-machine-learning-part-3/">GoodReads: Machine Learning (Part 3)</a></li><li><a title="Permanent Link toMachine Learning for Drug Adverse Event Discovery" rel="bookmark" href="https://datascienceplus.com/machine-learning-for-drug-adverse-event-discovery/">Machine Learning for Drug Adverse Event Discovery</a></li><li><a title="Permanent Link toGoodReads: Exploratory data analysis and sentiment analysis (Part 2)" rel="bookmark" href="https://datascienceplus.com/exploratory-data-analysis-and-sentiment-analysis/">GoodReads: Exploratory data analysis and sentiment analysis (Part 2)</a></li><li><a title="Permanent Link toGoodReads: Webscraping and Text Analysis with R (Part 1)" rel="bookmark" href="https://datascienceplus.com/goodreads-webscraping-and-text-analysis-with-r-part-1/">GoodReads: Webscraping and Text Analysis with R (Part 1)</a></li></ol>
<p>Factor analysis is a controversial technique that represents the variables of a dataset as linearly related to random, unobservable variables called factors, denoted where . The factors are representative of ‘latent variables’ underlying the original variables. The existence of the factors is hypothetical as they cannot be measured or observed....</p>
<p>The post <a rel="nofollow" href="http://www.aaronschlegel.com/factor-analysis-introduction-principal-component-method-r/">Factor Analysis Introduction with the Principal Component Method and R</a> appeared first on <a rel="nofollow" href="http://www.aaronschlegel.com/">Aaron Schlegel</a>.</p>
I want to share an edited screencast of my rehearsal for my recent San Francisco Bay Area R Users Group talk:
If you're thinking about teaching a course on statistics and data science using R, Chester Ismay and Albert Kim have created an online, open-source textbook for just that purpose. ModernDive is a textbook for that instructs students how to: use R to explore and visualize data; use randomization and simulation to build inferential ideas; effectively create stories using these ideas to convey information to a lay audience. The book makes liberal use of R packages, and makes effective use real-world data sets to communicate key concepts. Though still a work-in-progress, the book already effectively covers the basics of data analysis...
If you do enough web scraping, you’ll eventually hit a wall that the trusty httr verbs (that sit beneath rvest) cannot really overcome: dynamically created content (via javascript) on a site. If the site was nice enough to use XHR requests to load the dynamic content, you can generally still stick with httr verbs —... <a href="https://rud.is/b/2017/02/09/diving-into-dynamic-website-content-with-splashr/">Continue reading <span>→</span></a>
<p>Solution to Euler Problem 11 in the R language. What is the greatest product of four adjacent numbers in the same direction in the 20 by 20 grid? <a href="http://r.prevos.net/euler-problem-11/">Continue reading <span>→</span></a></p>
<p>The post <a rel="nofollow" href="http://r.prevos.net/euler-problem-11/">Euler Problem 11: Largest Product in a Grid</a> appeared first on <a rel="nofollow" href="http://r.prevos.net/">The Devil is in the Data</a>.</p>
<p>Recently I’ve worked with word2vec and doc2vec algorithms that I found interesting from many perspectives. Even though I used them for another purpose, the main thing they were developed for is Text analysis. As I noticed, my 2014 year’s article Twitter sentiment analysis is one of the most popular blog posts on the blog even today. […]</p>
<p>The post <a rel="nofollow" href="http://analyzecore.com/2017/02/08/twitter-sentiment-analysis-doc2vec/">Twitter sentiment analysis with Machine Learning in R using doc2vec approach</a> appeared first on <a rel="nofollow" href="http://analyzecore.com/">AnalyzeCore - data is beautiful, data is a story</a>.</p>
by Jonathan Regenstein Today, we are going to tackle a project that has long been on my wish list: a Shiny app to take a fund or portfolio, analyze its exposure to different countries, and display those exposures on a world map. Now you know how exciting my wishlists are. Before describing our data importing/wrangling […]
The ifelse function is the way to do vectorised if then else in R. One of the first cool things I learned to do in R a few years back, I got from Norman Matloff’s The Art of R Programming. When you have more than one if then statements, you just nest multiple ifelse functions before you reach the else.
In past couple of months, I have prepared several articles on R and SQL Server that have been published on SQL Server Central. The idea was, to have couple of articles covering the introduction to R, to basics on R Server, to some practical cases on R with SQL Server. 1) Using Microsoft R in … <a href="https://tomaztsql.wordpress.com/2017/02/08/r-and-sql-server-articles/">Continue reading <span>R and SQL Server articles</span></a>
I’m pleased to announce sjmisc 2.3.0, which was just updated on CRAN. The update might break existing code – however, functions were largely revised to work seamlessly within the tidyverse. In the long run, consistent design makes working with sjmisc more intuitive. Basically, sjmisc covers two domains of functionality: Reading and writing data between R […]
In the hyper-competitive retail industry, intelligence about your customers is key. You need to be able to find the right customers, understand what types of customers you have, and know how to keep the best ones. Three solutions based around R and SQL Server R Services will help you do exactly that. To find the right customers, you need to optimize your marketing activites. You might use different channels (phone, email, social media etc.) to try and reach potential customers, and some offers are likely to resonate more with certain prospects than others. Results from prior campaigns can be used...
This tutorial was prepared for the Ninth Annual Midwest Graduate Student Summit on Applied Economics, Regional, and Urban Studies (AERUS) on April 23rd-24th, 2016 at the University of Illinois at Urbana Champaign.
Note: Cross-posted with the Stack Overflow blog. Check out the code for this analysis on Kaggle.
For me, the weekends are mostly about spending time with my family, reading for leisure, and working on the open-source projects I am involved in. These w...
I’m excited to announce the release of my new e-book: Introduction to Empirical Bayes: Examples from Baseball Statistics, available here.
This book is adapted from a series of ten posts on my blog, starting with Understanding the beta distribution a...
RENDER FUNCTIONS In the sixth part of our series we will talk about the renderPlot and the renderUI function and then we will be ready to create our first visualization. (Find part 1-5 here). We are going to create a simple interactive scatterplot that will help us see the clusters that are created when we […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Building Shiny App exercises part 1" rel="bookmark" href="http://r-exercises.com/2016/12/12/building-shiny-app-exercises-part-1/">Building Shiny App exercises part 1 </a></li>
<li><a title="Building Shiny App exercises part 2" rel="bookmark" href="http://r-exercises.com/2016/12/18/building-shiny-app-exercises-part-2/">Building Shiny App exercises part 2 </a></li>
<li><a title="Building Shiny App exercises part 3" rel="bookmark" href="http://r-exercises.com/2016/12/25/building-shiny-app-exercises-part-3/">Building Shiny App exercises part 3 </a></li>
<li><a href="http://r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
<p>The post <a rel="nofollow" href="http://sharpsightlabs.com/blog/map-geospatial-data-usa-rivers/">How to map geospatial data: USA rivers</a> appeared first on <a rel="nofollow" href="http://sharpsightlabs.com/">SHARP SIGHT LABS</a>.</p>
<p>This Thursday at 10am I will be doing a live event with John Sonmez, the founder of SimpleProgrammer. The presentation is titled Blogging for Data Scientists. John...</p>
<p>The post <a rel="nofollow" href="http://www.arilamstein.com/blog/2017/02/06/upcoming-presentation-blogging-data-scientists/">Live Event: Blogging for Data Scientists</a> appeared first on <a rel="nofollow" href="http://www.arilamstein.com/">AriLamstein.com</a>.</p>
Authors: Christof Naumzik &amp; Stefan Feuerriegel Caffe (http://caffe.berkeleyvision.org) provides a powerful framework for deep learning. It is developed and maintained by the Berkeley Vision and Learning Center (BVLC) and has received a great deal of traction lately. Caffe enables users to define and train custom-made neural networks without hard-coding. Furthermore, it allows users to execute … <a href="http://www.rblog.uni-freiburg.de/2017/02/06/caffer-an-r-wrapper-for-caffe/">Continue reading<span> &quot;caffeR: an R wrapper for ‘caffe’&quot;</span></a>
In case you missed them, here are some articles from January of particular interest to R users. The Data Science Virtual Machine on Azure has been updated with the latest Microsoft R Server, and adds RStudio and JuliaPro. A crowdsourced list of local R user groups and community events, maintained by Colin Gillespie. Resources for searching R packages, now that CRAN has more than 10,000 of them. An analysis of 2 decades of Kung Fu movies (with R code) by Jim Vallandingham. New Zealand's Heartland Bank replaced SAS with Microsoft R Server. A tutorial on creating a predictive model for...
R Tutorial: Visualizing multivariate relationships in Large Datasets A tutorial by D.M. Wiig In two previous blog posts I discussed some techniques for visualizing relationships involving two or three variables and a large number of cases. In this tutorial I will extend that discussion to show some techniques that can be used on large datasets … <a href="https://dmwiig.net/2017/02/06/r-tutorial-visualizing-multivariate-relationships-in-large-datasets/">Continue reading <span>R Tutorial: Visualizing Multivariate Relationships in Large Datasets</span> <span>→</span></a>
  Oksana Kutkina, Stefan Feuerriegel March 7, 2016 Introduction Deep learning is a recent trend in machine learning that models highly non-linear representations of data. In the past years, deep learning has gained a tremendous momentum and prevalence for a variety of applications (Wikipedia 2016a). Among these are image and speech recognition, driverless cars, natural … <a href="http://www.rblog.uni-freiburg.de/2017/02/07/deep-learning-in-r/">Continue reading<span> &quot;Deep Learning in R&quot;</span></a>
In answering a simple question on X validated about producing Monte Carlo estimates of the variance of estimators of exp(-θ) in a Poisson model, I wanted to illustrate the accuracy of these estimates against the theoretical values. While one case was easy, since the estimator was a Binomial B(n,exp(-θ)) variate [in yellow on the graph], […]
A friend asked me whether I can create a loop which will run multiple regression models. She wanted to evaluate the association between 100 dependent variables (outcome) and 100 independent variable (exposure), which means 10,000 regression models. Regression models with multiple dependent (outcome) and independent (exposure) variables are common in genetics. So models will be […]<ul></ul><strong><p>Related Post</p></strong><ol><li><a title="Permanent Link toRegression model with auto correlated errors – Part 3, some astrology" rel="bookmark" href="https://datascienceplus.com/regression-model-with-auto-correlated-errors-part-3-some-astrology/">Regression model with auto correlated errors – Part 3, some astrology</a></li><li><a title="Permanent Link toRegression model with auto correlated errors – Part 2, the models" rel="bookmark" href="https://datascienceplus.com/regression-model-with-auto-correlated-errors-part-2-the-models/">Regression model with auto correlated errors – Part 2, the models</a></li><li><a title="Permanent Link toRegression model with auto correlated errors – Part 1, the data" rel="bookmark" href="https://datascienceplus.com/fitting-a-simple-regression-model-with-auto-correlated-errors-an-astrological-example-part-1-the-data/">Regression model with auto correlated errors – Part 1, the data</a></li><li><a title="Permanent Link toLinear Regression from Scratch in R" rel="bookmark" href="https://datascienceplus.com/linear-regression-from-scratch-in-r/">Linear Regression from Scratch in R</a></li><li><a title="Permanent Link toR for Publication by Page Piccinini: Lesson 5 – Analysis of Variance (ANOVA)" rel="bookmark" href="https://datascienceplus.com/r-for-publication-by-page-piccinini-lesson-5-analysis-of-variance-anova/">R for Publication by Page Piccinini: Lesson 5 – Analysis of Variance (ANOVA)</a></li></ol>
Dual y-axes: yes or no? What about if one of them is also reversed, i.e. values increase from the top of the chart to the bottom? Judging by this StackOverflow question, hydrologists are fond of both of these things. It asks whether ggplot2 can be used to generate a “rainfall hyetograph and streamflow hydrograph”, which … <a href="https://nsaunders.wordpress.com/2017/02/07/hyetographs-hydrographs-and-highcharter/">Continue reading <span>Hyetographs, hydrographs and highcharter</span></a>
My sjPlot-package was just updated on CRAN with some – as I think – useful new features. First, I have added some vignettes to the package (based on the existing online-documentation) that cover some core features and principles of the sjPlot-package, so you have direct access to these manuals within R. The vignettes are also […]
Today, I want to share my analysis of the World Gender Statistics dataset.
Last week I already introduced my Shiny app, where you can explore 160 measurements for 164 countries over 56 years. This week I’ve included a statistical analysis of these c...
We invite users and developers of R to submit an abstract for one or more of this year’s EARL Conferences. If you have a real-world business case use of R and you’re proud to share your experience, we want to … <a href="http://www.mango-solutions.com/wp/2017/02/share-your-knowledge-at-earl-2017-call-for-abstracts-san-francisco-and-london/">Continue reading <span>→</span></a>
I am happy to announce that my book about R and Finance (in portuguese) is finally available!
The idea of writing a book about R started back in the end of 2015, when I decided to try something different than research papers. W...
At Thursday (12.01.2017) we had a chance to attend the first TriCity R Users Group (Pomerania, Poland) meeting. The meetup was unexpectedly very successful! The success can be measured in the time attendees spent on ardently comments and questions aft...
I made a promise to someone that my next blog would be about stringi vs stringr and I intend to keep said promise. stringr and stringi do “string operations”: find, replace, match, extract, convert, transform, etc. The stringr package is now part of the tidyverse and is 100% focused on string processing and is pretty... <a href="https://rud.is/b/2017/02/06/strung-out-on-string-ops-a-brief-comparison-of-stringi-and-stringr/">Continue reading <span>→</span></a>
A pure maintenance release of the random package for truly (hardware-based) random numbers as provided by random.org is now on CRAN. As requested by CRAN, we made running tests optional. Not running tests is clearly one way of not getting (spurious, ...
One of the distinctive features of the R platform is how explicit and user controllable everything is. This allows the style of use of R to evolve fairly rapidly. I will discuss this and end with some new notations, methods, and tools I am nominating for inclusion into your view of the evolving “current best … <a href="http://www.win-vector.com/blog/2017/02/evolving-r-tools-and-practices/">Continue reading <span>Evolving R Tools and Practices</span></a>
Data science enhances people’s decision making. Doctors and researchers are making critical decisions every day. Therefore, it is absolutely necessary for those people to have some basic knowledge of data science. This series aims to help people that are around medical field to enhance their data science skills. We will work with a health related […]<div>
<h3>Related exercise sets:</h3><ol><li><a title="Descriptive Analytics-Part 2 : Data Imputation" rel="bookmark" href="http://r-exercises.com/2016/11/02/descriptive-analytics-part-2-data-imputation/">Descriptive Analytics-Part 2 : Data Imputation </a></li>
<li><a title="Data Science for Doctors – Part 1 : Data Display" rel="bookmark" href="http://r-exercises.com/2017/01/29/data-science-for-doctors-part-1-data-display/">Data Science for Doctors – Part 1 : Data Display </a></li>
<li><a title="Descriptive Analytics-Part 1: Data Formatting Exercises" rel="bookmark" href="http://r-exercises.com/2016/10/26/descriptive-analytics-part-1-data-formatting/">Descriptive Analytics-Part 1: Data Formatting Exercises </a></li>
<li><a href="http://r-exercises.com/start-here-to-learn-r/">Explore all our (>1000) R exercises</a></li><li><a href="http://r-exercises.com/r-courses/">Find an R course using our R Course Finder</a> directory</li></ol></div>
[Une version francaise de cette article est disponible ici] This year (2017) we will have our presidential election between April and May in France. A while ago I discovered the open data website of the French government publishing public data with free access and promoting utilization by anyone. So in this post I will explore … <a href="https://biologyforfun.wordpress.com/2017/02/05/patterns-across-50-years-of-french-presidential-election/">Continue reading <span>Patterns across 50 years of French presidential election</span></a><img height="1" alt="" width="1" src="https://pixel.wp.com/b.gif?host=biologyforfun.wordpress.com&blog=42461605&post=1758&subd=biologyforfun&ref=&feed=1" border="0">
An analysis of point by point data - I’m a big fan of Tennis. When I’m not working in the university, you can
probably find me in my favourite tennis club,
Sogipa. What is so great about Tennis?
It is a sport that challenges y...
These last days a trending Twitter hashtag was “#actuallivingscientist”, whose origin can be find in this convo and whose original goal was to allow scientists to present themselves to everyone, a sort of #scicomm action. A great initiative, becaus...
I think good data science reads like a good story. In that it flows. Has an arc. And is compelling.
But data science has a dirty secret. For every piece that works, there are about nine others that didn’t. Nine other stories that look like they were...
A new version of the nanotime package for working with nanosecond timestamps is now on CRAN.
nanotime uses the RcppCCTZ package for (efficient) high(er) resolution time parsing and formatting, and the bit64 package for the actual integer64 arithmetic...
<p>Contributed by Thomas Kassel. He is currently enrolled in the NYC Data Science Academy 17-week remote bootcamp program taking place from January-April 2017. This post is based on his first class project, Exploratory […]</p>
<p>The post <a rel="nofollow" href="http://blog.nycdatascience.com/student-works/r-visualization/hubway-bike-share-ridership-patterns/">Hubway Bike Share: Ridership Patterns</a> appeared first on <a rel="nofollow" href="http://blog.nycdatascience.com/">NYC Data Science Academy Blog</a>.</p>
A new minor version 0.2.1, of RcppCCTZ is now on CRAN. It corrects a possible shortcoming and rounding in the conversion from internal representation (in C++11 using int64_t) to the two double values for seconds and nanoseconds handed to R. Two other...
Are you attending or considering attending Strata / Hadoop World 2017 San Jose? Are you interested in learning to use R to work with Spark and h2o? Then please consider signing up for my 3 1/2 hour workshop soon. We are about half full now, but I really want to fill the room, while making … <a href="http://www.win-vector.com/blog/2017/02/going-to-strata-hadoop-world-2017-san-jose/">Continue reading <span>Going to Strata / Hadoop World 2017 San Jose?</span></a>
A couple days ago, I participated in a Science of the Super Bowl Panel discussion organized by Newswise. I was asked to give a 5 (which turned more into about 10) minute overview, so I focused on answering 3 questions. What is data science? How is data science used in the NFL? How might data <a rel="nofollow" href="http://jessepiburn.com/2017/02/science-of-the-super-bowl/"><span>Read more about Science of The Super Bowl</span>[…]</a>
Yes, it started with a tweet: Nice graphic on urine components via https://t.co/sfuXNB02sF pic.twitter.com/vhVLahQ8su — Metabolomics (@metabolomics) January 31, 2017 By what measure is this a “nice graphic”? First, the JPEG itself is low-quality. Second, it contains spelling and numerical errors (more on that later). And third…do I have to spell this out…those are 3D … <a href="https://nsaunders.wordpress.com/2017/02/04/nice-graphic-are-they-taking-the-p/">Continue reading <span>Nice graphic? Are they taking the p…</span></a>
RevoscaleR Package for R language is  package for scalable, distributed and parallel computation, available along with Microsoft R Server (and in-Database R Services). It solves many of limitations that R language is facing when run from a client machine. RevoScaleR Package addresses several of these issues: memory based data access model -> dataset can be … <a href="https://tomaztsql.wordpress.com/2017/02/03/revoscaler-package-for-microsoft-r/">Continue reading <span>RevoScaleR package for Microsoft R</span></a>
The heatmap is a useful graphical tool in any data scientist's arsenal. It's a useful way of representing data that naturally aligns to numeric data in a 2-dimensional grid, where the value of each cell in the grid is represented by a color. It's a natural fit for data that's in a grid already (say, a correlation matrix). But it's also useful for data that can be arranged in a grid, like quantities in a calendar, as a way of comparing clusters, or simply as a combination of two categorical or discrete variables. The base R heatmap function does a...