<p><div><div><div><div data-width="100" data-show-faces="false" data-send="true" data-layout="button_count" data-height="21" data-href="https://www.r-bloggers.com/ibm-data-science-experience-first-steps-with-yorkr/"></div></div><div><a data-url="https://www.r-bloggers.com/ibm-data-science-experience-first-steps-with-yorkr/" data-counturl="https://www.r-bloggers.com/ibm-data-science-experience-first-steps-with-yorkr/" data-count="horizontal" data-text="IBM Data Science Experience:  First steps with yorkr" class="twitter-share-button" data-via="rbloggers" href="https://twitter.com/share"></a></div><div></div></div><div></div></div>
<div>
(This article was first published on <strong><a href="https://gigadom.wordpress.com/2016/09/04/ibm-data-science-experience-first-steps-with-yorkr/"> R – Giga thoughts …</a></strong>, and kindly contributed to <a rel="nofollow" href="https://www.r-bloggers.com/">R-bloggers)</a> </div>
<p>Fresh, and slightly dizzy, from my foray into Quantum Computing with <a target="_blank" href="http://www.research.ibm.com/quantum/">IBM’s Quantum Experience</a>, I now turn my attention to <a target="_blank" href="http://datascience.ibm.com/">IBM’s Data Science Experience</a> (DSE).</p>
<p>I am on the verge of completing a really great 3 module ‘<a target="_blank" href="https://courses.edx.org/dashboard/programs/21/data-science-and-engineering-with-spark">Data Science and Engineering with Spark XSeries</a>’ from the University of California, Berkeley and I have been thinking of trying out some form of integrated delivery platform for performing analytics, for quite some time.  Coincidentally,  IBM comes out with its Data Science Experience. a month back. There are a couple of other collaborative platforms available for playing around with Apache Spark or Data Analytics namely <a target="_blank" href="http://jupyter.org/">Jupyter notebooks</a>, <a target="_blank" href="https://databricks.com/">Databricks</a>, <a target="_blank" href="https://data.world/">Data.world</a>.</p>
<p>I decided to go ahead with IBM’s Data Science Experience as  the GUI is a lot cooler, includes shared data sets and integrates with Object Storage, Cloudant DB etc,  which seemed a lot closer to the cloud, literally!  IBM’s DSE is an interactive, collaborative, cloud-based environment for performing data analysis with Apache Spark. DSE is hosted on IBM’s PaaS environment, Bluemix. It should be possible to access in DSE the plethora of cloud services available on Bluemix. IBM’s DSE uses Jupyter notebooks for creating and analyzing data which can be easily shared and has access to a few hundred publicly available datasets</p>
<p><em>Disclaimer: This article represents the author’s viewpoint only and doesn’t necessarily represent IBM’s positions, strategies or opinions</em></p>
<p>In this post, I use IBM’s DSE and my R package yorkr, for analyzing the performance of 1 ODI match (Aus-Ind, 2 Feb 2012)  and the batting performance of Virat Kohli in IPL matches. These are my ‘first’ steps in DSE so, I use plain old “R language” for analysis together with my R package ‘yorkr’. I intend to  do more interesting stuff on Machine learning with SparkR, Sparklyr and PySpark in the weeks and months to come.</p>
<p>Working with Jupyter notebooks are fairly straight forward which can handle code in R, Python and Scala. Each cell can either contain code (Python or Scala), Markdown text, NBConvert or Heading. The code is written into the cells and can be executed sequentially. Here is a screen shot of the notebook.</p>
<p><a target="_blank" rel="attachment wp-att-4759" href="https://gigadom.wordpress.com/2016/09/04/ibm-data-science-experience-first-steps-with-yorkr/untitled-37/"><img alt="Untitled" class="wp-image-4759" src="https://i2.wp.com/gigadom.files.wordpress.com/2016/09/untitled.png?resize=456%2C214&ssl=1" data-recalc-dims="1"></a></p>
<p>The ‘File’ menu can be used for ‘saving and checkpointing’ or ‘reverting’ to a checkpoint. The ‘kernel’ menu can be used to start, interrupt, restart and run all cells etc. Data Sources icon can be used to load data sources to your code. The data is uploaded to Object Storage with appropriate credentials. You will have to  import this data from Object Storage using the credentials. In my notebook with yorkr I directly load the data from Github.  You can use the sharing to share the notebook. The shared notebook has an extension ‘ipynb’. You can use the ‘Sharing’ icon  to share the notebook. The shared notebook has an extension ‘ipynb’. You an import this notebook directly into your environment and can get started with the code available in the notebook.</p>
<p>You can import existing R, Python or Scala notebooks as shown below. My notebook ‘Using R package yorkr – A quick overview’ can be downloaded using the link ‘<a target="_blank" href="https://apsportal.ibm.com/analytics/notebooks/f026d638-1759-49fb-a690-003617cc4579/view?access_token=f0fadefb800192f4c93da93914ca491880c30be2e5e4f714a957e8c1e978ba5e">yorkrWithDSE</a>’ and clicking the green download icon on top right corner.</p>
<p><a target="_blank" rel="attachment wp-att-4765" href="https://gigadom.wordpress.com/2016/09/04/ibm-data-science-experience-first-steps-with-yorkr/untitled2/"><img alt="Untitled2" class="wp-image-4765" src="https://i0.wp.com/gigadom.files.wordpress.com/2016/09/untitled2.png?resize=456%2C190&ssl=1" data-recalc-dims="1"></a></p>
<p>I have also uploaded the file to Github and you can download from here too ‘<a target="_blank" href="https://github.com/tvganesh/yorkrWith-DSE">yorkrWithDSE</a>’. This notebook can be imported into your DSE as shown below</p>
<p><a target="_blank" rel="attachment wp-att-4761" href="https://gigadom.wordpress.com/2016/09/04/ibm-data-science-experience-first-steps-with-yorkr/untitled1-2/"><img alt="Untitled1" class="wp-image-4761" src="https://i1.wp.com/gigadom.files.wordpress.com/2016/09/untitled11.png?resize=456%2C193&ssl=1" data-recalc-dims="1"></a></p>
<p>Jupyter notebooks have been integrated with Github and are rendered directly from Github.  You can view my Jupyter notebook here  – “<a target="_blank" href="https://github.com/tvganesh/yorkrWith-DSE/blob/master/yorkrWithDSE.ipynb">Using R package yorkr – A quick overview</a>’. You can also view it on NBviewer at “<a target="_blank" href="http://nbviewer.jupyter.org/gist/tvganesh/e814b3d5adc30a560d657fd5fecddb58">Using R package yorkr – A quick overview</a>”</p>
<p>So there it is. You can download my notebook, import it into IBM’s Data Science Experience and then use data from ‘<a target="_blank" href="https://github.com/tvganesh/yorkrData">yorkrData</a>” as shown. As already mentioned yorkrData contains converted data for ODIs, T20 and IPL. For details on how to use my R package yorkr  please my posts on yorkr at “<a target="_blank" href="https://gigadom.wordpress.com/aa-2/">Index of posts</a>”</p>
<p>Hope you have fun playing wit IBM’s Data Science Experience and my package yorkr.</p>
<p>I will be exploring IBM’s DSE in weeks and months to come in the areas of Machine Learning with SparkR,SparklyR or pySpark.</p>
<p>Watch this space!!!</p>
<p><em>Disclaimer: This article represents the author’s viewpoint only and doesn’t necessarily represent IBM’s positions, strategies or opinions</em></p>
<p>Also see</p>
<p>1. <a target="_blank" href="https://gigadom.wordpress.com/2016/06/23/introducing-qcsimulator-a-5-qubit-quantum-computing-simulator-in-r/">Introducing QCSimulator: A 5-qubit quantum computing simulator in R</a><br>
2. <a target="_blank" href="https://gigadom.wordpress.com/2015/10/02/natural-language-processing-what-would-shakespeare-say/">Natural Processing Language : What would Shakespeare say?</a><br>
3. <a target="_blank" href="https://gigadom.wordpress.com/2016/04/02/introducing-cricket-package-yorkr-part-1-beaten-by-sheer-pace/">Introducing cricket package yorkr:Part 1- Beaten by sheer pace!</a><br>
4. <a target="_blank" href="https://gigadom.wordpress.com/2013/07/08/a-closer-look-at-robot-horse-on-a-canter-in-android/">A closer look at “Robot horse on a Trot! in Android”</a><br>
5.  <a target="_blank" href="https://gigadom.wordpress.com/2016/05/14/re-introducing-cricketr-an-r-package-to-analyze-performances-of-cricketers/">Re-introducing cricketr! : An R package to analyze performances of cricketers</a><br>
6.   <a target="_blank" href="https://gigadom.wordpress.com/2014/10/11/whats-up-watson-using-ibm-watsons-qaapi-with-bluemix-nodeexpress-part-1/">What’s up Watson? Using IBM Watson’s QAAPI with Bluemix, NodeExpress – Part 1</a><br>
7.  <a target="_blank" href="https://gigadom.wordpress.com/2012/05/11/deblurring-with-opencv-weiner-filter-reloaded/">Deblurring with OpenCV: Wiener filter reloaded</a></p>
<p>To see all my posts check<br>
<a target="_blank" href="https://gigadom.wordpress.com/aa-2/">Index of posts</a></p>
<p> <a target="_blank" rel="nofollow" href="http://feeds.wordpress.com/1.0/gocomments/gigadom.wordpress.com/4758/"><img alt="" src="http://feeds.wordpress.com/1.0/comments/gigadom.wordpress.com/4758/" border="0"></a> <img alt="" src="https://i1.wp.com/pixel.wp.com/b.gif?resize=1%2C1&ssl=1" border="0" data-recalc-dims="1"></p>
<p><div><div><div><div data-width="55" data-show-faces="false" data-send="true" data-layout="box_count" data-height="62" data-href="https://www.r-bloggers.com/ibm-data-science-experience-first-steps-with-yorkr/"></div></div><div><a data-url="https://www.r-bloggers.com/ibm-data-science-experience-first-steps-with-yorkr/" data-counturl="https://www.r-bloggers.com/ibm-data-science-experience-first-steps-with-yorkr/" data-count="vertical" data-text="IBM Data Science Experience:  First steps with yorkr" class="twitter-share-button" data-via="rbloggers" href="https://twitter.com/share"></a></div><div></div></div><div></div></div>
<div>
<div>To <strong>leave a comment</strong> for the author, please follow the link and comment on their blog: <strong><a href="https://gigadom.wordpress.com/2016/09/04/ibm-data-science-experience-first-steps-with-yorkr/"> R – Giga thoughts …</a></strong>.</div>
<hr>
<a rel="nofollow" href="https://www.r-bloggers.com/">R-bloggers.com</a> offers <strong><a rel="nofollow" href="https://feedburner.google.com/fb/a/mailverify?uri=RBloggers">daily e-mail updates</a></strong> about <a title="The R Project for Statistical Computing" rel="nofollow" href="https://www.r-project.org/">R</a> news and <a title="R tutorials" rel="nofollow" href="https://www.r-bloggers.com/?s=tutorial">tutorials</a> on topics such as: <a title="Data science" rel="nofollow" href="https://www.r-bloggers.com/?s=data%20science">Data science</a>, <a title="Big Data" rel="nofollow" href="https://www.r-bloggers.com/?s=Big%20Data">Big Data, <a title="R jobs" rel="nofollow" href="https://www.r-users.com/">R jobs</a>, visualization (<a title="ggplot and ggplot2 tutorials" rel="nofollow" href="https://www.r-bloggers.com/?s=ggplot2">ggplot2</a>, <a title="Boxplots using lattice and ggplot2 tutorials" rel="nofollow" href="https://www.r-bloggers.com/?s=boxplot">Boxplots</a>, <a title="Maps and gis" rel="nofollow" href="https://www.r-bloggers.com/?s=map">maps</a>, <a title="Animation in R" rel="nofollow" href="https://www.r-bloggers.com/?s=animation">animation</a>), programming (<a title="RStudio IDE for R" rel="nofollow" href="https://www.r-bloggers.com/?s=RStudio">RStudio</a>, <a title="Sweave and literate programming" rel="nofollow" href="https://www.r-bloggers.com/?s=sweave">Sweave</a>, <a title="LaTeX in R" rel="nofollow" href="https://www.r-bloggers.com/?s=LaTeX">LaTeX</a>, <a title="SQL and databases" rel="nofollow" href="https://www.r-bloggers.com/?s=SQL">SQL</a>, <a title="Eclipse IDE for R" rel="nofollow" href="https://www.r-bloggers.com/?s=eclipse">Eclipse</a>, <a title="git and github, Version Control System" rel="nofollow" href="https://www.r-bloggers.com/?s=git">git</a>, <a title="Large data in R using Hadoop" rel="nofollow" href="https://www.r-bloggers.com/?s=hadoop">hadoop</a>, <a title="Web Scraping of google, facebook, yahoo, twitter and more using R" rel="nofollow" href="https://www.r-bloggers.com/?s=Web+Scraping">Web Scraping</a>) statistics (<a title="Regressions and ANOVA analysis tutorials" rel="nofollow" href="https://www.r-bloggers.com/?s=regression">regression</a>, <a title="principal component analysis tutorial" rel="nofollow" href="https://www.r-bloggers.com/?s=PCA">PCA</a>, <a title="Time series" rel="nofollow" href="https://www.r-bloggers.com/?s=time+series">time series</a>, <a title="finance trading" rel="nofollow" href="https://www.r-bloggers.com/?s=trading">trading</a>) and more...
<img height="1" alt="" width="1" src="http://feeds.feedburner.com/~r/RBloggers/~4/TSHgM64uxIo"></a></div>