<p><div><div><div><div data-show-faces="false" data-height="21" data-width="100" data-layout="button_count" data-send="true" data-href="https://www.r-bloggers.com/natural-language-processing-for-non-english-languages-with-udpipe/"></div></div><div></div></div><div></div></div>
<div>
(This article was first published on <strong><a href="http://www.bnosac.be/index.php/blog/72-natural-language-processing-for-non-english-languages-with-udpipe"> bnosac :: open analytical helpers</a></strong>, and kindly contributed to <a rel="nofollow" href="https://www.r-bloggers.com/">R-bloggers)</a> </div>
<p>BNOSAC is happy to announce the release of the udpipe R package (<a rel="nofollow" href="https://bnosac.github.io/udpipe/en" target="_blank">https://bnosac.github.io/udpipe/en</a>) which is a Natural Language Processing toolkit that provides language-agnostic ‘tokenization’, ‘parts of speech tagging’, ‘lemmatization’, ‘morphological feature tagging’ and ‘dependency parsing’ of raw text. Next to text parsing, the package also allows you to train annotation models based on data of ‘treebanks’ in ‘CoNLL-U’ format as provided at <a rel="nofollow" href="http://universaldependencies.org/format.html." target="_blank">http://universaldependencies.org/format.html.</a></p>
<h3>Language models</h3>
<p>The package provides direct access to language models trained on more than 50 languages. The following languages are directly available:</p>
<p><strong>afrikaans, ancient_greek-proiel, ancient_greek, arabic, basque, belarusian, bulgarian, catalan, chinese, coptic, croatian, czech-cac, czech-cltt, czech, danish, dutch-lassysmall, dutch, english-lines, english-partut, english, estonian, finnish-ftb, finnish, french-partut, french-sequoia, french, galician-treegal, galician, german, gothic, greek, hebrew, hindi, hungarian, indonesian, irish, italian, japanese, kazakh, korean, latin-ittb, latin-proiel, latin, latvian, lithuanian, norwegian-bokmaal, norwegian-nynorsk, old_church_slavonic, persian, polish, portuguese-br, portuguese, romanian, russian-syntagrus, russian, sanskrit, serbian, slovak, slovenian-sst, slovenian, spanish-ancora, spanish, swedish-lines, swedish, tamil, turkish, ukrainian, urdu, uyghur, vietnamese</strong></p>
<p>We hope that the package will allow other R users to build natural language applications on top of the resulting parts of speech tags, tokens, morphological features and dependency parsing output. And we hope in particular that applications will arise which are not limited to English only (like the <a rel="nofollow" href="https://cran.r-project.org/package=textrank" target="_blank">textrank</a> R package or the <a rel="nofollow" href="https://cran.r-project.org/package=cleanNLP" target="_blank">cleanNLP</a> package to name a few)</p>
<p><a rel="nofollow" href="https://bnosac.github.io/udpipe/en/index.html" target="_blank"><img alt="udpipe website" src="https://i2.wp.com/www.bnosac.be/images/bnosac/blog/udpipe-website.png?w=456" data-recalc-dims="1"></a></p>
<h3>Easy installation, great docs</h3>
<ul>
<li>Note that the package has no external software dependencies (no java nor python) and depends only on 2 R packages (Rcpp and data.table), which makes the package easy to install on any platform. The package is available for download at <a rel="nofollow" href="https://cran.r-project.org/package=udpipe" target="_blank">https://CRAN.R-project.org/package=udpipe</a> and is developed at <a rel="nofollow" href="https://github.com/bnosac/udpipe." target="_blank">https://github.com/bnosac/udpipe.</a> A small docusaurus website is made available at <a>https://bnosac.github.io/udpipe/en</a></li>
<li><a rel="nofollow" href="https://bnosac.github.io/udpipe/en" target="_blank"></a>We hope you enjoy using it and we would like to thank Milan Straka for all the efforts done on UDPipe as well as all persons involved in http://universaldependencies.org</li>
</ul>
<h3>Training on Text Mining with R</h3>
<p>Are you interested in text mining. Feel free to register for the <strong>upcoming course on text mining</strong></p>
<ul>
<li>Location &amp; Time: March 22-23 2018 in Leuven, Belgium</li>
<li>Register at <a rel="nofollow" href="https://lstat.kuleuven.be/training/coursedescriptions/text-mining-with-r" target="_blank">https://lstat.kuleuven.be/training/coursedescriptions/text-mining-with-r</a></li>
</ul>
<h3>Example</h3>
<p>Want to get started with it right away? Example annotating Polish text in UTF-8 encoding, but you can pick any language of choice listed above. Enjoy.</p>
<pre>library(udpipe)<br>model &lt;- udpipe_download_model(language = &quot;polish&quot;)<br>model &lt;- udpipe_load_model(file = model$file_model)<br>x &lt;- udpipe_annotate(model, x = &quot;Budynek otrzymany od parafii wymaga remontu, a placówka nie otrzymała jeszcze żadnej dotacji.&quot;)<br>x &lt;- as.data.frame(x)<br>x</pre>
<p><img alt="udpipe example polish" src="https://i1.wp.com/www.bnosac.be/images/bnosac/blog/udpipe-example-polish.png?w=456" data-recalc-dims="1"></p>
	<p>
<div>
<div>To <strong>leave a comment</strong> for the author, please follow the link and comment on their blog: <strong><a href="http://www.bnosac.be/index.php/blog/72-natural-language-processing-for-non-english-languages-with-udpipe"> bnosac :: open analytical helpers</a></strong>.</div>
<hr>
<a rel="nofollow" href="https://www.r-bloggers.com/">R-bloggers.com</a> offers <strong><a rel="nofollow" href="https://feedburner.google.com/fb/a/mailverify?uri=RBloggers">daily e-mail updates</a></strong> about <a rel="nofollow" href="https://www.r-project.org/" title="The R Project for Statistical Computing">R</a> news and <a rel="nofollow" href="https://www.r-bloggers.com/search/tutorial" title="R tutorials">tutorials</a> on topics such as: <a rel="nofollow" href="https://www.r-bloggers.com/search/data%20science" title="Data science">Data science</a>, <a rel="nofollow" href="https://www.r-bloggers.com/search/Big%20Data" title="Big Data">Big Data, <a rel="nofollow" href="https://www.r-users.com/" title="R jobs">R jobs</a>, visualization (<a rel="nofollow" href="https://www.r-bloggers.com/search/ggplot2" title="ggplot and ggplot2 tutorials">ggplot2</a>, <a rel="nofollow" href="https://www.r-bloggers.com/search/boxplot" title="Boxplots using lattice and ggplot2 tutorials">Boxplots</a>, <a rel="nofollow" href="https://www.r-bloggers.com/search/map" title="Maps and gis">maps</a>, <a rel="nofollow" href="https://www.r-bloggers.com/search/animation" title="Animation in R">animation</a>), programming (<a rel="nofollow" href="https://www.r-bloggers.com/search/RStudio" title="RStudio IDE for R">RStudio</a>, <a rel="nofollow" href="https://www.r-bloggers.com/search/sweave" title="Sweave and literate programming">Sweave</a>, <a rel="nofollow" href="https://www.r-bloggers.com/search/LaTeX" title="LaTeX in R">LaTeX</a>, <a rel="nofollow" href="https://www.r-bloggers.com/search/SQL" title="SQL and databases">SQL</a>, <a rel="nofollow" href="https://www.r-bloggers.com/search/eclipse" title="Eclipse IDE for R">Eclipse</a>, <a rel="nofollow" href="https://www.r-bloggers.com/search/git" title="git and github, Version Control System">git</a>, <a rel="nofollow" href="https://www.r-bloggers.com/search/hadoop" title="Large data in R using Hadoop">hadoop</a>, <a rel="nofollow" href="https://www.r-bloggers.com/search/Web+Scraping" title="Web Scraping of google, facebook, yahoo, twitter and more using R">Web Scraping</a>) statistics (<a rel="nofollow" href="https://www.r-bloggers.com/search/regression" title="Regressions and ANOVA analysis tutorials">regression</a>, <a rel="nofollow" href="https://www.r-bloggers.com/search/PCA" title="principal component analysis tutorial">PCA</a>, <a rel="nofollow" href="https://www.r-bloggers.com/search/time+series" title="Time series">time series</a>, <a rel="nofollow" href="https://www.r-bloggers.com/search/trading" title="finance trading">trading</a>) and more...
<img width="1" alt="" src="http://feeds.feedburner.com/~r/RBloggers/~4/g_4dG9IKgG4" height="1"></a></div>