R Web Scraping Quick Start Guide by Olgun Aydin

Author:Olgun Aydin [Olgun Aydin]
Language: eng
Format: epub, mobi
Tags: COM018000 - COMPUTERS / Data Processing, COM021030 - COMPUTERS / Databases / Data Mining, COM062000 - COMPUTERS / Data Modeling and Design
Publisher: Packt
Published: 2018-10-31T06:41:38+00:00

Article preview

In following part, we will also write XPath rules to collect this information, and then will be writing R script to collect the information, and at final step we will play with data to create some charts and plots.

Writing XPath rules

In this part, we are going to create our XPath rules to parse the HTML document we will collect:

First of all, we will write XPath rules to collect information from the left-hand side of the web page, in other words, to collect information about how many articles there are for each categories.

Let's navigate the landing page of the website devveri.com. As we exercised in previous chapter, will use Google Developer Tools to create and test XPath rules.

To use Google Developer Tools, we can right-click on an element, which we are interested in extracting data from.

Click Inspect Element. On the following screenshot, we marked the elements regarding categories:

Download

Copyright Disclaimer:
This site does not store any files on its server. We only index and link to content provided by other sites. Please contact the content providers to delete copyright contents if any and email us, we'll remove relevant links or contents immediately.