Hands-On Big Data Analytics with PySpark by Rudy Lai

Author:Rudy Lai
Language: eng
Format: epub
Tags: COM018000 - COMPUTERS / Data Processing, COM004000 - COMPUTERS / Intelligence (AI) and Semantics, COM062000 - COMPUTERS / Data Modeling and Design
Publisher: Packt Publishing
Published: 2019-03-29T07:08:52+00:00

Testing our custom RDD

Let's start this test to check if this has created our RDD. By doing this, we can extend our parent RDD and add behavior to our RDD. This is shown in the following screenshot:

"C:\Program Files\Java\jdk-12\bin\java.exe" "-javaagent:C:\Program Files\JetBrains\IntelliJ IDEA 2018.3.5\lib\idea_rt.jar=51687:C:\Program Files\JetBrains\IntelliJ IDEA 2018.3.5\bin" -Dfile.encoding=UTF-8 -classpath C:\Users\Sneha\IdeaProjects\Chapter07\out\production\Chapter07 com.company.Main

Process finished with exit code 0

In the next section, we'll be using RDD in an immutable way.

Download

Copyright Disclaimer:
This site does not store any files on its server. We only index and link to content provided by other sites. Please contact the content providers to delete copyright contents if any and email us, we'll remove relevant links or contents immediately.