Spark: The Definitive Guide: Big Data Processing Made Simple by Bill Chambers & Matei Zaharia
Author:Bill Chambers & Matei Zaharia [Chambers, Bill & Zaharia, Matei]
Language: eng
Format: epub
Tags: Python, Data Modeling & Design, Computers, Java, Information Technology/Operations, Programming Languages, Computer Engineering, Data Processing, Data Mining, Databases
ISBN: 9781491912300
Google: oitLDwAAQBAJ
Publisher: O'Reilly Media, Inc.
Published: 2018-02-08T19:27:52.453004+00:00
The Spark UI
The Spark UI provides a visual way to monitor applications while they are running as well as metrics about your Spark workload, at the Spark and JVM level. Every SparkContext running launches a web UI, by default on port 4040, that displays useful information about the application. When you run Spark in local mode, for example, just navigate to http://localhost:4040 to see the UI when running a Spark Application on your local machine. If you’re running multiple applications, they will launch web UIs on increasing port numbers (4041, 4042, …). Cluster managers will also link to each application’s web UI from their own UI.
Figure 18-2 shows all of the tabs available in the Spark UI.
Download
This site does not store any files on its server. We only index and link to content provided by other sites. Please contact the content providers to delete copyright contents if any and email us, we'll remove relevant links or contents immediately.
| Access | Data Mining |
| Data Modeling & Design | Data Processing |
| Data Warehousing | MySQL |
| Oracle | Other Databases |
| Relational Databases | SQL |
Algorithms of the Intelligent Web by Haralambos Marmanis;Dmitry Babenko(8298)
Azure Data and AI Architect Handbook by Olivier Mertens & Breght Van Baelen(6730)
Building Statistical Models in Python by Huy Hoang Nguyen & Paul N Adams & Stuart J Miller(6709)
Serverless Machine Learning with Amazon Redshift ML by Debu Panda & Phil Bates & Bhanu Pittampally & Sumeet Joshi(6581)
Data Wrangling on AWS by Navnit Shukla | Sankar M | Sam Palani(6366)
Driving Data Quality with Data Contracts by Andrew Jones(6315)
Machine Learning Model Serving Patterns and Best Practices by Md Johirul Islam(6080)
Learning SQL by Alan Beaulieu(5994)
Weapons of Math Destruction by Cathy O'Neil(5779)
Big Data Analysis with Python by Ivan Marin(5361)
Data Engineering with dbt by Roberto Zagni(4356)
Solidity Programming Essentials by Ritesh Modi(4005)
Time Series Analysis with Python Cookbook by Tarek A. Atwan(3863)
Pandas Cookbook by Theodore Petrou(3574)
Blockchain Basics by Daniel Drescher(3292)
Hands-On Machine Learning for Algorithmic Trading by Stefan Jansen(2905)
Feature Store for Machine Learning by Jayanth Kumar M J(2813)
Learn T-SQL Querying by Pam Lahoud & Pedro Lopes(2796)
Mastering Python for Finance by Unknown(2744)
