Simplify Big Data Analytics with Amazon EMR by Sakti Mishra

Author:Sakti Mishra
Language: eng
Format: epub
Publisher: Packt Publishing Limited
Published: 2022-02-18T00:00:00+00:00

You can repeat these steps to access any other web interface available in the master node or any other core and task nodes. For example, to access the JupyterHub web interface, you can configure any other local unused port to forward the request to port 9443 of the master node.

Next, you will learn how to configure SSH tunneling with dynamic port forwarding.

Setting up an SSH tunnel to the master node using dynamic port forwarding

This method is similar to SSH tunneling with local forwarding with additional configuration to make the port forwarding dynamic so that you can get the benefit of the FoxyProxy or SwitchyOmega add-ons to manage your dynamic SOCKS proxy configurations.

SOCKS proxy management tools provide features to configure the automatic filtering of URLs based on text patterns, where you can specify the master node's URL pattern for matching. These SOCKS proxy-based browser plugins can automatically turn on or off when you switch between the master node URL and other website URLs.

After you have allowed SSH inbound access to your cluster security group and collected the master node DNS and EC2 key pair, you can take the following steps for the setup:

Open a terminal window in OpenSSH.

Next, execute the following ssh command, which uses the master node's public DNS and EC2 key pair for connection and also defines the local unused port, which will be used to forward requests to all the ports of the target master node's local web server:ssh -i ~/<EC2KeyPairName>.pem -N -D 8999 hadoop@ec2-###-##-##-###.compute-1.amazonaws.com

Download

Copyright Disclaimer:
This site does not store any files on its server. We only index and link to content provided by other sites. Please contact the content providers to delete copyright contents if any and email us, we'll remove relevant links or contents immediately.