Beginning Apache Pig by Balaswamy Vaddeman

Beginning Apache Pig by Balaswamy Vaddeman

Author:Balaswamy Vaddeman
Language: eng
Format: epub
Publisher: Apress, Berkeley, CA


Table

You can specify a Hive table as a type of feed. You can also specify partitions.

Here’s the syntax:

catalog:$database-name:$table-name#partition-key=partition-value

The following code defines a ratings table in the emp_db database with the partition key as the date:

<table uri="catalog:emp_db:ratings#date=${YEAR}-${MONTH}-${DAY}" />

Frequency

The <frequency> tag specifies the frequency of the data feed. You can use minutes, hours, days, and months as frequency variables.

The following tag specifies the feed to be generated once every day:

<frequency>days(1)</frequency>



Download



Copyright Disclaimer:
This site does not store any files on its server. We only index and link to content provided by other sites. Please contact the content providers to delete copyright contents if any and email us, we'll remove relevant links or contents immediately.