Serverless ETL and Analytics with AWS Glue by Vishal Pathak Subramanya Vajiraya Noritaka Sekiyama Tomohiro Tanaka Albert Quiroga Ishan Gaur

Author:Vishal Pathak, Subramanya Vajiraya, Noritaka Sekiyama, Tomohiro Tanaka , Albert Quiroga , Ishan Gaur
Language: eng
Format: epub
Publisher: Packt Publishing Pvt Ltd
Published: 2022-07-22T00:00:00+00:00

Once a table is governed, the ways to interact with it change, with several important considerations to make, as follows:

S3 objects within it should be considered immutable. Even though through S3 you could potentially upload a new version of an object, this will not update the Lake Formation manifest and thus could potentially break the table’s functionality.

Whenever data is written to the table, the UpdateTableObjects API must be called to update the manifest with the new S3 objects.

In order to read from the table, any of the Lake Formation querying API calls should be used rather than simply reading from the S3 location. This will ensure the right S3 objects are queried, as well as applying the security access models defined in Lake Formation.

Download

Copyright Disclaimer:
This site does not store any files on its server. We only index and link to content provided by other sites. Please contact the content providers to delete copyright contents if any and email us, we'll remove relevant links or contents immediately.