Official Google Cloud Certified Professional Machine Learning Engineer Study Guide by Mona Mona;Ramamurthy Pratap; & Pratap Ramamurthy

Author:Mona, Mona;Ramamurthy, Pratap; & Pratap Ramamurthy [Mona, Mona & Ramamurthy, Pratap]
Language: eng
Format: epub
Publisher: John Wiley & Sons, Incorporated
Published: 2023-11-21T00:00:00+00:00

FIGURE 8.1 Google Cloud data and analytics overview

Let's look at the various steps.

Collect

If you need to collect batch or streaming data from various sources such as IoT devices, e‐commerce websites, or any third‐party applications, this can be done by Google Cloud services.

Pub/Sub and Pub/Sub Lite for real‐time streaming: Pub/Sub is a serverless scalable service (1 KB to 100 GB with consistent performance) for messaging and real‐time analytics. Pub/Sub can both publish and subscribe across the globe, regardless of where your ingestion or processing applications live. It has deep integration with processing services (Dataflow) and analytics services (BigQuery). You can directly stream data from a third party to BigQuery using Pub/Sub. Pub/Sub Lite is also a serverless offering that optimizes for cost over reliability. Pub/Sub Lite is good for workloads with more predictable and consistent load.

Datastream for moving on premise Oracle and MySQL databases to Google Cloud data storage: Datastream is a serverless and easy‐to‐use change data capture (CDC) and replication service. It allows you to synchronize data across heterogeneous databases and applications reliably and with minimal latency and downtime. Datastream supports streaming from Oracle and MySQL databases into Cloud Storage. Datastream is integrated with Dataflow, and it leverages Dataflow templates to load data into BigQuery, Cloud Spanner, and Cloud SQL.

BigQuery Data Transfer Service: You can load data from the following sources to BigQuery using the BigQuery Data Transfer Service: Data warehouses such as Teradata and Amazon Redshift

External cloud storage provider Amazon S3

Google software as a service (SaaS) apps such as Cloud Storage, Google Ads, etc.

Download

Copyright Disclaimer:
This site does not store any files on its server. We only index and link to content provided by other sites. Please contact the content providers to delete copyright contents if any and email us, we'll remove relevant links or contents immediately.