Processing Data with Google Cloud Dataflow

In this Project, you will:

Configure a Python application to create a simulated real-time data stream from historical data.

Use Apache Beam locally to test Dataflow locally.

Use Apache Beam to process data using Dataflow to create a simulated real-time dataset.

Query the simulated real-time data stream using BiqQuery.

1 hour and 15 minutes
Intermediate
No download needed
Shareable certificate
English
Desktop only

This is a self-paced lab that takes place in the Google Cloud console. In this lab you will simulate a real-time real world data set from a historical data set. This simulated data set will be processed from a set of text files using Python and Google Cloud DataFlow, and the resulting simulated real-time data will be stored in Google BigQuery.

Skills you will develop

  • Bigquery

  • Data Analysis

  • Apache Beam

  • Dataflow

How Projects work

Learn a new tool or skill in an interactive, hands-on environment

You'll gain access to software and tools in a cloud workspace - no download required

Offered by

Placeholder

Google Cloud

Frequently Asked Questions

In Projects, you'll complete an activity or scenario by following a set of instructions in an interactive hands-on environment. Projects are completed in a real cloud environment and within real instances of various products as opposed to a simulation or demo environment.

By purchasing a Project, you'll get everything you need to complete the Project including temporary access to any product required to complete the Project.

Even though Projects are technically available on mobile devices, we highly recommend that you complete Projects on a laptop or desktop only.

Yes, you can download and keep any of your created files from the Project. To do so, please make sure you save any files and work to your device before exiting the product environment.

Projects are not eligible for refunds. See our full refund policy.

Financial aid is not available for Projects.

In rare instances, Projects may be taken down for maintenance or other reasons. If you are experiencing any issues, please contact us.

Auditing is not available for Projects.

At the top of the page, you can view the experience level recommended for this Project.

Yes, everything you need to complete your Project will be available in your browser.