Lesson 4.3

Automating a recurring data job

The last step is turning the analysis into a script that runs on a schedule, logs what it did, and fails loudly.

11mBeginner13,576 students
Video thumbnail for Automating a recurring data job

Sign in to watch this lesson

Browsing is free. Create an account to play videos and track your progress.

Overview

The last step is turning the analysis into a script that runs on a schedule, logs what it did, and fails loudly.

What this lesson covers

  • Turn a notebook into a parameterised script
  • Log progress and failures usefully
  • Schedule the job and alert when it breaks

This lesson sits in Reproducible Workflows, part of Python for Data Work. It assumes what came before it and leads directly into the next lesson in the module.

In this lesson you will:

  • Turn a notebook into a parameterised script
  • Log progress and failures usefully
  • Schedule the job and alert when it breaks