Guides

If you have your working environment set up, and are already familiar with the principles behind ETL, it is now time to start using ETL!

In this section you will find guides for different use cases and tasks you might want to perform with ETL.

Quick reference

•   Add data to the catalog

  ---

  Create all ETL steps to import a new dataset to our catalog.

•   Upgrade indicators

  ---

  Whenever you update a dataset, you need to upgrade all indicator references so that all charts reflect this update.

•   Wizard

  ---

  Wizard is a self-contained webapp that helps you with most of your ETL work.

•   our CLI

  ---

  We also have a CLI, so that you can do some tasks from your terminal.

•   Using different environments

  ---

  All our tooling can be executed in different environments. Learn how to use them.

•   Staging servers

  ---

  What are they? And how do we actually work with them?

•   Backport datasets

  ---

  We use backporting to add legacy datasets to our catalog.

•   Import private datasets

  ---

  Import private datasets.

•   Harmonize country names

  ---

  Standardize country names to use OWID's defaults.

•   Edit the docs

  ---

  Improve, update our documentation.

•   OpenAI setup

  ---

  We use backporting to add legacy datasets to our catalog.