Design principles & workflow
Our World in Data is a publication that makes very heavy use of data to communicate about global issues.
The best data on global issues comes from the hard work of data providers, which can be individual researchers, small research groups, or big institutions like the UN or World Bank. Since we reuse this work, we are effectively a data republisher that tries to process and understand data from a wide variety of sources, and present it to the public in a unified way.
As a data republisher, we therefore need a methodology to process, version, and maintain several datasets all the way from the original source's publication wite to our platform. And it needs to be scalable.
-
The design principles of the ETL
Learn the design principles of our data architecture.
-
Learn the different steps in ETL.
-
Data alone is not enough.
Learn more about our metadata.
-
A bit of history. Learn how we got here.