Data Pipelines & Computation Engines

Dataiku offers many ways to efficiently rebuild datasets so that downstream outputs reflect the latest upstream data. In addition to the Rebuilding Datasets article in the reference documentation, these articles dive deeper into how to create effective data pipelines.

Concepts

• Concept | Computation engines
• Concept | Jobs
• Concept | Build modes
• Concept | Data pipeline optimization
• Concept | Where computation happens in Dataiku

Tutorials

• Tutorial | Build modes
• Tutorial | Recipe engines

How-tos

• How-to | Enable SQL pipelines in the Flow