Data Pipelines & Computation Engines

Dataiku offers many ways to efficiently rebuild datasets so that downstream outputs reflect the latest upstream data. In addition to the refdoc:flow/building-datasets article in the reference documentation, these articles dive deeper into how to create effective data pipelines.

Concepts

• Concept | Computation engines
• Concept | Build modes
• Concept | Data pipeline optimization
• Concept | Where computation happens in Dataiku

Tutorials

• Tutorial | Build modes
• Tutorial | Recipe engines

How-tos

• How-to | Access job information
• How-to | Enable SQL pipelines in the Flow