Concept: Computation Engine¶

Tip

This content is also included in the free Dataiku Academy course, Basics 102, which is part of the Core Designer learning path. Register for the course there if you’d like to track and validate your progress alongside concept videos, summaries, hands-on tutorials, and quizzes.

Computation has a cost. In DSS, there are computation strategies that help with reducing this cost. DSS can perform the computation using the DSS engine or push down the computation to external engines. DSS acts as an orchestrator of your connections’ engines, delegating the computation to these connections when possible.

../../../_images/dss-computation-delegation.png

When transforming your dataset, you are actually working with a sample of it. When you are ready to apply transformation steps to the whole dataset, you click Run. Then, you can select a computation engine that best fits the underlying data storage and the operation you are applying to the dataset.

../../../_images/computation-engine-options.png

Learn More¶

In this lesson, you learned about ways to optimize computation when working in Dataiku DSS. Continue learning about the Basics of Dataiku DSS by visiting Concept: Jobs.