Concept | Dataiku APIs#

In this article, you will learn about APIs in Dataiku.

The value of APIs#

Your first introduction to Dataiku may have been through its visual representations of datasets, recipes, and models.

For many use cases, these visual, point-and-click tools can quickly get the job done, while also opening avenues for collaboration with a much broader set of colleagues.

As a coder though, you never want a visual interface to restrict the scope of what’s possible. Dataiku offers APIs to enable coders to more interact with Dataiku objects and the instance itself, purely through code.

The APIs provide coders the flexibility to accomplish the same tasks offered by the visual interface (and much more) by writing code.

Actions with the Dataiku APIs#

Think of the ability to:

Read and write datasets.
Interact with folders and saved models.
Perform dynamic SQL queries.

For these kinds of actions, the Dataiku APIs take care of the low-level engineering needed to connect to Dataiku objects. However, this is just the beginning of what’s possible.

You can also use the APIs to:

Create and manage projects, groups, and users.
Build Flows and check the status of jobs and scenarios.
Manage the schema, metadata, and partitioning of datasets.

For these kinds of actions, the Dataiku APIs allow you to programmatically drive the operation of your instance and the projects kept there.

Let’s begin with the first set of actions, such as reading and writing datasets.

Whether using Python or R, these methods are found in a package named dataiku. You’ve already seen it at the top of any default code recipe.

The second set of actions, those that allow you to drive the operation of your instance or projects, are part of the public API. The public API is an HTTP REST API, but it’s recommended to access it through the Python API client called dataikuapi.

If working inside Dataiku, you won’t even need to explicitly load this package. You’ll be using it under the hood.
If working outside Dataiku, know that the dataikuapi package is available for public download. You will learn more about this in another lesson on using the APIs outside of Dataiku.

Now that you have a high-level understanding of APIs in Dataiku, let’s start investigating how to use methods from the dataiku package while working inside the platform.

APIs outside Dataiku#

No matter which API you are calling, the choice of coding within Dataiku or outside of it remains yours.

The APIs are available “out-of-the-box” inside Dataiku, but you can also import these packages outside of Dataiku. We’ll show how this can be done in another lesson.