Plugins in Dataiku DSS

Dataiku DSS contains native visual components that allow you to connect to data, process data, train models, and so on. At the same time, Dataiku allows you the flexibility of implementing custom components and sharing them with others. These custom components are packaged as plugins.

There are four ways to access plugins in Dataiku DSS:

  • By installing them from the Dataiku plugin store,

  • By developing them within Dataiku DSS,

  • By uploading .zip files that package plugins, and

  • By fetching them from a git repository

To develop a plugin, you program the backend using a language like Python or R. Then, you create the user interface by configuring parameters in .json files. For this lesson, we’ll focus on plugins that are already available in the plugin store.

Tip

This content is also included in a free Dataiku Academy course on the Plugin Store, which is part of the Advanced Designer learning path. Register for the course there if you’d like to track and validate your progress alongside concept videos, summaries, hands-on tutorials, and quizzes.

Plugin Components

A plugin in Dataiku DSS can contain one or more related components. Each plugin component consists of a graphical user interface (GUI) wrapper around code, and it exposes a single type of Dataiku element, such as a dataset, recipe, webapp, processor, and more.

../../_images/plugin_components.png

As an example, let’s take a look at the US Census plugin, which consists of six components — three visual recipes and three dataset connectors.

../../_images/plugin_store_UScensus_components.png

We can use the visual recipes from this plugin to enrich a dataset with one of the hundreds of socio-demographic variables from the US Census Bureau. We can also use the dataset connectors to build and use the US Census data directly within Dataiku DSS.

A plugin’s documentation is available on the Plugins page of the Dataiku website. The plugin’s page also includes a link to its source code on GitHub. Note that all plugins from the Dataiku DSS Plugin store are open source.

../../_images/plugin_doc_page.png

Authorization for Plugin Installation

A DSS admin or other user with the appropriate rights must install a plugin on the DSS instance before anyone can use the plugin.

  • As an administrator on a shared instance, you have the permissions to install and develop plugins.

  • As a user working on your local instance of Dataiku DSS, you have the permissions to install and develop plugins.

  • As a user on a shared instance, your rights to install and develop plugins will depend on the rights that an admin assigns to you.

From the Administration section, under the Security tab, we can see how permissions are distributed among users. For example, we can see that the administrators have all rights, while groups like data-team and readers have limited rights that prevent them from developing or installing plugins.

../../_images/plugin_group_auth_matrix.png

Plugin Usage

Once installed, the plugin is now available to the DSS instance where you installed it. It is available to all users of the instance. For example, the installed US Census plugin can be used directly and visually from the Flow to enrich some input data or connect to US census data. Let’s now explore how to use some plugin components.

Using a Visual Recipe Component

The plugin’s visual recipe components can be accessed by clicking the +Recipe button in the Flow, or by accessing them in the right panel.

../../_images/plugin_store_access_recipes.png

The plugin’s visual recipe works like any other visual recipe. That is, we can select input parameters in the recipe settings and then run the recipe.

../../_images/plugin_store_UScensus_settings.png

Using a Dataset Connector Component

To use one of the dataset connector components, Census USA, we can use the + Dataset button to access new dataset connectors for connecting to US census data.

../../_images/plugin_store_access_dataset_connectors.png

Then we will input values for parameters such as the states we want to get data from, the geography granularity, and the fields we want to extract. At the backend, Dataiku DSS fetches the data from the US census website.

../../_images/plugin_dataset_connector_settings.png

Using a Processor Component

The Zipcode geocoding plugin includes a processor component called zipcode geocoding that is accessible from the Prepare recipe.

../../_images/plugin_zipcode_processor.png

Using this processor, we can extract geographic coordinates from location data such as country and zip code. This processor step works just like any other in the Prepare recipe!

Learn More

To learn more about the plugin store, including through hands-on exercises, please register for the free Academy course on this subject found in the Advanced Designer learning path.

You can also find out more in this article on plugin store usage.