Tutorial | Governance basics

Get started

Dataiku’s Govern node enables project managers, lines of business, and compliance managers to track the progress of AI initiatives at the scale of an enterprise. Take your first steps as a Govern node end user!

Objectives

In this tutorial, you will:

• Surface metadata of items from connected Dataiku nodes in a centralized location.

• Add a governance layer to chosen items.

• Move items through governance workflows.

• Organize governed projects under business initiatives.

• Continue governing as your Dataiku items evolve.

Prerequisites

To reproduce the steps outlined in this tutorial, you will need:

• Dataiku 14.2 or later.

• A Dataiku Govern node connected to a Design node.

Caution

By its nature, effective AI governance requires close collaboration between many individuals of diverse responsibilities. Completing governance tutorials may require you to perform actions outside your own day-to-day activities. If you find yourself lacking the permissions to complete certain actions, reach out to your instance administrator. Otherwise, read along to simulate the suggested steps.

Create the project

1. From the Dataiku Design homepage, click + New Project.

2. Select Learning projects.

3. Search for and select Governance Basics.

4. If needed, change the folder into which the project will be installed, and click Create.

5. From the project homepage, click Go to Flow (or type g + f).

Note

You can also download the starter project from this website and import it as a zip file.

Use case summary

You’ve just created a project in the Design node, Dataiku’s sandbox environment for building analytics, models, and agents. Your goal is to apply a governance framework to this project using the Govern node.

The contents of this project aren’t important. Consider it a stand-in for the kind of projects you’ll be governing. Using this basic project as a demonstration, you’ll be able to understand how the Govern node can fit into your AI governance strategy.

Let’s get started!

1. On the Design node, navigate to the Governance Basics project you just created.

2. On the project homepage, next to the title, click the pencil () icon to rename the project <YOUR INITIALS> Governance Basics to make it easier to identify as your own.

3. From the waffle () menu in the top navigation bar of the Design node, select Dataiku Govern.

Tip

Throughout this tutorial, you’ll often move between the Govern and Design nodes. Keep both tabs open to ease switching back and forth!

Surface Dataiku items within the Govern node

Before taking any actions, it’s important to recognize how the Govern node surfaces the metadata of items from connected Dataiku nodes.

Start at the Govern homepage

Begin at the homepage of the Govern node.

1. If not already there, click the home () icon in the top navigation bar of the Govern node.

2. Recognize the presence of the following pages:

   • Governable items

   • Registries for models, bundles, and possibly GenAI

   • Business initiatives

   • Governed projects

When you finish this tutorial, you’ll understand the purpose of each of these pages.

Important

Your experience with the Govern node may differ depending on whether you have a standard or advanced license. An advanced license allows for greater customization, as well as greater capabilities with respect to GenAI. Nevertheless, the foundations covered in this tutorial apply equally to all users.

Review an inbox of governable Dataiku items

An email service has a spam filter controlling which mails enter the inbox. Similarly, your Govern node administrator may define controls over what items appear in your governance “inbox.” The Governable items page serves as that inbox. It surfaces items eligible for governance from all connected Dataiku nodes. For example:

• The administrator might automatically hide certain items so they never crowd your inbox.

• Alternatively, the administrator might automatically govern certain items, bypassing the inbox entirely.

The project you just created is an ungoverned Dataiku item from a synced Design node. Unless your administrator has defined a rule saying otherwise, this project should appear on the Governable items page.

1. Either from the homepage or directly from the top navigation bar, navigate to the Governable items () page.

2. Recognize the accordion menus of surfaced Dataiku items, including projects, bundles, saved models, etc.

3. In the Projects section, find your Governance Basics project.

4. If needed, use the search box to find it.

5. Review the project’s metadata in the Source objects () tab of the right details panel.

6. Confirm in the Related objects section that this project contains one saved model, but no bundles.

Test the sync between the Govern and Dataiku nodes

The Govern node actively tracks certain types of items from connected Dataiku nodes. Bundles are one such item. Add a bundle to the project, and confirm the Govern node recognizes this update.

1. Return to the Design node, and open your version of the Governance Basics project.

2. From the More Options () menu of the top navigation bar, select Bundles.

3. Click + New Bundle.

4. Name it v1.

5. Click Create.

6. Return to the Governable items () page of the Govern node.

7. Select your Governance Basics project.

8. Confirm the presence of the v1 bundle in the related objects section of the Source objects () tab. (Refresh the page if needed).

Tip

You’ll notice the presence of a icon, indicating that the project, bundle, and model aren’t governed. You’ll understand this soon!

Filter governable items

At the scale of an enterprise, you might have thousands of items you could govern. Accordingly, it’s worth getting familiar with the search, hiding, and filtering controls at the top of Govern node pages.

For example, the project you created on the Design node includes a specific tag: govern-training. Filter for ungoverned projects with this specific tag.

1. From the Governable items () page, click the Add Filter () icon.

2. Click the plus () icon > Condition to add a condition.

3. Create a filter where the field value Tags does contain the value govern-training.

4. Click Save. Name it govern-training tag, and click Save again.

5. Click Close on the filter dialog.

6. Observe how only items with this project tag remain.

Explore registries of Dataiku items

For now, resist the temptation to govern the project you’ve created. Complete the tour of the other key pages in the Govern node first.

The registry pages centralize all Dataiku items of a respective type into one location. From one particular registry, an organization can see all its models, bundles, or GenAI items. The ability to filter these lists in various ways makes these registries watchtowers for your data and AI initiatives.

1. From the top navigation bar of the Govern node, navigate to the Model registry ().

2. Recognize that you can filter the registry in many ways, including to show only deployed models ().

3. Find your version of the Governance Basics project, and expand the accordion menus to drill down into the model and model versions inside it.

4. Select the active model version () by clicking on its name.

5. Explore the right Details panel options, including the Model metrics () tab to review metrics of the model version.

   

6. Repeat the same process for the Bundle registry (), or, if available to you, the GenAI registry (). You’ll find these pages function just like the model registry.

Tip

Remember that the Govern node surfaces items from all connected nodes. The Dataiku instance (node ID) column reports which node the item comes from.

Add a governance layer to Dataiku items

In the registry pages, you likely noticed a governance status for all items. Beyond surfacing metadata of synced items from Dataiku nodes, the first action you’ll often take in the Govern node is adding a governance layer to such items. In other words, you’ll choose which Dataiku items you want to govern.

Important

Recall that instance-level governance settings mediate the end user experience. This tutorial happens to use an instance where the Govern node administrator has recommended all item types to be governed according to the Dataiku Standard template. While this is a reasonable choice, your own administrator may have a different set of rules in place.

Focus on governed projects

First, check if your Govern node already has projects with an active governed status.

1. From the top navigation bar of the Govern node, navigate to the Governed projects () page.

2. Your page might be empty. It could also have projects that other users sharing the space have chosen to govern.

3. If you have projects here, feel free to explore this page further, recognizing new terminology like template, workflow, and business initiative.

Tip

Once you govern your first project, it will appear on this page!

Govern your first Dataiku project

Add a governance layer to the Design node project you initially created.

1. Using the top navigation bar of the Govern node, navigate to the Governable items () page.

2. In the Projects menu, find your version of the Governance Basics project.

3. At the end of its row, click the gavel () to govern it.

4. Select Govern this item.

5. Click Start.

Now you have some choices to make about how to govern the item, in this case, a project.

1. For the project definition, confirm you’ve selected Save as a new Govern project.

2. For the project template, select the Dataiku Standard template.

3. The project’s child items may follow Instance rules like the screenshot below, but this may vary.

4. In any case, click Override the default instance rules to maintain consistency with the tutorial.

   

5. Click Govern and Edit Rules.

Tip

We’ll return to explaining terms like templates, child items, and business initiatives!

Find the source objects of Govern items

You should now be looking at the governance settings for child items of the Govern project, which you’ve just created. Before making changes, step back for a moment. It’s important to distinguish between synced Dataiku source items and capital “G” Govern items.

• The Govern node syncs the metadata of Dataiku items (such as projects, models, bundles, and GenAI items) from connected Dataiku nodes. These items are the actual assets built by teams of data scientists, engineers, and analysts.

• The Govern node presents the choice to govern these Dataiku source items, thereby creating Govern items. Although a Govern item includes the metadata of its Dataiku source item, these objects exist only in the Govern node.

To better illustrate this distinction, consider what happens when you delete a Govern project.

1. Return to the Governable items () page, and confirm the absence of your Governance Basics project (since it’s now governed, it’s no longer in your inbox).

2. Then navigate to the Governed projects () page.

3. Find your version of the Governance Basics project, and click on its name to open your first capital “G” Govern item, in this case, a Govern project.

4. Navigate to the Source objects panel.

5. Recognize that the source of this governed item is your Design node project.

6. In the item header, click the vertical dots () > Delete Govern project.

   

7. Read the confirmation that this action doesn’t delete the original Dataiku project found in the Design node, and then click Delete Govern Project.

8. Return to the Governable items () page to confirm your Dataiku project is once again available to be governed.

Tip

Not every Govern item necessarily has a Dataiku source item. Later, you’ll learn about pure Govern node items, such as business initiatives, that exist only in the Govern node.

Understand custom rules

Although yours may have differed, the first walkthrough of governing the project specified that the child items would be governed according to the instance rules. Compare that experience to governing the same project a second time, having previously overridden the default instance rules on this project.

1. From the Governable items () page, find your Governance Basics project, and click the gavel () to govern it again.

2. Once more, select Govern this item, and click Start.

3. Apply the same Dataiku Standard template to the new Govern project.

4. Recognize that the project’s child items now follow Custom rules.

5. Click Govern and Exit to add the governance layer again.

   

6. Confirm your project’s return to the Governed projects () page.

7. Navigate to the Model registry () or Bundle registry () pages.

8. In either case, find your governed Governance Basics project, and expand its accordion menu to see that the project’s child items aren’t governed.

Govern with respect to the item hierarchy

At this point, you’ve only governed the project (using custom rules defined at the project level). Try governing the project’s child items, such as a model version.

1. Navigate to the Model registry () page.

2. Find your version of the Governance Basics project.

3. Expand the accordion menus until reaching the project’s active saved model version ().

4. At the end of its row, click the gavel () to govern it.

5. Following the item hierarchy, recognize that you’ll first need to govern the parent saved model before the child saved model version.

6. Select Govern this item.

7. Click Start.

Governing the child items introduces a new category of rules: project rules.

• Recall that the tutorial first overrode the instance rules at the project level.

• Therefore, the project follows its own custom rules.

• As a consequence, the governance settings of the parent project now define the rules for the child items. In other words, the child items follow project rules.

In this case, the custom rules defined at the project level currently define a rule of “do nothing” for child items, leaving you free to make your own choices.

1. Govern the parent model according to the Dataiku Standard template.

2. Recognize the child model version will follow a project rule of “do nothing.”

3. Click Govern and Next.

   

4. Govern the selected saved model version according to the Dataiku Standard template.

5. Click Govern and Exit.

Use governance workflows

You’ve now added a governance layer to a Dataiku project, its child model, and model version. When doing so, you applied a specific governance template, in this case, the Dataiku Standard template. Having done so, start exploring the contents of a capital “G” Govern item.

Add metadata to a governed item

One benefit a governance layer enables is the ability to attach various kinds of metadata to a Dataiku item. For example, you can enrich a Govern project with descriptions, scope definitions, reviewer assignments, and a schedule.

1. Navigate to the Governed projects () page.

2. Find your Governance Basics project, and click on its name to open it.

3. While in the Overview panel, click Edit in the item header.

4. Next to Sponsor, click + Add, and select yourself.

5. Copy-paste the text below into the Description field.

   This project is solely for testing the capabilities of the Govern node.
   

6. Still within the Overview panel, scroll down to the Qualification snapshot. Try selecting different values for the risk, value, cost, and feasibility ratings.

7. Feel free to edit any further fields, and click Save in the item header when finished.

Tip

It’s up to you and your organization to determine how to make the best usage of a governed item’s fields. You’ll want to focus on collecting the necessary information to make informed governance decisions.

Advance a project through a governance workflow

Beneath the overview, you’ll see a workflow of five steps in the left panel. This is the standard workflow that you selected when governing the project.

For now, advance through these steps quickly. In Tutorial | Governance lifecycle, you’ll learn how to make them a meaningful part of your governance lifecycle.

1. From the left panel of your governed project, click Exploration to view that step of the project’s workflow.

2. Click Edit in the item header.

3. Click Set As Ongoing to indicate this step is in progress.

4. For the Notes field, copy-paste the following example:

   During the Exploration phase, we need to determine the key risks and projected value of the project.
   

5. Click Set As Finished to advance to the next step in the workflow.

6. Scroll down to the Qualification step and explore the available fields.

7. Click Set As Finished, and repeat this process until your project has finished the Delivered step.

8. Feel free to move back and forth between steps to test how it works. Click Save in the item header when ready to move on.

Advance child items through a governance workflow

Govern projects aren’t the only Govern item that have a workflow. According to the standard template, Govern bundles and Govern model versions have their own governance workflows.

You can navigate to the child items in several ways, including from the Source objects panel of the parent project.

1. From your governed project page, navigate to the Source objects panel.

2. Under Related objects, expand the Saved models accordion menu.

3. Expand the project’s saved model, and select the active version ().

4. Explore the active model version’s metadata in the right panel, including the Model metrics () tab.

5. In the right panel, click Open to view the governed model version.

   

6. Recognize how the model version has its own independent overview and workflow steps, which you can progress through in a similar manner as the governed parent project.

Tip

At the top of the page representing the governed model version, recognize the nested hierarchy: project, saved model, and model version.

Review the matrix and Kanban views of governed projects

Now that your governed project includes metadata and workflow progress, explore how it’s visualized in matrix and Kanban views.

1. From the top navigation bar, return to the Governed projects () page.

2. Find your Governance Basics project, noting its Completed workflow status (having finished the Delivered step).

3. Locate your project in the qualification matrix, and click its plot point to filter for projects matching the same criteria.

4. Review the metadata you added in the Overview () tab of the Details panel.

5. Switch to the Kanban () view to represent governed projects according to workflow steps.

Tip

You can customize the matrix axes to show the qualification metrics most relevant to your governance needs.

Manage governed projects with business initiatives

As your organization scales its governance activities, you may quickly accumulate hundreds if not thousands of governed projects.

A business initiative functions as an extra level of organization to manage governance activities. It enables grouping governed projects together on some shared theme or characteristic. On top of this grouping, it provides its own workflow and space for documentation.

Create a business initiative

From the Governed projects page, you may have noticed that your governed project isn’t assigned yet to a business initiative. Create one now!

1. From the top navigation bar of the Govern node, go to the Business initiatives () page.

2. Click Create.

3. If necessary, select Dataiku Standard as the template.

4. Name it <YOUR INITIALS> Test Initiative.

5. Click Create to make a new business initiative.

Add a governed project to a business initiative

Once you have a business initiative, you can add governed projects to it.

1. Within the Overview panel of the new business initiative, click Edit in the item header.

2. For Sponsors, click + Add, and select yourself.

3. Copy-paste a description such as:

   This business initiative groups together projects testing Dataiku Govern.
   

4. Next to Governed projects, click + Add.

5. Find your Governance Basics project, and Select it.

6. Back in the header of the business initiative page, click Save.

   

7. Return to the Governed projects () page, and confirm your Governance Basics project is now part of the new initiative.

Tip

Here you started with a business initiative and added a governed project to it. You can just as well open a governed project, and add it to an existing business initiative.

Move a business initiative through a governance workflow

Business initiatives follow their own workflow. This one adheres to the standard workflow.

1. From the Govern node’s top navigation bar, go to the Business Initiatives () page.

2. Find your business initiative, and click on its name Test Initiative to open it.

3. From your business initiative page, select the Ideation workflow step.

4. Click Edit in the item header.

5. In the Ideation step, click Set As Ongoing.

6. Make any adjustments to the fields and ratings as desired.

7. Click Set As Finished to advance to the In Progress step.

8. When finished exploring, click Save in the item header.

   

9. Return to the Business Initiatives () page, and find your in-progress initiative in the matrix () and Kanban () views.

Tip

There’s no right or wrong way to structure business initiatives. Some may represent permanent entities such as departments, business units, or geographic areas, and might never reach the “Delivered” workflow step.

Others may be time-bound, like initiatives tied to a business quarter or a special project, with clear start and end dates.

Having grouped a project under a business initiative, your tour of the standard Govern node pages is complete! Next, see how to manage governance as your Dataiku items evolve.

Govern an evolving project

Governance isn’t a one-time snapshot. It’s an ongoing commitment! The remainder of this tutorial focuses on how the Govern node handles changes in the synced Dataiku items which it governs. By doing so, you’ll further clarify your understanding of Dataiku items and Govern items.

Review the governance settings of child items

Any active Dataiku project will continue to evolve. Among other changes, this means new models and bundles. How does a Govern project respond to the evolution of its source objects?

Initially, the answer depends on the instance-level governance settings defined by the Govern node administrator. However, recall that your Govern project is no longer following the instance rules. Instead, you’ve switched to custom rules, which at the moment say to “do nothing.” Change that now.

1. From the Governed projects () page, open your Governance Basics Govern project.

2. Navigate to the Governance settings panel.

3. Recognize the project’s child items follow Custom rules, and click Edit.

4. Adjust the settings to automatically govern bundles in the project according to the Dataiku Standard template.

5. Click Save.

   

6. Confirm the change in the project’s custom rules.

Add a child item to a governed project

Put these rules to the test by creating a new bundle in the Dataiku source object of the governed project.

1. Return to the Design node, and open your version of the Governance Basics project.

2. From the More Options () menu of the top navigation bar, select Bundles.

3. Click + New Bundle.

4. Name it v2.

5. Click Create to finish adding a second bundle to the Dataiku project.

6. Back in the Govern node, return to the Source objects panel of the governed project.

7. In the Related objects section, confirm that the v1 bundle remains ungoverned, while the new v2 bundle, added after changing the rule, is automatically governed.

Trigger a governance run on child items

Although you defined a project rule to automatically govern bundles in the project, the original bundle remains ungoverned. This is a temporary dilemma. Changes in a project’s governance settings don’t instantaneously apply to existing child items. However, changes in the Dataiku source items (such as a name change) will trigger a sync between the Dataiku and Govern items, resolving this discrepancy.

You can also manually trigger a governance run to ensure existing items receive their new rules:

1. Navigate to the Governance settings panel of the Govern project.

2. Click Trigger Governance.

3. Click Trigger Auto-Governance to confirm.

4. Return to the Source objects panel, and confirm that the original v1 bundle is now governed, refreshing the page if needed.

Edit the source object of a governed project

That example should help address the governance of new and existing source items. But how does the Govern node respond to changes in the source objects themselves?

To explore this question, change the name of the Dataiku source project belonging to your Govern project.

1. Return to the Design node, and open your version of the Governance Basics project.

2. From the project homepage, click the pencil () icon to edit the title. Name it <YOUR INITIALS> New Governance Basics, and click Save.

3. Refresh the Source objects panel of the governed project.

4. In the Dataiku project section, confirm the governed project points to the updated “New” project title.

5. Confirm the presence of an information () icon in the item header of the governed project. Hover over it to find the name of the Dataiku source project (which no longer matches the name of the governed project).

Tip

Recall the distinction between Dataiku items and Govern items first discussed when deleting the original governed project. These mismatched names highlight the difference between the synced Dataiku source project and the capital “G” Govern project connected to it.

If desired, navigate to the Overview of the governed project page. Click Edit in the item header, and match the name of the governed project to its Dataiku source project. The information () icon disappears!

Next steps

Congratulations! You’ve taken your first steps using the Govern node to:

• Surface metadata of Dataiku items from connected nodes.

• Apply a governance layer to those items.

• Advance those items through workflow steps as defined by a governance template.

• Organize governance activities under business initiatives.

• Continue governing items as their Dataiku source objects evolve.

Before you finish, take a moment to delete work that you no longer need as a courtesy to those sharing your Govern node.

1. From the Business initiatives () page, open your test initiative. From the vertical dots () menu, click Delete Business Initiative.

2. From the Governed projects () page, open your project. From the vertical dots () menu, click Delete Govern Project.

3. From the Design node, open your project. From the project homepage, click Actions > Delete this project.

In this tutorial, you added a governance layer to Dataiku items, and moved them through workflow steps in an arbitrary manner to understand the basic functionality of the Govern node.

Next, look at these how tools can play a instrumental role during all stages of the AI lifecycle. Start with pre-qualification in the ideation phase and execute an AI project all the way through to monitoring a deployed project.

You’ll see how to do that in Tutorial | Governance lifecycle!