Contents Menu Expand Light mode Dark mode Auto light/dark mode
Dataiku
  • Academy
    • Join the Academy
      Benefit from guided learning opportunities →
      • Quick Starts
      • Learning Paths
      • Certifications
      • Academy Discussions
  • Community
      • Explore the Community
        Discover, share, and contribute →
      • Learn About Us
      • Ask a Question
      • What's New?
      • Discuss Dataiku
      • Using Dataiku
      • Setup and Configuration
      • General Discussion
      • Plugins & Extending Dataiku
      • Product Ideas
      • Programs
      • Frontrunner Awards
      • Dataiku Neurons
      • Community Resources
      • Community Feedback
      • User Research
  • Documentation
    • Reference Documentation
      Comprehensive specifications of Dataiku →
      • Release Notes
      • User's Guide
      • Specific Data Processing
      • Automation & Deployment
      • APIs
      • Installation & Administration
      • Other Topics
  • Knowledge
    • Knowledge Base
      Articles and tutorials on Dataiku features →
      • User Guide
      • Admin Guide
      • Dataiku Solutions
      • Dataiku Cloud
  • Developer
    • Developer Guide
      Tutorials and articles for developers and coder users →
      • Getting Started
      • Concepts and Examples
      • Tutorials
      • API Reference
Dataiku Knowledge Base

Get Started

  • Begin Your Journey
    • Core Tasks
      • Quick Start | Dataiku for data preparation
      • Quick Start | Dataiku for machine learning
      • Quick Start | Dataiku for Generative AI
      • Quick Start | Dataiku for agents
      • Quick Start | Dataiku for MLOps
      • Quick Start | Dataiku for AI collaboration
    • Transition from Other Tools
      • Quick Start | Excel to Dataiku
        • Concept | From Excel to Dataiku
      • Quick Start | Alteryx to Dataiku
    • Domain Onboarding
      • Quick Start | Dataiku for manufacturing data preparation and visualization
      • Quick Start | Dataiku for finance data preparation
  • Discover Dataiku Interface
    • Homepage
      • Concept | Dataiku homepage
      • Concept | Dataiku Cloud Launchpad
      • How-to | Find the Dataiku version
    • Projects
      • Concept | Project
      • How-to | Duplicate a Dataiku project
      • Tip | Using project folders
    • Flow
      • Concept | Flow
      • Tutorial | Explore the Flow
      • Tutorial | Flow zones

User Guide

  • Import Data
    • Data Connections
      • Concept | Data connections
      • Concept | Architecture model for databases
      • Concept | Connection changes
      • Concept | Sync recipe
      • Tutorial | Configure a connection between Dataiku and an SQL database
      • Tutorial | Data transfer with visual recipes
      • How-to | Remap a connection when importing a project to a Dataiku instance
      • How-to | Utilize MS Access
    • Data Exploration
      • Concept | Dataiku datasets
      • Concept | Dataset characteristics
      • Concept | Sampling on datasets
      • Concept | Analyze data quality in the Explore tab
      • Tutorial | Getting started with datasets
      • How-to | Rename a dataset
      • How-to | Reorder or hide dataset columns
      • How-to | Export a filtered dataset
      • How-to | Apply a filter to summary statistics in the Analyze window
      • How-to | Generate dataset metadata
      • FAQ | Why can’t I drag a folder into Dataiku?
      • FAQ | Where can I see how many records are in my entire dataset?
    • Managed Folders
      • Concept | Managed folders
      • Tutorial | Managed folders
  • Prepare and Transform Data
    • Discover Visual Recipes
      • Concept | Recipes in Dataiku
      • Concept | Common steps in visual recipes: Pre-filter, Post-filter, & Computed columns
      • Concept | Flow Assistant
      • How-to | Insert or delete a recipe within the Flow
      • How-to | Use the Flow Assistant
      • How-to | Extract unstructured content into a dataset
    • Prepare Data
      • Overview
        • Concept | Prepare recipe
        • Tutorial | Prepare recipe
        • How-to | Copy-paste Prepare recipe steps
        • How-to | Apply Prepare steps to multiple columns
      • Dataiku Formulas
        • Concept | Dataiku formulas
        • Concept | Dataiku formulas cheat sheet
        • Concept | Safe sums across columns in Dataiku formulas
        • Tutorial | Relative referencing in Dataiku formulas
        • How-to | Remove scientific notation in a column
        • How-to | Pad a number with leading zeros
        • How-to | Fill empty cells of a column with the value of the corresponding row from another column
        • FAQ | In a formula, how can I check if a variable belongs to a set of values?
      • Working with Numbers
        • Reference | Handling decimal notations
        • How-to | Normalize number formats in a Prepare recipe
        • How-to | Handle accounting-style negative numbers
      • Managing Dates
        • Concept | Date handling in Dataiku
      • Additional Data Preparation
        • Tutorial | Smart pattern builder for string pattern extraction
        • Tutorial | Visual logic processors for data preparation
        • Tutorial | Enrich web logs in the Prepare recipe
        • Reference | Using custom Python functions in the Prepare recipe
        • How-to | Standardize text fields using fuzzy values clustering
        • How-to | Generate Prepare recipe steps with AI
    • Join Data
      • Concept | Join recipe
      • Concept | Fuzzy join recipe
      • Concept | Geo join recipe
      • Tutorial | Join recipe
      • Tutorial | Geo join recipe
      • Tutorial | Fuzzy join recipe
    • Aggregate Data
      • Concept | Group recipe
      • Concept | Window recipe
      • Tutorial | Group recipe
      • Tutorial | Window recipe
    • Enrich Data
      • Concept | Labeling recipe
      • Concept | Generate recipes using Generative AI
      • How-to | Segment your data using statistical quantiles
    • Reorder Data
      • Concept | Sort recipe
      • Concept | Top N recipe
      • Tutorial | Top N recipe
    • Transform Data
      • Concept | Pivot recipe
      • Concept | Dynamic dataset and recipe repeat
      • Tutorial | Pivot recipe
      • Tutorial | Dynamic recipe repeat
      • How-to | Reshape data from wide to long format
    • Reduce Data
      • Concept | Distinct recipe
      • Concept | Sample/Filter recipe
      • Tutorial | Distinct recipe
    • Stack/Split Data
      • Concept | Split recipe
      • Concept | Stack recipe
    • Build Data
      • Concept | Computation engines
      • Concept | Build modes
      • Concept | Data pipeline optimization
      • Tutorial | Build modes
      • Tutorial | Recipe engines
      • Tutorial | In-database data visualization and preparation
      • How-to | Access job information
      • How-to | Enable SQL pipelines in the Flow
    • Migrate from Other Tools
      • From Excel to Dataiku
        • Tutorial | Relative referencing in Dataiku formulas
        • How-to | Work with editable datasets
        • How-to | Import an Excel workbook
        • Reference | Data cleaning
        • Reference | Using formulas
        • Reference | Working with dates
        • Reference | Removing duplicates
        • Reference | Filtering rows
        • Reference | Sampling rows
        • Reference | Split a dataset
        • Reference | Append datasets
        • Reference | Joining datasets
        • Reference | Aggregate and pivot
        • Reference | Sorting values
        • Reference | Top values
      • From Alteryx to Dataiku
        • Reference | Alteryx to Dataiku concept mapping
  • Visualize Data
    • Charts
      • Concept | Charts
      • Concept | In-database charts
      • Tutorial | Charts
      • Tutorial | Pivot tables
      • Tutorial | Custom aggregation for charts
      • Tutorial | No-code maps
      • How-to | Use the craft binning interface in charts
      • How-to | Build hierarchies for drill-down charts
      • How-to | Animate charts
      • FAQ | How do I display non-aggregated metrics in charts?
      • FAQ | How do I sort on a measure not displayed in charts?
    • Dashboards
      • Concept | Dashboards
      • Tutorial | Use dashboards to build reports
      • Tutorial | Dashboard management
      • How-to | Manage sampling on insights
    • Webapps
      • Concept | Webapps
    • Static Insights
      • Concept | Static insights
  • Collaborate and Share
    • Collaboration Overview
      • Concept | Collaboration
    • Wikis & Flow Documentation
      • Concept | Explain the Flow with Generative AI
      • Concept | Workflow documentation in a wiki
      • How-to | Create a wiki article
      • How-to | Export a wiki to a PDF
      • How-to | Generate and export Flow documentation
      • Tip | Link Dataiku objects in a wiki article
    • Tags & Object Descriptions
      • Concept | Tags
    • Sharing Projects & Dataiku Assets
      • Concept | Project permissions and asset sharing
      • Concept | Data Catalog
      • Concept | Enterprise Asset Library
      • How-to | Set up limited access to projects
      • How-to | Manage project access requests
      • How-to | Share project to non-Dataiku users
      • How-to | Manage object sharing
      • How-to | Enable quick sharing of datasets and objects
      • How-to | Copy Flow items to a new or existing project
      • How-to | Share a project in the Enterprise Asset Library
      • Tip | Ensuring metadata completeness in Data Collections
    • Discussions
      • Concept | Discussions
      • How-to | Start discussions in a Dataiku object
    • Workspaces
      • Concept | Workspaces
      • How-to | Create a workspace
      • How-to | Share a workspace to non-Dataiku users
    • Stories
      • Concept | Dataiku stories
      • Tutorial | Dataiku stories with Generative AI
      • Tutorial | Dataiku stories
      • How-to | Import a story
    • Project Version Control
      • Concept | Version control for Dataiku projects
      • Tutorial | Git for projects
      • How-to | Undo actions in Dataiku
    • Dataiku Apps
      • Concept | Dataiku apps
      • Tutorial | Dataiku apps
  • Use Generative AI and Agents
    • LLM Administration
      • Concept | LLM connections
      • Concept | Guardrails against risks from Generative AI and LLMs
    • Text Processing with Visual GenAI Recipes
      • Concept | Large language models and the LLM Mesh
      • Concept | Classify text recipe
      • Concept | Summarize text recipe
      • Concept | Prompt Studios and Prompt recipe
      • Tutorial | Classify text with Generative AI
      • Tutorial | Summarize text with Generative AI
      • Tutorial | Prompt engineering with LLMs
      • Tutorial | Processing text with the Prompt recipe
    • Retrieval Augmented Generation (RAG)
      • Concept | Embed recipes and Retrieval Augmented Generation (RAG)
      • Tutorial | Build a RAG system and turn it into a conversational agent
      • Tutorial | Retrieval Augmented Generation (RAG) with the Embed dataset recipe
      • Tutorial | Manage document-level permissions for RAG
    • Agents
      • Concept | Simple Visual Agents
      • Concept | Overview of agent tools
      • Concept | Configuring agent tools
      • Concept | Agent Hub
      • Concept | Semantic Models Lab
      • Tutorial | Simple Visual Agents
      • Tutorial | Agent Hub
      • Tutorial | Agent Review
      • How-to | Deploy an agentic project
  • Leverage Machine Learning
    • Interactive Statistics
      • Concept | Statistics worksheets
      • Concept | Statistics cards
      • Concept | Generate statistics recipe
      • Concept | Variable types for interactive statistics
      • Concept | Factor and response roles in statistics cards
      • Concept | Statistics cards for fit curves and distributions
      • Concept | Correlation matrices in statistical worksheets
      • Concept | Principal Component Analysis (PCA)
      • Concept | Hypothesis testing
      • Concept | Hypothesis test categories
      • Concept | Grouping variables in statistical testing
      • Concept | Adjustment methods for hypothesis test cards
      • Tutorial | Interactive statistics
      • How-to | Export a statistics card as a recipe
    • Feature Engineering
      • Concept | Data preparation for machine learning
      • Concept | Visual analyses in the Lab
      • Concept | Generate features recipe
      • Tutorial | Visual analyses in the Lab
      • Tutorial | Generate features recipe
    • AutoML Model Design
      • Concept | Quick models in Dataiku
      • Concept | The Design tab within the visual ML tool
      • Concept | Features handling
      • Concept | Multimodal ML using LLMs
      • Concept | Feature generation & reduction
      • Concept | Algorithm and hyperparameter selection
      • Concept | ML diagnostics
      • Concept | ML assertions
      • Tutorial | Machine learning basics
      • Tutorial | Model overrides
      • Tutorial | ML diagnostics
      • Tutorial | ML assertions
      • Tutorial | Clustering (unsupervised) models with visual ML
      • Tutorial | MLlib with Dataiku
      • Tutorial | Multimodal machine learning
      • How-to | Distributed hyperparameter search
      • FAQ | How does the AutoML tool automatically select or reject features when training a model?
      • Troubleshoot | In visual ML, I get the error “All values of the target are equal” when they’re not
    • AutoML Model Results
      • Concept | The Result tab within the visual ML tool
      • Concept | Model summaries within the visual ML tool
      • Concept | Explainable AI
      • Concept | Partial dependence plots
      • Concept | Subpopulation analysis
      • Concept | Individual prediction explanations
      • Concept | What if? analysis
      • Concept | Advanced What if? simulators
      • Concept | Interpretation of regression model output
      • Concept | Model comparisons
      • Tutorial | Advanced What if simulators
      • Tutorial | Exporting a model’s preprocessed data with a Jupyter notebook
      • How-to | Set up What if analysis for a dashboard consumer
      • FAQ | Why don’t the values in the visual ML chart match the final scores for each algorithm?
    • Model Scoring
      • Concept | Model deployment to the Flow
      • Concept | Scoring data
      • Tutorial | Model scoring basics
    • Custom Models in Visual ML
      • Concept | Custom preprocessing within the visual ML tool
      • Concept | Custom modeling within the visual ML tool
      • Tutorial | Custom preprocessing & modeling within visual ML
    • Causal Prediction
      • Concept | Causal prediction
      • Tutorial | Causal prediction
    • Complex Data
      • Time Series
        • Concept | Time series fundamentals
        • Concept | Time series analysis with interactive statistics
        • Concept | Time series preparation
        • Concept | Time series resampling
        • Concept | Time series interval extraction
        • Concept | Time series windowing
        • Concept | Time series extrema extraction
        • Concept | Time series forecasting
        • Concept | What if? analysis for time series
        • Tutorial | Time series analysis
        • Tutorial | Time series forecasting (visual ML)
        • Tutorial | Time series preparation
        • Tutorial | Forecasting time series data with R and Dataiku
        • Tutorial | Deep learning for time series
        • Tutorial | Export preprocessed data (for time series models)
      • Text
        • Concept | Regular expressions in Dataiku
        • Concept | Introduction to natural language processing (NLP)
        • Concept | Challenges of natural language processing (NLP)
        • Concept | Cleaning text data
        • Concept | Handling text features for machine learning
        • Tutorial | Build a text classification model
      • Images
        • Concept | Pre-trained image classification models
        • Concept | Optimization of image classification models
        • Concept | Object detection
        • Tutorial | Image classification without code
        • Tutorial | Image classification with code
        • Tutorial | Object detection without code
        • How-to | Prepare images for use in a model
      • Geographic Data
        • Concept | Geo join recipe
        • Tutorial | Geographic processors
        • Tutorial | No-code maps
        • Tutorial | Geo join recipe
        • Tutorial | Compute isochrones and routes with the Geo Router plugin
        • Tutorial | Working with shapefiles and US census data
      • Graph Analytics
        • Concept | Introduction to graph analytics
        • Tutorial | Building and exploring a graph for patient data analysis
    • Generalized Linear Models (GLM)
      • Concept | Generalized Linear Model (GLM)
      • Tutorial | Generalized Linear Models
    • Partitioned Models
      • Concept | Partitioned models
      • Tutorial | Partitioned models
      • How-to | Train a stratified or partitioned model
    • Deep Learning
      • Tutorial | Deep learning within visual ML
      • Tutorial | Deep learning for time series
    • Responsible AI
      • Concept | Responsible AI
      • Concept | Dangers of irresponsible AI
      • Concept | Responsible AI in the data science practice
      • Concept | Basics of bias
      • Concept | Model fairness
      • Concept | Evaluating group fairness
      • Concept | Interpretability
      • Concept | Model transparency
      • Concept | Deployment biases
      • Tutorial | Responsible AI training
    • Feature Store
      • Tutorial | Building your feature store in Dataiku
      • How-to | Add a dataset to the feature store
      • How-to | Add a feature group to the Flow
  • Explore Data Quality
    • Concept | Metrics
    • Concept | Checks
    • Concept | Data quality rules
    • Concept | Metrics & checks (pre-12.6)
    • Concept | Data lineage
    • Tutorial | Data quality
    • Tutorial | Custom metrics, checks, and data quality rules
    • Tutorial | Data quality and SQL metrics
    • Tutorial | Implement pre-deployment checks with Project Standards
    • FAQ | What’s the difference between distinct and unique value count metrics?
  • Automate Tasks
    • Automation Scenarios
      • Concept | Automation scenarios
      • Concept | Custom metrics, checks, data quality rules & scenarios
      • Tutorial | Automation scenarios
      • Tutorial | Scenario reporters
      • Tutorial | Webhook reporters in scenarios
      • Tutorial | Custom step-based scenarios
      • Tutorial | Custom script scenarios
      • Tutorial | Test scenarios
      • How-to | Automate documentation exports in a scenario
      • How-to | Build missing partitions with a scenario
      • Code Sample | Set a timeout for a scenario build step
      • Code Sample | Set email recipients in a “Send email” reporter
      • FAQ | Can I control which datasets in my Flow get rebuilt during a scenario?
    • Variables
      • Concept | Variables in Dataiku
      • Tutorial | Project variables in visual recipes
      • Tutorial | Coding with variables
    • Partitioning
      • Concept | Partitioning
      • Concept | How partitioning adds value
      • Concept | Partitioned datasets
      • Concept | Jobs with partitioned datasets
      • Concept | Partitioning by pattern
      • Concept | Partitioning in a scenario
      • Concept | Partition redispatch and collection
      • Tutorial | File-based partitioning
      • Tutorial | Column-based partitioning
      • Tutorial | Partitioning in a scenario
      • Tutorial | Repartition a non-partitioned dataset
      • Tip | Interacting with partitioned datasets using the Python API
  • Deploy to Production
    • AIOps Overview
      • Concept | Definition, challenges, and principles of MLOps
      • Concept | How model development impacts MLOps
      • Concept | Model packaging for deployment
      • Concept | Dataiku architecture for MLOps
    • Project Deployment
      • Concept | Automation node preparation
      • Concept | Project deployment
      • Tutorial | Deploy a project bundle to a production environment
    • API Deployment
      • Concept | Real-time APIs
      • Concept | API endpoints
      • Concept | API query enrichments
      • Concept | API Deployer
      • Tutorial | Deploy an API service to a production environment
    • Model Monitoring
      • Concept | Model evaluation stores
      • Concept | Monitoring model performance and drift in production
      • Concept | Monitoring and feedback in the AI project lifecycle
      • Tutorial | Model monitoring with a model evaluation store
      • Tutorial | API endpoint monitoring
      • Tutorial | Model monitoring in different contexts
      • Tutorial | Deployment automation
      • Tutorial | Surface external models within Dataiku
      • FAQ | How can I get model monitoring metrics in a dataset format?
    • GenAI Monitoring
      • Tutorial | LLM evaluation
      • Tutorial | Agent evaluation
    • Scaling & Automation
      • Concept | Unified Monitoring
      • Tutorial | Getting started with CI/CD pipelines with Dataiku
      • Tutorial | Jenkins pipeline for API services in Dataiku
      • Tutorial | Jenkins pipeline for Dataiku with the Project Deployer
      • Tutorial | Azure pipeline for Dataiku with the Project Deployer
      • Tutorial | Jenkins pipeline for Dataiku without the Project Deployer
  • Implement AI Governance
    • Governance Overview
      • Concept | AI governance
      • Concept | The Govern node’s role in the Dataiku platform
      • Concept | Surfacing Dataiku metadata in the Govern node
      • Concept | Instance-level governance settings
      • Concept | Item hierarchy in the Govern node
      • Concept | Adding a governance layer to Dataiku items
      • Concept | Governed items
      • Concept | Sign-offs in workflows of Govern items
      • Tutorial | Governance basics
      • Tutorial | Governance lifecycle
      • How-to | Export Govern items
      • How-to | Subscribe to email notifications
    • Governance Roles & Permissions
      • Concept | Govern roles and permissions
      • Tutorial | Govern roles and permissions
      • How-to | Add role assignment rules to a Govern item
    • Governance Customization
      • Tutorial | Custom governance templates
      • Tutorial | Custom governance items
      • Tutorial | Custom governance pages
      • Tutorial | Use imported templates in the Blueprint Designer
      • How-to | Switch artifact templates (blueprint versions)
      • How-to | Export and import blueprint and blueprint versions
      • Tip | Embed a dashboard in Dataiku Govern
  • Code
    • Python
      • Concept | Jupyter notebook
      • Concept | Python recipe
      • Tutorial | Code notebooks and recipes
    • SQL
      • Concept | SQL notebooks
      • Concept | SQL code recipes
      • Concept | AI SQL Assistant
      • Tutorial | SQL notebooks and recipes
    • Shared Code
      • Concept | Shared code
      • How-to | Import a notebook from GitHub
    • Dataiku APIs
      • Concept | Dataiku APIs
  • Extend with Plugins
    • Concept | Plugin management
    • Concept | Plugins in Dataiku
    • Concept | Plugin development
    • How-to | Install a plugin
    • How-to | Update a plugin
    • FAQ | Are plugins supported?
    • FAQ | Where can I find the details of a plugin?

Dataiku Cloud

  • Space Management
    • Free Trials of Dataiku Cloud
      • How-to | Begin a free trial from Dataiku
      • How-to | Begin a free trial from Snowflake Partner Connect
      • Tip | Working with Snowflake Partner Connect sample projects
    • Users & Access Management on Dataiku Cloud
      • Reference | License management on Dataiku Cloud
      • Reference | Permission management on Dataiku Cloud
      • How-to | Invite users to your Dataiku Cloud space
      • How-to | Automatically attribute profiles and groups to users
      • How-to | Automatically invite users to your instance
      • How-to | Use trial seats
      • How-to | Activate single sign-on (SSO)
      • Troubleshoot | The invited user didn’t receive an email
    • Support on Dataiku Cloud
      • How-to | Contact support on Dataiku Cloud
      • How-to | Grant Dataiku support access to your instance
      • FAQ | Should I email support -at- dataiku -dot- com if I need help?
    • Production Nodes on Dataiku Cloud
      • How-to | Install the Automation node
      • How-to | Install the API node
      • How-to | Use the referenced data deployment mode on Dataiku Cloud
      • How-to | Deploy an API service from the Automation node on Dataiku Cloud
  • Data Transfer and Security on Dataiku Cloud
    • Reference | Relocatable datasets
    • Reference | Data transfer between cloud storage locations
    • How-to | Secure data connections through AWS PrivateLink
    • How-to | Secure data connections through Azure Private Link
    • How-to | Secure data connections through GCP Private Service Connect
    • How-to | Restrict access to or from Dataiku Cloud with IP addresses
    • How-to | Access data sources through a VPN server
  • Compute and Resource Quotas on Dataiku Cloud
    • Reference | Overview of compute engines on Dataiku Cloud
    • Reference | Leveraging fully managed elastic AI compute
    • Reference | Managing elastic AI compute capacity
    • Reference | Managing containerized execution configurations for standard compute or (GPU) accelerated compute
    • Reference | Resource quota management
    • Tip | Choosing container sizes
    • Tip | Using Spark
    • Troubleshoot | The job takes an unusually long time to complete
    • Troubleshoot | The job queues for a long time and then fails without ever starting

Additional Offerings

  • Dataiku Solutions
    • Retail & CPG
      • Solution | Customer Satisfaction Reviews
      • Solution | Demand Forecast
      • Solution | Distribution Spatial Footprint
      • Solution | Market Basket Analysis
      • Solution | Product Recommendation
      • Solution | Customer Lifetime Value Forecasting
      • Solution | RFM Segmentation
      • Solution | Markdown Optimization
      • Solution | Store Segmentation
      • Solution | Marketing Mix Modeling
      • Solution | Dynamic Selling Assistant
    • Financial Services & Insurance
      • Solution | AML Alerts Triage
      • Solution | Credit Scoring
      • Solution | Customer Segmentation for Banking
      • Solution | Next Best Offer for Banking
      • Solution | Credit Risk Stress Testing (CECL, IFRS9)
      • Solution | Lead Scoring
      • Solution | Churn Prediction
      • Solution | Insurance Claims Modeling
    • Health & Life Sciences
      • Solution | Optimizing Omnichannel Marketing
      • Solution | Pharmacovigilance
      • Solution | Social Determinants of Health
      • Solution | Clinical Site Intelligence
      • Solution | Clinical Trial Intelligence Assistant
      • Solution | Molecular Property Prediction
      • Solution | Dynamic HCP Segmentation
      • Solution | Real-World Data: Cohort Discovery
      • Solution | Medical Entity Extraction Assistant
    • Manufacturing & Energy
      • Solution | Batch Performance Optimization
      • Solution | Maintenance Performance and Planning
      • Solution | Manufacturing Process Control
      • Solution | Parameters Analyzer
      • Solution | Production Quality Control
      • Solution | Supplier Management Assistant
    • Finance Teams
      • Solution | Financial Forecasting
      • Solution | Reconciliation
      • Solution | Agentic Insights
    • Operations
      • Solution | Process Mining
    • Governance
      • Solution | Leveraging Compute Resource Usage Data
      • Solution | EU AI Act Readiness
      • Solution | LLM Provider Due Diligence
      • Solution | ISO 42001 Readiness
    • Real Estate
      • Solution | Real Estate Pricing
  • Use Cases
    • Data Preparation Use Cases
      • Tutorial | Airport traffic by US and international carriers
      • Tutorial | Network optimization
    • Classification Use Cases
      • Tutorial | Predictive maintenance in the manufacturing industry
      • Tutorial | Churn prediction
      • Tutorial | Facies classification
    • Clustering Use Cases
      • Tutorial | Web logs analysis
    • Plugin Use Cases
      • Tutorial | Data governance with the GDPR plugin
      • Tutorial | A/B testing for event promotion (AB test calculator plugin)

Admin Guide

  • Deploying Dataiku
    • Dataiku Architecture
      • Reference | Fleet Manager
      • Reference | The Dataiku elastic AI stack
    • Deploying Dataiku Instances to Cloud Stacks
      • Tutorial | Deploy a Dataiku instance to Cloud Stacks on AWS
      • Tutorial | Deploy a Dataiku instance to Cloud Stacks on Azure
    • Instance Templates
      • Reference | Fleet blueprints
      • How-to | Create or modify an instance template
      • How-to | Grant SSH access
      • How-to | Grant security roles
      • How-to | Use the license override setting
      • Tip | Modifying instance templates and settings
      • Tip | The impact of instance template modifications on disk sizes
      • Tip | The impact of instance template modifications on other elements
    • Setup Actions for Instance Templates
      • Reference | Setup actions
      • How-to | Add a new setup action
      • How-to | Run Ansible tasks
      • How-to | Set up Kubernetes and Spark-on-Kubernetes
      • How-to | Remove a setup action
    • Virtual Networks
      • Reference | Creating or modifying a virtual network
      • How-to | View or edit a virtual network
      • How-to | Edit virtual network names
      • How-to | Assign a public IP address
      • How-to | Assign a virtual network ID and subnet name
      • How-to | Create default or custom security groups
      • How-to | Enable Fleet Management configuration options
      • How-to | Choose DNS strategy
      • How-to | Choose an SSL strategy
      • How-to | Reprovision an instance after applying modifications
    • Instance Management from Fleet Manager
      • Reference | Instance lifecycle management from Fleet Manager
      • Reference | Defining settings at the instance level
      • Reference | Setting the disk sizes
      • Reference | Reprovisioning, deleting or stopping an instance
      • Reference | Defining static IP addresses
      • Reference | Defining an SSL strategy
      • Reference | Using the dashboard and agent logs
      • How-to | Upgrade an instance
      • How-to | Configure automatic snapshots of the data disk
  • Configuring Dataiku
    • License File Management
      • How-to | Configure your DSS license
      • How-to | Update a license file through the license override setting
      • How-to | Select a sublicense
      • How-to | Update a license file for a cloud setup
      • How-to | Fetch usage statistics in Fleet Manager
      • How-to | View license information from the DSS Administration menu
    • User Identity & Authentication
      • Reference | Security model overview
      • Reference | User identity
      • Reference | User profiles
      • Reference | Supported authentication methods
      • How-to | Create a local user (manually)
      • How-to | Add LDAP users via LDAP configuration
      • How-to | Add local users from an Azure Active Directory (AAD)
    • User Groups & Permissions
      • Reference | Global vs. per-resource group permissions
      • Reference | Global group permissions
      • Reference | Per-resource group permissions
      • How-to | Set up user groups (overview)
      • How-to | Create a group and assign it global permissions
      • How-to | Verify group membership and permissions
      • How-to | Grant per-project permissions
      • How-to | Control access to code environments
      • How-to | Control access to managed clusters
      • How-to | Assign access to containerized execution
      • How-to | Assign Deployer infrastructure permissions
      • Tip | Creating a permissions model based on user types
      • Code Sample | Add a group to a Dataiku project using Python
      • FAQ | Which activities require that a user be added to the allowed_user_groups local Unix group?
    • Connection Usage Parameters
      • Reference | “Allow write” and “Allow managed datasets” usage parameters
      • Reference | Usage parameters for cloud storage
      • Reference | Usage parameters for SQL databases
    • Connection Security
      • Tutorial | Using AWS AssumeRole with an S3 connection to persist datasets
      • Reference | Security permissions for data connections
      • Reference | Global vs. per-user connection credentials
    • DSS Metastore Catalog
      • Reference | Dataiku metastore catalog
      • Reference | Querying datasets from metastore-aware engines
      • How-to | Configure an internal metastore
      • How-to | Configure an external metastore (AWS Glue Data Catalog)
      • How-to | Synchronize a dataset to the metastore catalog
      • How-to | Import a dataset from the Hive metastore (HMS)
      • How-to | Interact with AWS Glue
      • How-to | Build a chart using a metastore-aware engine
      • How-to | Query datasets from a metastore-aware notebook
    • Preferred Connections and Format for Dataset Storage
      • Concept | Default, fallback, and forced dataset connections
      • How-to | Configure the global default file format
      • How-to | Adjust the default configuration for preferred connections and file formats for a project
      • Tip | Selecting default file formats and preferred connections
    • Code Environment Administration
      • How-to | Grant permissions to create or manage code environments
      • How-to | Create a new code environment
      • How-to | Manage code environment properties
      • How-to | Configure default code environments
      • How-to | Install system-level package dependencies
      • How-to | Point DSS to a custom Python package repository
      • How-to | Point DSS to a CRAN mirror
      • How-to | Provide access to custom package repositories via an internet proxy
      • FAQ | Does Dataiku support custom package repositories?
  • Operating Dataiku
    • Instance Monitoring
      • Tutorial | Self-healing API service deployments on Kubernetes
      • Tutorial | Forward Dataiku logs to Splunk Cloud Platform
      • Tutorial | Use Datadog to monitor Dataiku-managed Elastic AI clusters
      • Code Sample | Find out which users are logged onto the Dataiku instance
      • Solution | Leveraging Compute Resource Usage Data
    • Diagnosing Performance Issues
      • How-to | Get support
      • Troubleshoot | A code recipe takes a long time to run
      • Troubleshoot | Dataiku isn’t using the optimal engine for a visual recipe
      • Troubleshoot | A visual recipe job log says “Computation will not be distributed”
      • Troubleshoot | Diagnosing instance-wide performance
      • Troubleshoot | Sync recipe from Snowflake to S3 takes many hours to complete
      • Troubleshoot | Python or PySpark job takes several hours to complete
      • Troubleshoot | The Dataiku UI is slow to load for all users
      • Tip | Scoping performance issues
      • Tip | Takeaways for performance troubleshooting
    • Project Cleaning and Maintenance
      • Tutorial | Create a scenario for automating project maintenance macros
      • Reference | Project maintenance macros
      • Reference | Project maintenance macros glossary
  • Go back to the homepage
  • Prepare and Transform Data
Back to top

Reduce Data#

Data preparation in Dataiku is achieved with recipes in the Flow. Recipes can be:

Concepts#

  • Concept | Distinct recipe
  • Concept | Sample/Filter recipe

Tutorials#

  • Tutorial | Distinct recipe
Next
Concept | Distinct recipe
Previous
How-to | Reshape data from wide to long format
Copyright © 2026, Dataiku
Made with Sphinx and @pradyunsg's Furo
On this page
  • Reduce Data
    • Concepts
    • Tutorials