Reference | Data transfer between cloud storage locations#

Data transfer between cloud storage providers can be categorized into two types of traffic:

Egress traffic

The volume of data leaving your Dataiku instance

Ingress traffic

The volume of data entering your Dataiku instance

The largest source of data transfer between cloud storage providers occurs when you:

  • Leverage Dataiku Cloud-managed compute (DSS engine or containers for Spark jobs or ML model training) on data located on a cloud provider or region different from your Dataiku instance.

  • Sync data from your cloud storage to Dataiku Cloud-managed S3.

For all Dataiku cloud editions, data transfer out of Dataiku Cloud is limited to 1,000 GB per month on Dataiku Cloud. You can visualize the volume of data entering or leaving your Dataiku instance in your Launchpad’s Usage & Monitoring panel.

Important

This 1,000 GB limit can be lifted upon motivated customer request. Contact Support to learn more.