Does this tool connect to my OCI account?

No. This tool runs entirely in your browser and generates configuration JSON that you can copy and paste into your infrastructure-as-code templates, CLI commands, or cloud console. It never connects to any cloud account or sends data externally.

Are the generated configurations production-ready?

The tool produces syntactically valid configurations based on current OCI service specifications. Always review generated configs against your organization security policies and test in a non-production environment before deploying.

OCI Data Integration Task Builder

StorageOCI

Build Data Integration workspace and task configurations with source, transform, and target data flows.

Last verified: May 2026

OCI Data Integration Configuration

Build Data Integration workspace and task configurations with source, transform, and target data flow steps.

Required Fields

compartmentIdworkspaceIddisplayNametask.modelTypetask.dataFlow.sourcetask.dataFlow.target

{
  "compartmentId": "ocid1.compartment.oc1..aaaaaaaexample",
  "workspaceId": "ocid1.disworkspace.oc1.iad.aaaaaaaexample",
  "displayName": "etl-customer-data-task",
  "description": "ETL task to transform customer data from Object Storage to ADW",
  "task": {
    "modelType": "INTEGRATION_TASK",
    "name": "customer-data-etl",
    "dataFlow": {
      "source": {
        "modelType": "OCI_OBJECT_STORAGE_DATA_ASSET",
        "name": "raw-customer-csv",
        "namespace": "my-tenancy",
        "bucketName": "raw-data",
        "objectName": "customers/*.csv",
        "schema": {
          "fields": [
            { "name": "customer_id", "type": "VARCHAR", "length": 50 },
            { "name": "email", "type": "VARCHAR", "length": 255 },
            { "name": "created_date", "type": "DATE" },
            { "name": "total_spend", "type": "NUMBER", "precision": 10, "scale": 2 }
          ]
        }
      },
      "transforms": [
        {
          "modelType": "FILTER_OPERATOR",
          "name": "filter-active",
          "condition": "status = 'ACTIVE'"
        },
        {
          "modelType": "EXPRESSION_OPERATOR",
          "name": "add-load-date",
          "expression": "CURRENT_TIMESTAMP AS load_date"
        },
        {
          "modelType": "LOOKUP_OPERATOR",
          "name": "enrich-region",
          "lookupEntity": "DIM_REGION",
          "lookupCondition": "src.zip_code = lookup.zip_code"
        }
      ],
      "target": {
        "modelType": "ORACLE_AUTONOMOUS_DATA_WAREHOUSE",
        "name": "adw-customer-table",
        "connectionId": "ocid1.disconnection.oc1.iad.aaaaaaaexample",
        "schemaName": "ANALYTICS",
        "tableName": "FACT_CUSTOMERS",
        "writeMode": "MERGE",
        "mergeKey": ["customer_id"]
      }
    }
  },
  "schedule": {
    "frequency": "DAILY",
    "time": "03:00",
    "timezone": "UTC"
  },
  "freeformTags": {
    "pipeline": "customer-etl",
    "team": "data-engineering"
  }
}

Generated Output

Output will appear here...

See It in Action

Your team has 30 Excel files arriving in Object Storage daily that need ingestion into Autonomous Database for reporting. The builder generates a Data Integration task: connection to the Object Storage bucket, data flow with column mapping + type conversion + validation, target Autonomous DB table, scheduled hourly OR triggered by Object Storage events. End-to-end ingestion pipeline in 1 day vs the 1-week estimate writing custom Python ETL by hand.

What This Tool Does

Build Data Integration workspace and task configurations with source, transform, and target data flows. This tool helps OCI engineers generate valid configurations quickly without consulting documentation, reducing errors and accelerating infrastructure deployment. All processing runs in your browser with no data sent to external servers.

Technical Details

The builder constructs OCI Data Integration configurations: workspace resource (compartment, VCN/subnet for private networking), project (logical container for related tasks), connection assets (data sources: Autonomous DB, Object Storage, MySQL, etc.), data flow tasks (visual flow definitions with source → transforms → target), and execution schedule. Output is generated as oci data-integration commands and Terraform oci_dataintegration_workspace + oci_dataintegration_data_asset resources.

Common Use Cases

1Generating oci data integration task configurations for new infrastructure deployments.
2Validating existing configurations against best practices before applying changes.
3Learning OCI service configuration patterns through interactive examples.
4Accelerating infrastructure-as-code development by producing correct JSON/YAML starting points.

Common Questions

Does this tool connect to my OCI account?: No. This tool runs entirely in your browser and generates configuration JSON that you can copy and paste into your infrastructure-as-code templates, CLI commands, or cloud console. It never connects to any cloud account or sends data externally.
Are the generated configurations production-ready?: The tool produces syntactically valid configurations based on current OCI service specifications. Always review generated configs against your organization security policies and test in a non-production environment before deploying.

Expert Tips

TIP

OCI Data Integration is the right answer for ETL/ELT between Oracle services (Object Storage → Autonomous Database, Object Storage → ADW). For non-Oracle data sources, consider Spark on Data Flow or third-party tools — Data Integration's connector ecosystem is strongest for Oracle databases.

TIP

Visual data flow designer accelerates ETL development dramatically vs writing SQL/Python by hand for typical transformations. Build the flow visually, generate the underlying SQL/PySpark, deploy. The trade-off: complex business logic still needs custom code, not visual flows.

TIP

Schedule integration tasks via the built-in scheduler OR via OCI Events for event-driven triggering (e.g., 'when a file lands in this Object Storage prefix, run the ingestion task'). Event-driven is dramatically more efficient than polling-based scheduling for irregular data arrivals.

Related Learning Guides

Autonomous Database on OCI20 min read
OCI Object Storage & Tiers16 min read

Was this tool helpful?

Disclaimer: This tool runs entirely in your browser. No data is sent to our servers. Always verify outputs before using them in production. AWS, Azure, and GCP are trademarks of their respective owners.