Pipelines endpoint v2

Create and manage pipelines programmatically. Base URL: https://api.kmp.kaiju.go.example/v2.

Create a pipeline

POST /v2/pipelines

Name Type Required Description
namestringYesHuman-readable pipeline name, unique per workspace.
source_connector_idstringYesID of the connector events are read from.
destination_connector_idstringYesID of the connector events are written to.
transformsarrayNoOrdered list of transform step definitions. Omit for a pass-through copy.
schedulestringNoCron expression. Omit for event-triggered (streaming) pipelines.
create-pipeline.sh bash
curl -X POST https://api.kmp.kaiju.go.example/v2/pipelines \
  -H "Authorization: Bearer $KMP_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "name": "ingest-orders",
    "source_connector_id": "conn_pg_orders",
    "destination_connector_id": "conn_snowflake_dw"
  }'

List pipelines

GET /v2/pipelines — cursor-paginated, see Rate limits for the pagination envelope.

Pipeline states

Returned pipelines include a state field of draft, active, or paused — see Pipelines for what each means.

Deleting a pipeline

Deleting a pipeline does not delete its source or destination connectors, and does not delete events already written to the destination. In-flight runs are allowed to finish before deletion completes.