Pipelines endpoint v2
Create and manage pipelines programmatically. Base URL: https://api.kmp.kaiju.go.example/v2.
Create a pipeline
POST /v2/pipelines
| Name | Type | Required | Description |
|---|---|---|---|
name | string | Yes | Human-readable pipeline name, unique per workspace. |
source_connector_id | string | Yes | ID of the connector events are read from. |
destination_connector_id | string | Yes | ID of the connector events are written to. |
transforms | array | No | Ordered list of transform step definitions. Omit for a pass-through copy. |
schedule | string | No | Cron expression. Omit for event-triggered (streaming) pipelines. |
create-pipeline.sh
bash
curl -X POST https://api.kmp.kaiju.go.example/v2/pipelines \
-H "Authorization: Bearer $KMP_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"name": "ingest-orders",
"source_connector_id": "conn_pg_orders",
"destination_connector_id": "conn_snowflake_dw"
}'
List pipelines
GET /v2/pipelines — cursor-paginated, see Rate limits for the pagination envelope.
Pipeline states
Returned pipelines include a state field of draft, active, or paused — see Pipelines for what each means.
Deleting a pipeline
Deleting a pipeline does not delete its source or destination connectors, and does not delete events already written to the destination. In-flight runs are allowed to finish before deletion completes.
On this page