Kafka Integration
Integrate Data Mesh Manager APIs with Kafka.
HTTP Source Connector for Confluent Cloud
The events endpoint can easily be integrated with the HTTP Source Connector for Confluent Cloud, an official managed Kafka connector, available on the Confluent Cloud. The connector forwards all Data Mesh Manager events to a defined Kafka topic.
Use these events in Kafka to trigger further processes in your data platform, such as granting permissions, provisioning resources or notifications.
In Confluent search for the connector plugin HTTP Source:
Configuration
Configure the connector with these settings:
| Configuration | Value | Remarks |
|---|---|---|
| HTTP(S) URL | https://api.datamesh-manager.com/api/events | |
| Endpoint Authentication Type | none | |
| SSL Enabled | true | (no further keystore settings required) |
| Topic Name Pattern | datameshmanager.events | or any other topic name that matches your conventions |
| HTTP Request Method | GET | |
| Select output record value format | JSON | |
| HTTP Request Headers | x-api-key: your-secret-api-key | See details for API Key generation |
| HTTP Request Parameters | lastEventId=${offset} | |
| HTTP Request Body | (empty) | |
| HTTP Initial Offset | (empty) | |
| HTTP Offset Mode | CHAINING | |
| HTTP Response Data JSON Pointer | (empty) | |
| HTTP Offset JSON Pointer | /id | |
| Request Interval (ms) | 15000 |
The settings should now look like this:
