Integrations¶
Relation endpoints¶
Required¶
Endpoint |
Interface |
Description |
|---|---|---|
|
|
Metadata storage. Provided by postgresql or postgresql-k8s. |
|
|
Event streaming for metadata change events and audit logging. Provided by kafka or kafka-k8s. |
|
|
Search and graph indexing. Provided by opensearch (machine charm). |
All three are commonly consumed as cross-model offers, since OpenSearch runs on a machine cloud. Each endpoint supports a single relation.
Optional¶
Endpoint |
Interface |
Description |
|---|---|---|
|
|
Exposes the web UI (port 9002). Required for SSO. |
|
|
Exposes the GMS API (port 8080) for external clients. |
|
|
Automatic metadata ingestion from trino-k8s catalogs. |
|
|
OIDC credentials for SSO, from the Canonical Identity Platform or an oauth-external-idp-integrator. |
|
|
Forwards logs from all three containers to Loki. |
Provided¶
Endpoint |
Interface |
Description |
|---|---|---|
|
|
Prometheus scrape configuration for the GMS and frontend JMX exporters. |
|
|
Ships the “DataHub Monitoring” dashboard to Grafana. |
|
|
GMS URL and a dedicated service account token, consumed by charms that call the DataHub API on their own behalf, such as datahub-mcp-k8s. One service account per relation. |
Charm-managed resources in DataHub¶
Through the trino-catalog and datahub-client integrations, the charm creates resources inside DataHub. They are identifiable by naming convention, and user-created resources that do not match these patterns are never touched:
Resource |
Naming pattern |
Example |
|---|---|---|
Ingestion sources |
|
|
Per-catalog password secrets |
|
catalog |
GMS access token secret |
|
- |
Service accounts for |
|
|
Catalog names are normalized by uppercasing and replacing non-alphanumeric characters with _. The charm never deletes the ingestion sources and secrets it creates for Trino catalogs: when a catalog is removed or the Trino relation is broken, they stay in place, so that removing the relation cannot destroy customized ingestion sources. Remove the ones you no longer want in the DataHub UI.
Service accounts are different: the one created for a datahub-client relation is deleted when that relation is removed, which invalidates the tokens issued for it.
Juju secrets used by the charm¶
Secret |
Owner |
Purpose |
|---|---|---|
|
User |
GMS and frontend encryption keys; referenced by the |
|
Charm |
The auto-generated initial admin password, returned by the |
|
Charm |
Internal system client credentials for GMS. |
|
Charm |
Access token used by charm-managed ingestion sources. |