dataflow-apps

Argo CD app-of-apps repo for dataflow workloads (Flink jobs, NiFi flow apps, and related pipeline manifests).

This repo should only contain Argo CD child Application/ApplicationSet resources that point to workload repos.

Layout

• manifests/*.yaml: child Application resources, one per workload repo/app.
• infra/nifi/*.yaml: shared NiFi Registry, Registry bucket bootstrap, and external-cluster resources used by workload apps.

Current child apps

• dataflow-nifi-infra -> this repo (prod, infra/nifi/)
• dataflow-cms-translation-app -> https://github.com/dotcomrow/dataflow-cms-translation-app.git (prod, manifests/)
• dataflow-platform-deploy-app -> https://github.com/dotcomrow/dataflow-platform-deploy-app.git (prod, manifests/)
• dataflow-notification-app -> https://github.com/dotcomrow/dataflow-notification-app.git (prod, manifests/)

Deploy model

1. Argo CD deploys this repo (path: manifests).
2. This repo creates/updates child Application resources.
3. Child apps deploy pipeline workloads into dataflow namespace.

This keeps platform runtime (k8s-kafka) separate from pipeline workloads.