Skip to content

Add AWS EKS API autoscaling (Prometheus + adapter) - #94

Draft
Erik Weathers (erikdw) wants to merge 14 commits into
mainfrom
erikdw/api-autoscaling-aws-prom
Draft

Add AWS EKS API autoscaling (Prometheus + adapter)#94
Erik Weathers (erikdw) wants to merge 14 commits into
mainfrom
erikdw/api-autoscaling-aws-prom

Conversation

@erikdw

Copy link
Copy Markdown
Contributor

Summary

  • Stacks on the GKE autoscaling branch: keep AutoscalingMetric for cloud=google, add in-chart Prometheus + prometheus-adapter for cloud=aws.
  • HPA uses the same CPU / event-loop ratio (0.4) / delay mean seconds (0.05) targets; AWS metric names come from the adapter (event_loop_*).
  • Unit tests cover Google vs AWS template selection and unsupported-cloud failure.

Test plan

  • ./test.sh (unit + render + lint) locally
  • Helm upgrade on erikdw-sandbox2 with cloud: aws and api.autoscaling.enabled: true
  • Confirm Prom scrapes :8001/metrics, custom.metrics has ELU/delay, HPA currents non-zero
  • Rebase/retarget onto main after the GKE PR merges

Made with Cursor

Adds optional Horizontal Pod Autoscaling on GKE using native
AutoscalingMetric support. When turned on, the API scales on CPU,
event-loop utilization, and mean event-loop delay (same signals we use
on AWS ECS), and Prometheus metrics are enabled automatically. Requires
GKE 1.35.1+.

See https://docs.cloud.google.com/kubernetes-engine/docs/how-to/expose-custom-metrics-autoscaling
@erikdw

Copy link
Copy Markdown
Contributor Author

Sync / retest (2026-08-10)

  • Already contains main (no rebase needed); still correctly stacked on GKE #95.
  • Re-validated on erikdw-sandbox2: Prom targets up on :8001/metrics, custom.metrics ELU/delay present (1m / 20m), HPA cpu: 0%/50%, 1m/400m + 1 more….
  • Helm-upgraded with current chart + nested api.autoscaling.* values schema.

@erikdw
Erik Weathers (erikdw) force-pushed the erikdw/api-autoscaling-aws-prom branch from c943428 to aa9106b Compare August 14, 2026 00:11
brianvans (brianvans) and others added 4 commits August 14, 2026 11:12
Better document hard requirement on v2.9.0 for /metrics endpoint
Rebase onto Brian's pool-based GKE autoscaling and ContainerResource CPU
targeting. Scrapes all API pools and feeds per-pool HPAs through
custom.metrics with the same event-loop targets.

Co-authored-by: Cursor <cursoragent@cursor.com>
@erikdw
Erik Weathers (erikdw) force-pushed the erikdw/api-autoscaling-aws-prom branch from aa9106b to c0f2ea0 Compare August 17, 2026 22:37
Base automatically changed from brianvans/support-autoscaling-api-on-gke to main August 18, 2026 00:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants