-
This release builds with Go
v1.26.4 -
This release builds with
k8s.io/client-go:v0.35.4 -
[SECURITY] Upgrade Go toolchain to address CVE-2026-42504 (GO-2026-5038) by @slessard in #2982
-
[SECURITY] Fix several high-scoring CVEs (golang.org/x/net, oauth2, sys, term, text) by @slessard in #2981
-
[BUGFIX] Fix watch-list bookmarks with sharding (WatchListClient compatibility) by @jfremy-openai in #2974
-
[BUGFIX] Don't panic on CronJobs with unparseable schedules by @atosatto in #2978
NOTE: This release addresses a security vulnerability (GHSA-g3c8-4qh2-rhrg) where /debug/pprof/* endpoints were not protected by the --auth-filter flag. The endpoints have been moved to the telemetry server and are now correctly gated. See #2924 for details. Credits to @vldevadath for responsible disclosure.
-
This release builds with Go
v1.26.2 -
This release builds with
k8s.io/client-go:v0.35.4 -
[SECURITY] Fix authentication bypass: move pprof endpoints to telemetry server and protect with auth filter (GHSA-g3c8-4qh2-rhrg) by @bhope in #2924
-
[SECURITY] Bump
go-jose/v4tov4.1.4for CVE-2026-34986 by @marioferh in #2941 -
[SECURITY] Fix CVE-2026-24051 in otel go library by @marvin659 in #2908
-
[SECURITY] Fix CVE-2026-39883 in otel go library by @Dinesh-Jilagam in #2952
-
[SECURITY] Bump
google.golang.org/grpctov1.79.3by @sturman in #2925 -
[FEATURE] Add
PreemptionBySchedulerandTerminationByKubelettokube_pod_status_reasonby @bhope in #2892 -
[FEATURE] Add
SchedulingGatedtokube_pod_status_reasonby @bhope in #2880 -
[FEATURE] Add
containerlabel to HPA ContainerResource metrics by @bxrne in #2836 -
[FEATURE] Add deployment-based sharding example by @ystkfujii in #2931
-
[BUGFIX] Handle DeletedFinalStateUnknown panic in CR informer by @rexagod in #2955
-
[BUGFIX] Fix memory leak from orphaned CR reflector goroutines on repeated CRD discovery by @bhope in #2920
-
[BUGFIX] Load CRS config when
--continue-without-custom-resource-state-config-fileis set and file exists by @ybouhachem in #2918 -
[BUGFIX] Accept legacy
custom_resource_config_fileas deprecated alias by @nmn3m in #2926 -
[BUGFIX] Fix order-dependent metric loss from header deduplication by @jfremy-openai in #2866
-
[BUGFIX] Avoid mutating metric families during write by @bhope in #2852
-
[BUGFIX] Honor
stderrthresholdwhenlogtostderris enabled by @pierluigilenoci in #2906 -
[ENHANCEMENT] Bump to Kubernetes 1.35 by @mrueg in #2861
-
[ENHANCEMENT] Build with Go 1.26 by @mrueg in #2890
-
[ENHANCEMENT] Switch to a maintained fork of
robfig/cronby @mrueg in #2874
NOTE: This release addresses a regression that caused a panic when new versions were added to existing CustomResourceDefinitions. See the post-mortem analysis in #2838 for more details.
NOTE: endpointslices are now part of the default resources exposed as metrics. endpoints is deprecated and needs to be manually activated through the --resources flag. See #2659 for more details.
-
This release builds with Go
v1.25.6 -
This release builds with
k8s.io/client-go:v0.34.3 -
[CHANGE] Replace endpoints with endpointslices as default resource by @mrueg in #2659
-
[BUGFIX] Fix regression: React on WATCH updates for CRD informer by @rexagod in #2838
-
[BUGFIX] Deduplicate tolerations when generating
kube_pod_tolerationsby @bhope in #2835 -
[FEATURE] Allow filtering resources via URL parameters by @mrueg in #2844
-
[FEATURE] Add
kube_job_status_readymetric by @nmn3m in #2771 -
[FEATURE] Add
kube_deployment_ownermetric by @nmn3m in #2782 -
[FEATURE] Add
kube_deployment_status_replicas_terminatingandkube_replicaset_status_terminating_replicasmetrics by @atiratree in #2708 -
[FEATURE] Promote CronJob, HPA, and Pod metrics from BETA to STABLE by @nmn3m in #2798
-
[FEATURE] Promote StatefulSet metrics to STABLE by @yasicar in #2783
-
[FEATURE] Add info metric for client-go version by @fpetkovski in #2739
-
[FEATURE] Warn on probe failing by @mickael-carl in #2808
-
[ENHANCEMENT] Add
failedcondition tokube_certificatesigningrequest_conditionby @ksmiley in #2841 -
[ENHANCEMENT] Reduce allocations when creating metric families by @fpetkovski in #2807
-
[ENHANCEMENT] Bump to kubernetes 1.34 by @mrueg in #2785
-
[ENHANCEMENT] Bump exporter-toolkit by @mrueg in #2770
-
[ENHANCEMENT] Replace gojsontoyaml with gojq by @mrueg in #2660
-
[ENHANCEMENT] Split benchmarks by @mrueg in #2759
-
This release builds with Go
v1.24.6 -
This release builds with
k8s.io/client-go:v0.33.4 -
This release is the last release that has endpoint metrics enabled by default. In the next release we will enable endpointslices metrics and disable endpoint metrics by default, since the endpoint resources are deprecated. You can still alter this behaviour in kube-state-metrics' config.
-
[FEATURE] Add new metric for pod unscheduled time tracking by @yshngg in #2699
-
[BUGFIX] Fix index out of range by @taraspos in #2716
-
[BUGFIX] Config file overrides apply to some fields but not other by @rashmichandrashekar in #2705
-
[BUGFIX] Fix logic for plain text fallback format by @timonegk in #2730
-
[FEATURE] Include reason label to
kube_deployment_status_conditionby @Rishab87 in #2719 -
[FEATURE] Continue running kube-state-metrics when config file doesnt exist at startup by @rashmichandrashekar in #2703
-
[FEATURE] Introduce deletion timestamp metric for daemonset, statefulset, deployment, service and pdb by @IgorIgnatevBolt in #2678
-
[FEATURE] Add HorizontalPodAutoscaler created and deletionTimestamp info into metrics by @IgorIgnatevBolt in #2675
Note:
-
This release builds with Golang
v1.24.4 -
This release builds with
k8s.io/client-go:v0.32.6 -
[FEATURE] Add a
reclaim_policylabel to thekube_persistentvolume_infometric by @SuperQ in #2615 -
[FEATURE] Use dlclark/regexp2 over standard library's package to support lookarounds by @rexagod in #2616
-
[BUGFIX] Report correct values in
kube_pod_status_reasonmetric by @carlosmorenokm1 in #2644 -
[FEATURE] Add add
pathTypetokube_ingress_pathby @rexagod in #2670 -
[FEATURE] Introduce object limits by @mrueg in #2626
-
[BUGFIX] Close reflectors once their corresponding CRDs are dropped by @rexagod in #2672
-
[FEATURE] Incorporate
WithAuthenticationAndAuthorizationto support endpoint authn/z by @mrueg in #2686
Note:
-
This release builds with Golang
v1.23.5 -
This release builds with
k8s.io/client-go:v0.32.1 -
[BUGFIX] Fix CR cache for GVK all specified case by @chelseychen in #2567
-
[BUGFIX] Deduplicate tolerations before creating metric by @RiRa12621 in #2559
-
[BUGFIX] Make
$VERSION3rd-party independant by @rexagod in #2572 -
[BUGFIX] Fix NoNodePod naming in jsonnet by @mrueg in #2598
-
[BUGFIX] Panic in
util.GVRFromTypefor structured types by @L3n41c in #2553 -
[FEATURE] Add external traffic policy to kube_service_info by @jahantech in #2584
-
[FEATURE] Promote kube_statefulset_ordinals_start from ALPHA -> STABLE by @pwschuurman in #2415
-
[FEATURE] Add timezone to kube_cronjob_info / Make kube_cronjob_next_schedule_time timezone-aware by @mrueg in #2376
Note:
-
This release builds with Golang
v1.23.3 -
This release builds with
k8s.io/client-go:v0.31.2 -
This release removes
kube_endpoint_address_not_readyandkube_endpoint_address_availablewhich have been deprecated in 2022. Please usekube_endpoint_addressas a replacement. -
[BUGFIX] Use --track-unscheduled-pods to select unscheduled pods in Daemonset sharding by @CatherineF-dev in #2388
-
[BUGFIX] Install tools so VERSION gets set by @mrueg in #2456
-
[BUGFIX] Syntax errors in kube-state-metrics.libsonnet by @jeffmccune in #2454
-
[BUGFIX] Set kube_job_status_failed metric even when there are no job.Status.Conditions present by @richabanker in #2485
-
[BUGFIX] de-duplication of custom resource metrics by @bartlettc22 in #2502
-
[BUGFIX] Configure sharding every time MetricsHandler.Run runs by @wallee94 in #2478
-
[BUGFIX] Panic in
util.GVRFromTypefor core objects by @L3n41c in #2535 -
[BUGFIX] Big memory value overflow by @leiwingqueen in #2540
-
[BUGFIX] Expose empty labels by @mrueg in #2539
-
[BUGFIX] CustomResourceMetrics: Convert status condition Unknown to a valid value by @Haleygo in #2536
-
[CHANGE] Remove deprecated endpoint address metric by @mrueg in #2527
-
[FEATURE] Add new metric kube_job_status_suspended by @Indresh2410 in #2542
-
[FEATURE] Move endpoint ports into address metric by @mrueg in #2503
-
[ENHANCEMENT] Use concurrent map when storing metrics by @rarruda in #2510
Note:
-
This release builds with Golang
v1.22.5. -
This release builds with
k8s.io/client-go:v0.30.3. -
This release adds read and write timeouts for requests. The defaults might have an impact on scrapes that take a long time.
-
[BUGFIX] Pod autosharding: transition from labelselector to fieldselector by @pkoutsovasilis in #2347
-
[ENHANCEMENT] Add automatic detection of memory limits by @SuperQ in #2447
-
[FEATURE] Add
readyzendpoint by @rexagod in #2442 -
[FEATURE] Add
livezendpoint by @rexagod in #2418 -
[FEATURE] Add kube_persistentvolume_volume_mode metric by @ricardoapl in #2370
-
[FEATURE] Add read and write timeouts by @Pokom in #2412
Note:
-
This release addresses a critical issue where scraping the exposition data for certain types caused metrics-backends to crash: #2248.
-
This release builds with
k8s.io/client-go:v0.29.3. -
[BUGFIX] Fallback to
gaugeforprotobuf-based negotiations by @rexagod in #2270 -
[ENHANCEMENT] Add
kube_pod_container_status_last_terminated_timestampby @tetianakravchenko in #2291 -
[FEATURE] Allow prefixing expandable paths by @rexagod in #2052
Note:
This release builds with Golang v1.21.8.
- [ENHANCEMENT] Add OpenSSF Scorecard to README by @dalehenries in #2277
- [ENHANCEMENT] Generate OpenVX data for every release by @shafeeqes in #2276
- [ENHANCEMENT] Add restartPolicy to
kube_pod_init_container_infometric by @changhyuni in #2240 - [FEATURE] Add
kube_node_status_addressesmetric by @stonith in #2252 - [FEATURE] Add namespace label to
endpointslicemetrics by @mrueg in #2266 - [FEATURE] Add opt-in
kube_persistentvolume_csi_attributesmetric by @machadovilaca in #2133 - [FEATURE] Add new metric
kube_pod_schedulermetric by @adinhodovic in #2222 - [FEATURE] Support filtering annotations allow-list by
*by @xonvanetta in #2234 - [ENHANCEMENT] Support scraping pod metrics that are still in scheduling status and have no assigned nodes by @mickeyzzc in #2217
- [FEATURE] Add backend resource info for
kube_ingress_pathby @rohitphatak in #2109
Note:
-
This release addresses a regression introduced in #2105.
-
[BUGFIX] Remove FieldSelector from non-namespaced resources by @mrueg and @dgrisonnet in #2190
-
[ENHANCEMENT] Bump Go to v1.20.8
Note:
-
Label and annotation metrics aren't exposed by default anymore to reduce the memory usage of the default configuration of kube-state-metrics. Before this change, they used to only include the name and namespace of the objects which is not relevant to users not opting in these metrics.
-
[BUGFIX] Log no _info suffix in name only once per reading the configuration for custommetrics by @chrischdi in #2157
-
[BUGFIX] Don't crash on non-existent valueFrom path values by @chihshenghuang in #2140
-
[BUGFIX] Index out of range in metrics_store.SanitizeHeaders by @mrueg in #2166
-
[BUGFIX] Always extract the headers but only write it when we have custommetrics by @chrischdi in #2154
-
[BUGFIX] Add filtering for Lease metrics by @ntoofu in #2122
-
[FEATURE] Implement kube_pod_status_initialized_time by @opeco17 in #2148
-
[FEATURE] Disable labels and annotations metrics when metric-annotations-… by @opeco17 in #2145
-
[FEATURE] Add webhooks client config service metrics by @dgrisonnet in #2114
-
[FEATURE] Support kube_persistentvolumeclaim_deletion_timestamp by @maxime1907 in #2074
-
[FEATURE] Support kube_persistentvolume_deletion_timestamp by @maxime1907 in #2075
-
[FEATURE] Adds new metric
kube_pod_service_accountby @swarup-stripe in #2096 -
[FEATURE] Add volumemode to PVC info metric by @machadovilaca in #2134
-
[FEATURE] Enable metric-annotations-allowlist and metric-labels-allowlist for ResourceQuota by @opeco17 in #2175
-
[FEATURE] Allow field KV general matching by @rexagod in #2067
-
[FEATURE] Support hot reload for kubeconfig by @opeco17 in #2144
-
[FEATURE] Add support for endpoint topology routing hints by @MarkSRobinson in #2090
This release does not incorporate any user-facing changes. Re-running release procedures as the process for the previous release failed. Changes are listed in v2.9.0.
This release does not incorporate any user-facing changes. Re-running release procedures as the process for the previous release failed. Changes are listed in v2.9.0.
The changes mentioned below are only the user-facing ones. For a list of the complete set of changes, refer the changelog associated with the release tag.
Note:
-
The deprecated experimental VerticalPodAutoscaler metrics are no longer supported, and have been removed. We recommend to use CustomResourceState metrics to gather metrics from custom resources like the Vertical Pod Autoscaler.
-
#2004 regulated label names to adhere with OTel-Prometheus standards, so existing label names that do not follow the same may be replaced by the ones that do. Please refer to the PR for more details.
-
[BUGFIX] Adhere to OTel-Prometheus standard for labels #2004 @rexagod
-
[BUGFIX] Respect relative paths for label resolutions #2007 @rexagod
-
[BUGFIX] Support LabelsFromPath functionality for Info-typed metrics #2048 @murphd40
-
[CHANGE] Remove VerticalPodAutoscaler #2017 @mrueg
-
[ENHANCEMENT] Add StatefulSet Start Ordinal metrics for KEP-3335 #1959 @pwschuurman
-
[ENHANCEMENT] Add namespace label to
kube_lease_renew_time#2073 @A-Hilaly -
[ENHANCEMENT] Add parameters for PodSecurity #2042 @jcpunk
-
[ENHANCEMENT] Add support for multi cluster prometheus alerts #2058 @jkroepke
-
[ENHANCEMENT] Don't crash on non-existent path values #1998 @rexagod
-
[ENHANCEMENT] Only use OpenMetrics and Text in contentType #2024 @CatherineF-dev
-
[ENHANCEMENT] Update go version to 1.20.4 #2056 @RamakrishnanArun
-
[FEATURE] Add support for variable VKs in CRS config #1851 @rexagod
-
[FEATURE] Support quantities and percentages #1989 @mrueg
-
[FEATURE] Use prometheus/exporter-toolkit landing page #2034 @mrueg
- [BUGFIX] Only use OpenMetrics and Text in contentType #2024 @CatherineF-dev
- [BUGFIX] Don't crash on non-existent paths @rexagod #1998
- [BUGFIX] Fix public Builder compatibility with BuilderInterface @clamoriniere #1994
Note: The --version flag was removed as kube-state-metrics version also provides the same information. See #1956
Note: Experimental CustomResourceState changed their labels for better usability. See #1942 kube_crd_uptime{group="myteam.io", kind="Foo", version="v1"} -> kube_customresource_uptime{customresource_group="myteam.io", customresource_kind="Foo", customresource_version="v1"}
- [CHANGE] Prefix Group, Version and Kind labels for CustomResourceState Metrics #1942 @bavarianbidi
- [CHANGE] Fix empty string for "owner_*" dimensions #1923 @pawcykca
- [CHANGE] Remove broken --version flag, replace by version command #1956 @bjorand
- [FEATURE] Add metrics for EndpointSlices #1910 @mrueg
- [FEATURE] Add metrics for config file changes #1916 @mrueg
- [FEATURE] Add metrics for CustomResource State config file change #1928 @mrueg
- [FEATURE] Reload Kube-State-Metrics on CustomResourceState config file change #1930 @mrueg
- [FEATURE] Make CustomResourceState metrics type dynamic #1930 @rexagod
- [FEATURE] Add kube_pod_status_qos_class to pod metrics #1932 @frezes
- [FEATURE] Add kube_pod_status_ready_time and kube_pod_status_containers_ready_time metrics #1938 @ryanrolds
- [FEATURE] Enrich UserAgent with more information about kube-state-metrics #1960 @mrueg
- [FEATURE] Convert True/False to 1.0/0.0 values in CustomResourceState metrics #1963 @jabdoa2
- [FEATURE] Expose metrics in OpenMetrics format #1974 @mrueg
- [BUGFIX] Handle unit length
valueFromvalues #1958 @rexagod - [ENHANCEMENT] Build with kubernetes 1.26 #1933 @mrueg
Note: Experimental VerticalPodAutoscaler metrics are considered deprecated in this release and will be removed in v2.9.0. Please use CustomResourceStateMetrics to gather metrics from VPA resources. See: #1718
Note: Experimental CustomResourceState changed their naming convention for better usability. The name of the CRD used to be interpolated into the name of the metric which made it impossible to aggregate a CRD across different versions. This was changed to have the GVK information represented as labels: kube_myteam_io_v1_Foo_uptime -> kube_crd_uptime{group="myteam.io", kind="Foo", version="v1"} See: #1847
- [CHANGE] Deprecate VerticalPodAutoscaler metrics #1835 @rexagod
- [CHANGE] Recommend kube-scheduler metrics for container resource limits and requests #1849 @rexagod
- [FEATURE] Add experimental kube_pod_container_status_last_terminated_exitcode metric #1752 @ssabo
- [FEATURE] Introduce custom-resources-only flag #1813 @bavarianbidi
- [FEATURE] Allow allowlist filtering by wildcard key #1823 @rexagod
- [FEATURE] Add ContainerResourceSourceType to hpa spec and target metrics #1831 @whitebear009
- [FEATURE] Represent group, version and kind of a resource as labels #1850 @rexagod
- [FEATURE] Sharding metrics per node via fieldSelector #1864 @CatherineF-dev
- [FEATURE] Add experimental StatefulSet retention policy metrics #1876 @mattcary
- [FEATURE] Allow labelFromKey field for all applicable metric types #1880 @rexagod
- [FEATURE] Introduce Viper, allow hot-reload on config change #1827 @rexagod
- [FEATURE] Introduce Cobra, allow configuration via environment variables #1834 @rexagod
- [FEATURE] Add experimental kube_node_deletion_timestamp metric #1890 @rexagod
- [FEATURE] Support autoscaling/v2 resources for HorizontalPodAutoscaler #1906 @JoaoBraveCoding
- [FEATURE] Add IngressClass metrics #1905 @kaitoii11
- [ENHANCEMENT] Import Kubernetes metrics stability framework #1844 @CatherineF-dev
- [ENHANCEMENT] Promote kube_pod_container_status_waiting_reason and kube_deployment_status_replicas_ready to stable #1821 @CatherineF-dev
- [ENHANCEMENT] Build with Kubernetes 1.25 and go 1.19 #1819 @mrueg
- [BUGFIX] Handle singular labels in allowlist #1826 @rexagod
- [BUGFIX] Do not expose ingress path metric when service is nil #1841 @evir35
- [BUGFIX] Allow lease metrics to be exported across all namespaces #1845 @lantingchiang
- [FEATURE] Add local storage labels to kube_persistentvolume_info #1814 @nabokihms
- [FEATURE] Add support for StateSet and Info metrics for Custom-Resource State #1777 @chrischdi
- [FEATURE] Add support for Rolebinding resource metrics #1799 @kaitoii11
- [FEATURE] Add new kube_horizontalpodautoscaler_status_target_metric #1725 @tanguyfalconnet
- [FEATURE] Add support for Role and Clusterrole resource metrics #1759 @kaitoii11
- [FEATURE] Add support for the ServiceAccount resource metrics #1773 @Serializator
- [FEATURE] Add metric for pod tolerations #1769 @Serializator
- [FEATURE] Add new kube_endpoint_address metric #1761 @bavarianbidi
- [FEATURE] Support reading the timestamp fields of custom resources #1766 @dontan001
- [ENHANCEMENT] Migrate to structured logging #1807 @dmpe
- [ENHANCEMENT] Switch registry vanity domain from k8s.gcr.io to registry.k8s.io #1750 @mrueg
- [ENHANCEMENT] Graduate new endpoint metrics to stable #1812 @bavarianbidi
- [BUGFIX] Fix label name for kube_pod_nodeselector #1756 @yosshi825
- [BUGFIX] Fix Custom-Resource State Metrics not to contain underscores #1754 @chrischdi
- [BUGFIX] Fix kube_node_status_allocatable unit doc #1760 @jumbosushi
- [FEATURE] Add experimental Custom-Resource State Metrics #1710 @iamnoah
- [FEATURE] Add kube_pod_ips metric #1740 @bjschafer
- [FEATURE] Add kube_pod_nodeselector metric #1675 @geojaz
- [FEATURE] Add CSIPersistentVolumeSource to persistent volume metric #1727 @luke-sprig
- [FEATURE] Add kube_cronjob_status_last_successful_time metric #1732 @splitice
- [FEATURE] Add kube_persistentvolumeclaim_created metric #1741 @aidan-ogorman-dev
- [ENHANCEMENT] Build with Go 1.18 #1726, #1745 @mrueg
- [ENHANCEMENT] Bump kubernetes 1.24 and other go dependencies #1726, #1743 @mrueg
- [ENHANCEMENT] Update x/crypto to mitigate CVE-2022-27191 #1721 @pgvishnuram
- [BUGFIX] Assert that newlines in comma separated arguments are ignored #1706 @sthaha
- [BUGFIX] Fix potential panic in pod store #1723 @mfojtik
- [BUGFIX] Fix potential panic in internal store #1731 @jan--f
- [BUGFIX] Properly initialize KSM Server test #1699 @fpetkovski
- [BUGFIX] Publish images with with the correct tag
- [FEATURE] Add
ingressclasslabel tokube_ingress_infometric #1652 @adammw - [FEATURE] Extend KSM library to support custom resource metrics #1644 @Garrybest
- [ENHANCEMENT] Use apiVersion
v1forPodDisruptionBudgetandCronJobresources #1491 @bison - [ENHANCEMENT] Optimize slice allocations #1676 @sherifabdlnaby
- [BUGFIX] Use plural form of resource name in
allowlistfor PodDisruptionBudget #1653 @arajkumar
- [FEATURE] Add a
--namespace-denylistcommand line flag to exclude metrics from certain namespaces #1596 #1595 @mallow111 - [FEATURE] Add
kube_*_labelsandkube_*_annotationsmetrics for Pod Disruption Budgets #1623 @arajkumar - [FEATURE] Add a Kustomization file for deploying KSM in authosharding mode #1603 @karancode
- [FEATURE] Expose a metric for the number of ports in endpoint objects #1571 @bavarianbidi
- [FEATURE] Add a command line flag for opt-in metrics #1643 @Serializator
- [FEATURE] Add
kube_horizontalpodautoscaler_infometric #1648 @Serializator - [ENHANCEMENT] Update Go to 1.17.4 #1649 @fpetkovski
- [ENHANCEMENT] Update Kubernetes to 1.23 #1649 @fpetkovski
- [BUGFIX] Report the correct architecture for arm64 images #1629 @Serializator
- [BUGFIX] Fix BuilderInterface and BuildStoresFunc to allow using KSM as a library #1618 @ahmed-mez
- [BUGFIX] Fix the image build job. Reverts #1602
- [BUGFIX] Downgrade latest allowed go version to 1.16.9 #1601 @mrueg
- [BUGFIX] Fix CI variable names used for building KSM images @mrueg
- [FEATURE] Add the kube_persistentvolumeclaim_annotations metric which exposes annotations on PVCs #1566 @arajkumar
- [BUGFIX] Revert the accidentally removed kube_persistentvolumeclaim_labels metric #1566 @arajkumar
- [BUGFIX] Filter annotations in metrics based on
--metric-annotations-allowlistinstead of--metric-labels-allowlistfor CronJob, Daemonset, HPA and Ingress resources #1580 @midnw - [BUGFIX] Avoid panicking when VPA objects have no targetRef #1584 @nabokihms
- [FEATURE] Add --use-apiserver-cache flag to set resourceVersion=0 for ListWatch requests #1548
- [FEATURE] Introduce metrics for Kubernetes object annotations #1468
- [FEATURE] Introduce start time metric for containers in terminated state #1519
- [FEATURE] Introduce metrics for cronjob job history limits #1535
- [FEATURE] Add system_uuid dimension to kube_node_info metric #1535
- [FEATURE] Add available replica metric for statefulsets #1532
- [FEATURE] Add ready replica metric for deployments #1534
- [CHANGE] Update go clients for Kubernetes to support 1.22 #1545
- [CHANGE] Use new promlint package and update prometheus cli to 2.28.1 #1531
- [CHANGE] go.mod: Update and minimize dependencies #1529
- [CHANGE] Use BuilderInterface instead of internal/store.Builder in metricshandler #1537
- [CHANGE] Add WithAllowLabels to public BuilderInterface #1514
- [BUGFIX] Fixes a bug where KSM did not export any metrics when it had no permissions for resources in at least one namespace #1499
- [CHANGE] Update go version and dependencies #1493
- [FEATURE] Add support for native TLS #1354
- [FEATURE] Add wildcard option to metric-labels-allowlist #1403
- [FEATURE] Add build info metric #1332
- [CHANGE] Add "uid" label to every pod metric #1304
- [CHANGE] Add resourceVersion to CronJob metrics #1447
- [CHANGE] Update go version and dependencies #1474
- [CHANGE] Bump client-go and friends to v0.21 (Kubernetes v1.21) #1463
- [CHANGE] Replace deprecated use of ioutil #1458
- [BUGFIX] Fix builder.Builder WithMetrics signature #1455
- [BUGFIX] Fix pod-metric missing reasons #1287
- [BUGFIX] Fix multiListWatch resourceVersion mismatch if watch reconnected #1377
- [CHANGE] Update go version and dependencies #1440
- [CHANGE] Rename --labels-metric-allow-list to --metric-labels-allowlist #1424
- [CHANGE] Remove deprecated Kubernetes APIs #1423
- [CHANGE] go.mod: Update Dependencies #1419
- [CHANGE] Remove vendor folder #1419
- [CHANGE]
k8s.gcr.io/kube-state-metrics/kube-state-metricsbecomes the authoritative registry Location on quay.io will not be updated anymore. Previously pushed images will be kept around to avoid breaking existing deployments.
- [CHANGE] internal/store/pod.go: Only create waiting_reason series if pods are in waiting state #1378
- [CHANGE] internal/store/pod.go: Only create terminated_reason series if pods are in terminated state #1381
- [CHANGE] internal/store/pod.go: Only create last_terminated containers series if containers are terminated state #1397
- [FEATURE] Bump client-go and friends to v0.20 (kubernetes v1.20) #1328
- [FEATURE] Bump go version to 1.16+ #1399
- [BUGFIX] Fix gzip writer #1372
- [BUGFIX] fix labels-metric-allow-list documentation #1404
- [BUGFIX] Propagate resource version when sharded #1402
Promotion to beta release after a period of no bugs.
- [BUGFIX] Fix container resource limits metrics, which got dropped #1293
- [BUGFIX] Adjust and refactor allowing labels to work for Kubernetes labels metrics #1301 Note this is a breaking change, if you were using --labels-allow-list, look at the PR details for more information.
- [CHANGE] Migrate ingress and certificates to new stable APIs #1260
- [CHANGE] Revert "Rework resource metrics" #1278 To better align with future Kubernetes resource metrics, the changes to resource metrics were reverted, new metrics are: kube_pod_container_resource_requests and kube_pod_container_resource_limits
- [FEATURE] Added the job failure reason in kube_job_status_failed metric #1214
- [FEATURE] feat(persistentvolume): claimRef info to labels (kube_persistentvolume_claim_ref) #1244
- [FEATURE] pod: add gauge for runtimeclass handler (kube_pod_runtimeclass_name_info) #1276
- [CHANGE] Update go module path to k8s.io/kube-state-metrics/v2 #1238
- [CHANGE] Bump klog to v2 and client-go to 1.19 #1250
- [FEATURE] Add iscsi initiator name to persistentvolume_info #1235
- [BUGFIX] Added Namespace to Rolebinding Jsonnet #1233
- [BUGFIX] Reference closure scoped family generator #1240
NOTE: This is a major new alpha 2.0 release with breaking changes and removed metrics. See details below!
- [CHANGE] Apply boundaries to metrics and allow via flag (--labels-allow-list) what labels to include #1125
- [CHANGE] Update DaemonSet updated_number_scheduled metric name to be consistent #1181 Metric was changed from kube_daemonset_updated_number_scheduled to kube_daemonset_status_updated_number_scheduled
- [CHANGE] Rework resource metrics #1168 Metrics kube_pod_container_resource_requests, kube_pod_container_resource_limits, kube_pod_overhead, kube_pod_init_container_resource_limits, kube_pod_init_container_resource_requests changed
- [CHANGE] Convert k8s labels to snake case #1165
- [CHANGE] Mutatingwebhookconfiguration.go: Switch to v1 #1144
- [CHANGE] v2: Rename storage class labels reclaimPolicy to reclaim_policy and volumeBindingMode to volume_binding_mode #1107
- [CHANGE] v2: Renamed --namespace flag to --namespaces #1098
- [CHANGE] Rename kube_pod_deleted to kube_pod_deletion_timestamp #1079
- [CHANGE] v2: Rename collector flag to resource flag #1006 --resources is the new flag
- [CHANGE] Remove non-identifying labels from pod metrics #1009
- [CHANGE] v2: Remove deprecated stable metrics #1004
Note that some of these were replaced with EXPERIMENTAL resource metrics. See #1168 for more details.
kube_pod_container_resource_requestsandkube_pod_container_resource_limitsare the replacements withresourcelabels representing the resource name andunitlabels representing the resource unit.- kube_pod_container_resource_requests_cpu_cores
- kube_pod_container_resource_limits_cpu_cores
- kube_pod_container_resource_requests_memory_bytes
- kube_pod_container_resource_limits_memory_bytes
kube_node_status_capacityandkube_node_status_allocatableare the replacements withresourcelabels representing the resource name andunitlabels representing the resource unit.- kube_node_status_capacity_pods
- kube_node_status_capacity_cpu_cores
- kube_node_status_capacity_memory_bytes
- kube_node_status_allocatable_pods
- kube_node_status_allocatable_cpu_cores
- kube_node_status_allocatable_memory_bytes
- [CHANGE] Rename black-/whitelist to allow/deny-list #1045 New flags are --metric-allowlist and --metric-denylist
- [CHANGE] Update telemetry port to 8081 #1049
- [CHANGE] v2: Rename hpa metrics to use full horizontalpodautoscaler #1003 All metrics with prefix of kube_hpa_ were renamed to kube_horizontalpodautoscaler_
- [CHANGE] v2: change metrics port to 8080, telemetry port to 8081 #1005
- [FEATURE] Add http request metric for kube-state-metrics main /metrics #1218
- [FEATURE] Add fc/iscsi/nfs identifier tags to persistentvolume_info metric #1208
- [FEATURE] Adds new pod metric kube_pod_container_state_started #1183
- [FEATURE] Add observedGeneration metric (kube_daemonset_status_observed_generation) for DaemonSets #1178
- [FEATURE] Add internal_ip to node_info #1172
- [FEATURE] Avoid conflicts when mapping Kubernetes labels to Prometheus labels #1156
- [FEATURE] Add aws/gce volume id to kube_persistentvolume_info #1146
- [FEATURE] Add UnexpectedAdmissionError to kube_pod_status_reason metric #1145
- [FEATURE] Add init container requests (kube_pod_init_container_resource_requests) #1123
- [FEATURE] Add host_network to kube_pod_info #1100
- [FEATURE] Add kube_replicationcontroller_owner #1058
- [FEATURE] Pod: add gauges for pod overhead (kube_pod_overhead) #1053
- [FEATURE] Add "Terminating" status in kube_pod_status_phase metrics #1013
- [FEATURE] Add lease collector metrics #1038
- [ENHANCEMENT] Add DeprecatedVersion to struct FamilyGenerator and func NewFamilyGenerator #1160
- [ENHANCEMENT] Add security context to deployment and statefulset #1034
- [BUGFIX] Fix VolumeAttachment API version mismatch: expected v1 but watching v1beta1 #1136
- [BUGFIX] Fix various CI issues (kube_volumeattachment_info nodeName -> node label rename) #1117
- [BUGFIX] Fix maxUnavailable to round down instead up #1076
- [BUGFIX] internal/store/mutatingwebhookconfiguration.go: Switch to v1 #1144
- [BUGFIX] Fix VolumeAttachment API version mismatch: expected v1 but watching v1beta1 #1136
- [BUGFIX] Switch to using only v1 client of validatingwebhookconfiguration #1052
- [BUGFIX] Fix VolumeAttachment api version to be used (was v1beta1, should have been v1). #1043
- [BUGFIX] Fix MutatingWebhookConfiguration api version to be used (was v1beta1, should have been v1). #1043
- [BUGFIX] Fix ValidatingWebhookConfiguration api version to be used (was v1beta1, should have been v1). #1043
- [BUGFIX] Use the correct for NetworkPolicy reflector. #1042
- [CHANGE] Remove experimental hpa metrics kube_hpa_status_current_metrics_average_utilization and kube_hpa_status_current_metrics_average_value #1030
- [BUGFIX] Fix segfault with External metrics #1023
- [BUGFIX] Fix segfault in hpa metrics #1019
- [BUGFIX] Fix nil panics when parsing hpa memory current metrics #1014
After a testing period of 7 days, there were no additional bugs found or features introduced.
- [BUGFIX] Move resource version from metric label to metric number value #997
- [CHANGE] Add tools as go modules #927
- [FEATURE] Add
kube_hpa_spec_target_metricmetric. #966 - [FEATURE] Add hpa stats for current utilization and average value. #961
- [FEATURE] Add
kube_namespace_status_conditionmetric. #949 - [FEATURE] Add
kube_persistentvolumeclaim_status_conditionandkube_persistentvolumeclaim_status_phasemetrics #952 - [FEATURE] Add
kube_networkpolicy_*metrics #893 - [FEATURE] Add
kube_volumeattachment_*metrics #946 - [FEATURE] add
kube_mutatingwebhookconfiguration_*,kube_validatingwebhookconfiguration_*metrics #914 - [ENHANCEMENT] Add
pod_cidrlabel to thekube_node_infometric. #963 - [ENHANCEMENT] Generate all manifests from jsonnet #908
- [ENHANCEMENT] Add kube-state-metrics alerting rules. #962
- [ENHANCEMENT] Add "Evicted" to the set of container terminated reasons. #968
- [BUGFIX] Add check for ReclaimPolicy, VolumeBindingMode storageclass metrics. #929
- [BUGFIX] Use single MultiListerWatcher for single store to fix missing metrics when watching multiple namespaces. #969
- [BUGFIX] Fix nil panics parsing HPA CPU current metrics. #993
After a testing period of 7 days, there were no additional bugs found or features introduced.
- [CHANGE] Pin go version to go mod artifact file #882
- [BUGFIX] Correct mapping of hpa condition status labels #890
- [FEATURE] Introduce sharding (and experimental auto-sharding) #613
- [FEATURE] Add
kube_pod_status_unschedulable metric#835 - [CHANGE] Makefile: Remove tmpdir after container build #867
- [ENHANCEMENT] Add metrics about kube-state-metric's interaction with the Kubernetes API. #866
- [FEATURE] Add
kube_node_role metric#877 - [ENHANCEMENT] Add support for Darwin OS in e2e test #879
- [CHANGE] Revert "add
kube_*_annotations metricsfor all objects" #859 - [CHANGE] Remove
kube_namespace_annotationsmetric #859
- [BUGFIX] Fix crash due to missing ingress http block. #831
- [BUGFIX] Add nil guard checks when querying VPA objects. #832
After a testing period of 7 days, there were no additional bugs found or features introduced.
- [BUGFIX] Use the appsv1 apigroup when building the reflector for replicasets. #816
- [CHANGE] Use appsv1 apigroup for ReplicaSet. #804
- [CHANGE] Use distroless/static as base image to further reduce image size. #748
- [CHANGE] Return standardized text for health endpoint. #767
- [ENHANCEMENT] Add DeadlineExceeded pod termination reason. #740
- [ENHANCEMENT] Add CreateContainerError and InvalidImageName waiting reasons. #763
- [FEATURE] Add Pod init container metrics. #762
- [FEATURE] Add Metrics About StorageClass. #777
- [FEATURE] Allow black/white- listing of metrics by regex. #773
- [FEATURE] Add metrics for VerticalPodAutoscaler objects (experimental and disabled by default). #791
- [FEATURE] Add (experimental)
kube_*_annotationsmetrics. #770
After a testing period of 10 days (release candidate 2), there were no additional bugs found, thus releasing the stable version v1.6.0.
- [FEATURE] Add
kube_replicaset_labelsto replicaset collector (#638). - [FEATURE] Add ingresses collector (#640).
- [FEATURE] Add certificate signing request collector (#650).
- [FEATURE] Add
kube_persistentvolumeclaim_access_modemetric (#673). - [FEATURE] Add
kube_persistentvolume_capacitymetric (#674). - [FEATURE] Add
kube_job_ownermetric (#681). - [ENHANCEMENT] Add
priority_classlabel tokube_pod_infometric (#713). - [BUGFIX] Bump addon-resizer patch version reducing resource consumption (#724).
- [BUGFIX] Use k8s.io/api/apps/v1 for DaemonSet, Deployment and StatefulSet reflector (#720).
After a testing period of 30 days, there were no additional bugs found or features introduced. Due to no bugs being reported over an in total 41 days period, we feel no more pre-releases are necessary for a stable release.
This release's focus was a large architectural change in order to improve performance and resource usage of kube-state-metrics drastically. Special thanks to @mxinden for his hard work on this! See the changelog of the pre-releases for more detailed information and related pull requests.
An additional change has been requested to be listed in the release notes:
- [CHANGE] Due to removal of the surrounding mechanism the
ksm_resources_per_scrapeandksm_scrape_error_totalmetrics no longer exists.
After a testing period of 11 days, there were no additional bugs found or features introduced.
- [CHANGE] Disable gzip compression of kube-state-metrics responses by default. Can be re-enabled via
--enable-gzip-encoding. See #563 for more details. - [FEATURE] Add
kube_replicaset_ownermetric (#520). - [FEATURE] Add
kube_pod_container_status_last_terminated_reasonmetric (#535). - [FEATURE] Add
stateful_set_status.{current,update}_revisionmetric (#545). - [FEATURE] Add pod disruption budget collector (#551).
- [FEATURE] Make kube-state-metrics usable as a library (#575).
- [FEATURE] Add
kube_service_spec_external_ipmetric and addexternal_nameandload_balancer_iplabel tokube_service_infometric (#571). - [ENHANCEMENT] Add uid info in
kube_pod_infometric (#508). - [ENHANCEMENT] Update addon-resizer to 1.8.3 and increase resource limits (#552).
- [ENHANCEMENT] Improve metric caching and rendering performance (#498).
- [ENHANCEMENT] Adding CreateContainerConfigError as possible reason for container not starting (#578).
After a testing period of 16 days, there were no additional bugs found or features introduced.
- [CHANGE]
kube_job_status_start_timeandkube_job_status_completion_timemetric types changed from counter to gauge. - [CHANGE]
joblabel tojob_nameas this collides with the Prometheusjoblabel. - [FEATURE] Allow white- and black-listing metrics to be exposed.
- [FEATURE] Add
kube_node_status_capacityandkube_node_status_allocatablemetrics. - [FEATURE] Add
kube_pod_status_scheduled_timemetric. - [FEATURE] Add
kube_pod_container_status_waiting_reasonandkube_pod_container_status_terminated_reasonmetrics. - [ENHANCEMENT] Add generic resource metrics for Pods,
kube_pod_container_resource_requestsandkube_pod_container_resource_limits. This deprecates the old resource metrics for Pods. - [ENHANCEMENT] Prefer protobuf over json when communicating with the Kubernetes API.
- [ENHANCEMENT] Add dynamic volume support.
- [ENHANCEMENT] Properly set kube-state-metrics user agent when performing requests against the Kubernetes API.
- [BUGFIX] Fix incrorrect HPA metric labels.
- [BUGFIX] Use Go 1.10.1 fixing TLS and memory issues.
- [BUGFIX] Fix Pod unknown state.
After a testing period of 12 days, there were no additional bugs found or features introduced.
- [CHANGE] Removed
--in-clusterflag in #371. Users can no longer specify--apiserverwith--in-cluster=true. To emulate this behaviour in future releases, set theKUBERNETES_SERVICE_HOSTenvironment variable to the value of the--apiserverargument. - [FEATURE] Allow to specify multiple namespace.
- [FEATURE] Add
kube_pod_completion_time,kube_pod_spec_volumes_persistentvolumeclaims_info, andkube_pod_spec_volumes_persistentvolumeclaims_readonlymetrics to the Pod collector. - [FEATURE] Add
kube_node_spec_taintmetric. - [FEATURE] Add
kube_namespace_annotationsmetric. - [FEATURE] Add
kube_deployment_spec_strategy_rollingupdate_max_surgemetric. - [FEATURE] Add
kube_persistentvolume_labelsmetric. - [FEATURE] Add
kube_persistentvolumeclaim_lablesmetric. - [FEATURE] Add
kube_daemonset_labelsmetric. - [FEATURE] Add Secret metrics.
- [FEATURE] Add ConfigMap metrics.
- [ENHANCEMENT] Add additional reasons to
kube_pod_container_status_waiting_reasonmetric. - [BUGFIX] Fix namespacing of HPA.
- [BUGFIX] Fix namespacing of PersistentVolumes.
- [BUGFIX] Fix CronJob tab parsing.
After a testing period of 10 days, there were no additional bugs found or features introduced.
- [CHANGE] The CronJob collector now expects the version to be v1beta1.
- [FEATURE] Add
Endpointsmetrics collector. - [FEATURE] Add
PersistentVolumemetrics collector. - [FEATURE] Add
HorizontalPodAutoscalermetrics collector. - [FEATURE] Add
kube_pod_container_status_terminated_reasonmetric. - [FEATURE] Add
kube_job_labelsmetric. - [FEATURE] Add
kube_cronjob_labelsmetric. - [FEATURE] Add
kube_service_spec_typemetric. - [FEATURE] Add
kube_statefulset_status_replicas_currentmetric. - [FEATURE] Add
kube_statefulset_status_replicas_readymetric. - [FEATURE] Add
kube_statefulset_status_replicas_updatedmetric. - [ENHANCEMENT] Allow specifying the host/IP kube-state-metrics binds to.
- [ENHANCEMENT] Add
volumenamelabel tokube_persistentvolumeclaim_infometric. - [ENHANCEMENT] Add
cluster_iplabel tokube_service_infometric. - [ENHANCEMENT] Print version on startup and useful debug information at runtime.
- [ENHANCEMENT] Add metrics for kube-state-metrics itself. For separation purposes this listens on a separate host/IP and port, both configurable respectively.
After a testing period of one week, there were no additional bugs found or features introduced.
- [FEATURE] Add
kube_pod_container_status_waiting_reasonmetric. - [FEATURE] Add
kube_node_status_capacity_nvidia_gpu_cardsandkube_node_status_allocatable_nvidia_gpu_cardsmetrics. - [FEATURE] Add
kube_persistentvolumeclaim_info,kube_persistentvolumeclaim_status_phaseandkube_persistentvolumeclaim_resource_requests_storage_bytesmetrics. - [FEATURE] Add
kube_cronjob_createdmetric. - [FEATURE] Add
kube_namespace_status_phase,kube_namespace_labelsandkube_namespace_createdmetrics. - [FEATURE] Add
*_createdmetrics for all available collectors and resources. - [FEATURE] Add ability to specify glog flags.
- [FEATURE] Add ability to limit kube-state-metrics objects to single namespace.
- [ENHANCEMENT] Bump client-go to 5.0 release branch.
- [ENHANCEMENT] Add pprof endpoints for profiling.
- [ENHANCEMENT] Log resources and API versions used when collecting metrics from objects.
- [ENHANCEMENT] Log number of resources used to generate metrics off of.
- [ENHANCEMENT] Improve a usage message for collectors flag.
- [BUGFIX] Fix Job start time nil panic.
- [BUGFIX] Fix nil pointer panic when pods have an owner without controllers.
After a testing period of one week, there were no additional bugs found or features introduced.
- [CHANGE] Remove
kube_node_status_ready,kube_node_status_out_of_disk,kube_node_status_memory_pressure,kube_node_status_disk_pressure, andkube_node_status_network_unavailablemetrics in favor of one generickube_node_status_conditionmetric. - [CHANGE] Flatten created by label on
kube_pod_infometric. - [FEATURE] Add
kube_pod_start_timemetric. - [FEATURE] Add PersistentVolumeClaim metrics.
- [FEATURE] Add StatefulSet metrics.
- [FEATURE] Add Job and CronJob metrics.
- [FEATURE] Add label metrics for deployments.
- [FEATURE] Add
kube_pod_ownermetrics. - [ENHANCEMENT] Add
provider_idlabel tokube_node_infometric. - [BUGFIX] Fix various nil pointer panics.
- [FEATURE] Add label metrics for Pods, Nodes and Services.
- [FEATURE] Expose number of ready Pods for DaemonSets.
- [FEATURE] Add LimitRange metrics.
- [FEATURE] Add ReplicationController metrics.
- [ENHANCEMENT] Add NodeMemoryPressure, NodeDiskPressure, NodeNetworkUnavailable condition metrics.
- [ENHANCEMENT] Add
created_bylabel tokube_pod_infometric.
- [BUGFIX] fix panic if max unavailable if rolling update is unset
- [FEATURE] Add replicaset metrics
- [FEATURE] Add resourcequota metrics
- [FEATURE] Add daemonset metrics
- [FEATURE] Add resource limit and request metrics for pod containers
- [FEATURE] Add node name label to
kube_pod_infometric - [FEATURE] Add rolling update metrics for deployments
- [ENHANCEMENT] Allow disabling collectors
- [ENHANCEMENT] Improve in cluster vs non in cluster configuration
- [FEATURE] Add pod metrics:
kube_pod_status_scheduled,kube_pod_container_requested_cpu_coresandkube_pod_container_requested_memory_bytes - [FEATURE] Add deployment metric
kube_deployment_metadata_generation - [FEATURE] Add node metric
kube_node_spec_unschedulable - [CHANGE] Rename
kube_node_status_allocateable_*tokube_node_status_allocatable_*
- [CHANGE] Prefix all metrics with
kube_ - [CHANGE] Make metric collection synchronous
- [FEATURE] Add a number of node/pod/deployment metrics