Istio Internals by port

Introduction

Istio가 노출하는 port 중심의 Istio의 내부 구조에 관한 기술로서, 사실 상 Istio in Action의 Appendix D에 대한 요약과 약간의 첨언이다.

Motivation

Istio 운영 시 troubleshooting까지 하려면 최소한 traffic 종류 별로 Istio 및 관련 시스템과의 연결 구조는 알아야 하겠다.

Internal Architecture by Port

초록색은 Kubernetes를, 푸른색은 Istio를, 노란색은 Prometheus를, 주황색은 app을 의미한다.

위 diagram에 대한 상세 내용은 아래에 이어진다. Istio component를 중심으로 설명한다.

`istiod`

Istio의 control plane으로 Pilot은 이에 대한 옛 이름이다(원래 용도에 따라 control plane은 pilot , citadel, galley 등으로 나뉘었는데 istiod 로 합쳐졌다고). kubectl -n istio-system exec -it deploy/istiod -- netstat -tnl 명령으로 아래와 같은 port 확인이 가능하다.

Active Internet connections (only servers)
Proto Recv-Q Send-Q Local Address           Foreign Address         State      
tcp        0      0 127.0.0.1:9876          0.0.0.0:*               LISTEN     
tcp6       0      0 :::15017                :::*                    LISTEN     
tcp6       0      0 :::15010                :::*                    LISTEN     
tcp6       0      0 :::15014                :::*                    LISTEN     
tcp6       0      0 :::15012                :::*                    LISTEN     
tcp6       0      0 :::8080                 :::*                    LISTEN

BASH

아래 이어지는 port 별 설명 중 각 항목 제목은 포트와 해당 port를 사용하는 client를 나타낸다.

`8080`: Kubelet, Debug

Kubelet은 /ready path로 istiod 의 readiness probing을 이룬다.
debug용 endpoint로 Kiali나 istioctl 가 사실 상 이 endpoint를 사용하는 듯. istioctl proxy-status 는 ~:8080/debug/syncz 을 사용하여 지정한 proxy가 sync 중인지를 확인한다고. 일부는 Istio proxy의 15004 debug port로 redirect하여 Istio proxy에 대한 조회용으로 쓰이기도.
매우 다양한 API를 노출하는데 여기에서 다 논하기는 어렵다. kubectl exec -it -n {istiod namespace} {istiod podname} -- curl -i localhost:8080/debug 을 호출하면 HTML이 나오는데, 여기에 전체 목록이 있다.

`9876`: Admin

istiod process의 instrospection를 노출. istioctl dashboard controlz deployment/istiod.istio-system 에 사용된다고. Istio Introspection에 대해서는 다음 참고.

Istiod IntrospectionDescribes how to use ControlZ to get insight into a running istiod component.
https://istio.io/latest/docs/ops/diagnostic-tools/controlz/

`15010`: Istio proxy (plain text)

gRPC 기반으로 Istio proxy와 각종 xDS configuration을 동기화한다(SDS의 certificate 포함. xDS는 Istiod 가 open하는 API로, Istio proxy가 이들 API를 사용하여 자신의 configuration을 동적으로 수정한다. xDS에 대해서는 별도의 글로 다룬다.
plain text 기반이므로 보안에 취약하다.

`15012`: Istio proxy (TLS, mTLS)

15010 과 동일 용도이나 TLS, mTLS 를 사용한다. 15010 을 대신하여 default로 사용된다.

`15014`: Prometheus

Prometheus의 scraping API를 노출하여 control plane의 metrics를 전한다.

다음은 metric 예로 kubectl exec -it -n istio-system deploy/istiod -- curl localhost:15014/metrics 의 호출 결과다(펼쳐야 보인다).

# HELP citadel_server_csr_count The number of CSRs received by Citadel server.
# TYPE citadel_server_csr_count counter
citadel_server_csr_count 385
# HELP citadel_server_root_cert_expiry_timestamp The unix timestamp, in seconds, when Citadel root cert will expire. A negative time indicates the cert is expired.
# TYPE citadel_server_root_cert_expiry_timestamp gauge
citadel_server_root_cert_expiry_timestamp 2.026012781e+09
# HELP citadel_server_success_cert_issuance_count The number of certificates issuances that have succeeded.
# TYPE citadel_server_success_cert_issuance_count counter
citadel_server_success_cert_issuance_count 385
# HELP controller_sync_errors_total Total number of errorMetric syncing controllers.
# TYPE controller_sync_errors_total counter
controller_sync_errors_total{cluster="Kubernetes"} 60
# HELP endpoint_no_pod Endpoints without an associated pod.
# TYPE endpoint_no_pod gauge
endpoint_no_pod 0
# HELP galley_validation_config_updates k8s webhook configuration updates
# TYPE galley_validation_config_updates counter
galley_validation_config_updates 2
# HELP galley_validation_passed Resource is valid
# TYPE galley_validation_passed counter
galley_validation_passed{group="networking.istio.io",resource="serviceentries",version="v1beta1"} 2
# HELP go_gc_duration_seconds A summary of the pause duration of garbage collection cycles.
# TYPE go_gc_duration_seconds summary
go_gc_duration_seconds{quantile="0"} 6.3828e-05
go_gc_duration_seconds{quantile="0.25"} 0.000103
go_gc_duration_seconds{quantile="0.5"} 0.000132919
go_gc_duration_seconds{quantile="0.75"} 0.00018363
go_gc_duration_seconds{quantile="1"} 0.004474532
go_gc_duration_seconds_sum 17.210624907
go_gc_duration_seconds_count 7448
# HELP go_goroutines Number of goroutines that currently exist.
# TYPE go_goroutines gauge
go_goroutines 656
# HELP go_info Information about the Go environment.
# TYPE go_info gauge
go_info{version="go1.22.2"} 1
# HELP go_memstats_alloc_bytes Number of bytes allocated and still in use.
# TYPE go_memstats_alloc_bytes gauge
go_memstats_alloc_bytes 3.2271864e+07
# HELP go_memstats_alloc_bytes_total Total number of bytes allocated, even if freed.
# TYPE go_memstats_alloc_bytes_total counter
go_memstats_alloc_bytes_total 6.4070987328e+10
# HELP go_memstats_buck_hash_sys_bytes Number of bytes used by the profiling bucket hash table.
# TYPE go_memstats_buck_hash_sys_bytes gauge
go_memstats_buck_hash_sys_bytes 4.213174e+06
# HELP go_memstats_frees_total Total number of frees.
# TYPE go_memstats_frees_total counter
go_memstats_frees_total 5.4178272e+08
# HELP go_memstats_gc_sys_bytes Number of bytes used for garbage collection system metadata.
# TYPE go_memstats_gc_sys_bytes gauge
go_memstats_gc_sys_bytes 4.793192e+06
# HELP go_memstats_heap_alloc_bytes Number of heap bytes allocated and still in use.
# TYPE go_memstats_heap_alloc_bytes gauge
go_memstats_heap_alloc_bytes 3.2271864e+07
# HELP go_memstats_heap_idle_bytes Number of heap bytes waiting to be used.
# TYPE go_memstats_heap_idle_bytes gauge
go_memstats_heap_idle_bytes 4.4146688e+07
# HELP go_memstats_heap_inuse_bytes Number of heap bytes that are in use.
# TYPE go_memstats_heap_inuse_bytes gauge
go_memstats_heap_inuse_bytes 4.345856e+07
# HELP go_memstats_heap_objects Number of allocated objects.
# TYPE go_memstats_heap_objects gauge
go_memstats_heap_objects 182924
# HELP go_memstats_heap_released_bytes Number of heap bytes released to OS.
# TYPE go_memstats_heap_released_bytes gauge
go_memstats_heap_released_bytes 4.0599552e+07
# HELP go_memstats_heap_sys_bytes Number of heap bytes obtained from system.
# TYPE go_memstats_heap_sys_bytes gauge
go_memstats_heap_sys_bytes 8.7605248e+07
# HELP go_memstats_last_gc_time_seconds Number of seconds since 1970 of last garbage collection.
# TYPE go_memstats_last_gc_time_seconds gauge
go_memstats_last_gc_time_seconds 1.7145463259043484e+09
# HELP go_memstats_lookups_total Total number of pointer lookups.
# TYPE go_memstats_lookups_total counter
go_memstats_lookups_total 0
# HELP go_memstats_mallocs_total Total number of mallocs.
# TYPE go_memstats_mallocs_total counter
go_memstats_mallocs_total 5.41965644e+08
# HELP go_memstats_mcache_inuse_bytes Number of bytes in use by mcache structures.
# TYPE go_memstats_mcache_inuse_bytes gauge
go_memstats_mcache_inuse_bytes 4800
# HELP go_memstats_mcache_sys_bytes Number of bytes used for mcache structures obtained from system.
# TYPE go_memstats_mcache_sys_bytes gauge
go_memstats_mcache_sys_bytes 15600
# HELP go_memstats_mspan_inuse_bytes Number of bytes in use by mspan structures.
# TYPE go_memstats_mspan_inuse_bytes gauge
go_memstats_mspan_inuse_bytes 631840
# HELP go_memstats_mspan_sys_bytes Number of bytes used for mspan structures obtained from system.
# TYPE go_memstats_mspan_sys_bytes gauge
go_memstats_mspan_sys_bytes 1.15872e+06
# HELP go_memstats_next_gc_bytes Number of heap bytes when next garbage collection will take place.
# TYPE go_memstats_next_gc_bytes gauge
go_memstats_next_gc_bytes 5.782032e+07
# HELP go_memstats_other_sys_bytes Number of bytes used for other system allocations.
# TYPE go_memstats_other_sys_bytes gauge
go_memstats_other_sys_bytes 1.099978e+06
# HELP go_memstats_stack_inuse_bytes Number of bytes in use by the stack allocator.
# TYPE go_memstats_stack_inuse_bytes gauge
go_memstats_stack_inuse_bytes 4.620288e+06
# HELP go_memstats_stack_sys_bytes Number of bytes obtained from system for stack allocator.
# TYPE go_memstats_stack_sys_bytes gauge
go_memstats_stack_sys_bytes 4.620288e+06
# HELP go_memstats_sys_bytes Number of bytes obtained from system.
# TYPE go_memstats_sys_bytes gauge
go_memstats_sys_bytes 1.035062e+08
# HELP go_threads Number of OS threads created.
# TYPE go_threads gauge
go_threads 15
# HELP grpc_server_handled_total Total number of RPCs completed on the server, regardless of success or failure.
# TYPE grpc_server_handled_total counter
grpc_server_handled_total{grpc_code="OK",grpc_method="CreateCertificate",grpc_service="istio.v1.auth.IstioCertificateService",grpc_type="unary"} 385
# HELP grpc_server_handling_seconds Histogram of response latency (seconds) of gRPC that had been application-level handled by the server.
# TYPE grpc_server_handling_seconds histogram
grpc_server_handling_seconds_bucket{grpc_method="CreateCertificate",grpc_service="istio.v1.auth.IstioCertificateService",grpc_type="unary",le="0.005"} 0
grpc_server_handling_seconds_bucket{grpc_method="CreateCertificate",grpc_service="istio.v1.auth.IstioCertificateService",grpc_type="unary",le="0.01"} 328
grpc_server_handling_seconds_bucket{grpc_method="CreateCertificate",grpc_service="istio.v1.auth.IstioCertificateService",grpc_type="unary",le="0.025"} 373
grpc_server_handling_seconds_bucket{grpc_method="CreateCertificate",grpc_service="istio.v1.auth.IstioCertificateService",grpc_type="unary",le="0.05"} 378
grpc_server_handling_seconds_bucket{grpc_method="CreateCertificate",grpc_service="istio.v1.auth.IstioCertificateService",grpc_type="unary",le="0.1"} 382
grpc_server_handling_seconds_bucket{grpc_method="CreateCertificate",grpc_service="istio.v1.auth.IstioCertificateService",grpc_type="unary",le="0.25"} 382
grpc_server_handling_seconds_bucket{grpc_method="CreateCertificate",grpc_service="istio.v1.auth.IstioCertificateService",grpc_type="unary",le="0.5"} 384
grpc_server_handling_seconds_bucket{grpc_method="CreateCertificate",grpc_service="istio.v1.auth.IstioCertificateService",grpc_type="unary",le="1"} 384
grpc_server_handling_seconds_bucket{grpc_method="CreateCertificate",grpc_service="istio.v1.auth.IstioCertificateService",grpc_type="unary",le="2.5"} 385
grpc_server_handling_seconds_bucket{grpc_method="CreateCertificate",grpc_service="istio.v1.auth.IstioCertificateService",grpc_type="unary",le="5"} 385
grpc_server_handling_seconds_bucket{grpc_method="CreateCertificate",grpc_service="istio.v1.auth.IstioCertificateService",grpc_type="unary",le="10"} 385
grpc_server_handling_seconds_bucket{grpc_method="CreateCertificate",grpc_service="istio.v1.auth.IstioCertificateService",grpc_type="unary",le="+Inf"} 385
grpc_server_handling_seconds_sum{grpc_method="CreateCertificate",grpc_service="istio.v1.auth.IstioCertificateService",grpc_type="unary"} 5.820930060000009
grpc_server_handling_seconds_count{grpc_method="CreateCertificate",grpc_service="istio.v1.auth.IstioCertificateService",grpc_type="unary"} 385
# HELP grpc_server_msg_received_total Total number of RPC stream messages received on the server.
# TYPE grpc_server_msg_received_total counter
grpc_server_msg_received_total{grpc_method="CreateCertificate",grpc_service="istio.v1.auth.IstioCertificateService",grpc_type="unary"} 385
# HELP grpc_server_msg_sent_total Total number of gRPC stream messages sent by the server.
# TYPE grpc_server_msg_sent_total counter
grpc_server_msg_sent_total{grpc_method="CreateCertificate",grpc_service="istio.v1.auth.IstioCertificateService",grpc_type="unary"} 385
# HELP grpc_server_started_total Total number of RPCs started on the server.
# TYPE grpc_server_started_total counter
grpc_server_started_total{grpc_method="CreateCertificate",grpc_service="istio.v1.auth.IstioCertificateService",grpc_type="unary"} 385
# HELP istio_build Istio component build info
# TYPE istio_build gauge
istio_build{component="pilot",tag="1.21.1"} 1
# HELP istiod_managed_clusters Number of clusters managed by istiod
# TYPE istiod_managed_clusters gauge
istiod_managed_clusters{cluster_type="local"} 1
istiod_managed_clusters{cluster_type="remote"} 0
# HELP istiod_uptime_seconds Current istiod server uptime in seconds
# TYPE istiod_uptime_seconds gauge
istiod_uptime_seconds 855358.261435591
# HELP pilot_conflict_inbound_listener Number of conflicting inbound listeners.
# TYPE pilot_conflict_inbound_listener gauge
pilot_conflict_inbound_listener 0
# HELP pilot_conflict_outbound_listener_tcp_over_current_tcp Number of conflicting tcp listeners with current tcp listener.
# TYPE pilot_conflict_outbound_listener_tcp_over_current_tcp gauge
pilot_conflict_outbound_listener_tcp_over_current_tcp 0
# HELP pilot_debounce_time Delay in seconds between the first config enters debouncing and the merged push request is pushed into the push queue.
# TYPE pilot_debounce_time histogram
pilot_debounce_time_bucket{le="0.01"} 0
pilot_debounce_time_bucket{le="0.1"} 0
pilot_debounce_time_bucket{le="1"} 1020
pilot_debounce_time_bucket{le="3"} 1023
pilot_debounce_time_bucket{le="5"} 1023
pilot_debounce_time_bucket{le="10"} 1026
pilot_debounce_time_bucket{le="20"} 1028
pilot_debounce_time_bucket{le="30"} 1028
pilot_debounce_time_bucket{le="+Inf"} 1028
pilot_debounce_time_sum 182.75178215800005
pilot_debounce_time_count 1028
# HELP pilot_destrule_subsets Duplicate subsets across destination rules for same host
# TYPE pilot_destrule_subsets gauge
pilot_destrule_subsets 0
# HELP pilot_dns_cluster_without_endpoints DNS clusters without endpoints caused by the endpoint field in STRICT_DNS type cluster is not set or the corresponding subset cannot select any endpoint
# TYPE pilot_dns_cluster_without_endpoints gauge
pilot_dns_cluster_without_endpoints 0
# HELP pilot_duplicate_envoy_clusters Duplicate envoy clusters caused by service entries with same hostname
# TYPE pilot_duplicate_envoy_clusters gauge
pilot_duplicate_envoy_clusters 0
# HELP pilot_eds_no_instances Number of clusters without instances.
# TYPE pilot_eds_no_instances gauge
pilot_eds_no_instances 0
# HELP pilot_endpoint_not_ready Endpoint found in unready state.
# TYPE pilot_endpoint_not_ready gauge
pilot_endpoint_not_ready 0
# HELP pilot_inbound_updates Total number of updates received by pilot.
# TYPE pilot_inbound_updates counter
pilot_inbound_updates{type="config"} 3602
pilot_inbound_updates{type="eds"} 3809
pilot_inbound_updates{type="svc"} 76
pilot_inbound_updates{type="svcdelete"} 13
# HELP pilot_info Pilot version and build information.
# TYPE pilot_info gauge
pilot_info{version="1.21.1-ee6e9f6a314224fd9bcb808ca1d74d1dc66adba8-Clean"} 1
# HELP pilot_k8s_cfg_events Events from k8s config.
# TYPE pilot_k8s_cfg_events counter
pilot_k8s_cfg_events{event="add",type="Gateway"} 1
pilot_k8s_cfg_events{event="add",type="GatewayClass"} 1
pilot_k8s_cfg_events{event="add",type="HTTPRoute"} 10
pilot_k8s_cfg_events{event="add",type="ServiceEntry"} 1
pilot_k8s_cfg_events{event="delete",type="HTTPRoute"} 3
pilot_k8s_cfg_events{event="update",type="Gateway"} 10
pilot_k8s_cfg_events{event="update",type="GatewayClass"} 4
pilot_k8s_cfg_events{event="update",type="HTTPRoute"} 36
pilot_k8s_cfg_events{event="update",type="ServiceEntry"} 1
# HELP pilot_k8s_endpoints_pending_pod Number of endpoints that do not currently have any corresponding pods.
# TYPE pilot_k8s_endpoints_pending_pod gauge
pilot_k8s_endpoints_pending_pod 0
# HELP pilot_k8s_reg_events Events from k8s registry.
# TYPE pilot_k8s_reg_events counter
pilot_k8s_reg_events{event="add",type="EndpointSlice"} 42
pilot_k8s_reg_events{event="add",type="Namespaces"} 13
pilot_k8s_reg_events{event="add",type="Nodes"} 3
pilot_k8s_reg_events{event="add",type="Pods"} 14297
pilot_k8s_reg_events{event="add",type="Services"} 42
pilot_k8s_reg_events{event="delete",type="EndpointSlice"} 13
pilot_k8s_reg_events{event="delete",type="Pods"} 14252
pilot_k8s_reg_events{event="delete",type="Services"} 13
pilot_k8s_reg_events{event="update",type="EndpointSlice"} 3239
pilot_k8s_reg_events{event="update",type="Namespaces"} 52
pilot_k8s_reg_events{event="update",type="Nodes"} 8386
pilot_k8s_reg_events{event="update",type="Pods"} 115740
pilot_k8s_reg_events{event="update",type="Services"} 449
# HELP pilot_no_ip Pods not found in the endpoint table, possibly invalid.
# TYPE pilot_no_ip gauge
pilot_no_ip 0
# HELP pilot_proxy_convergence_time Delay in seconds between config change and a proxy receiving all required configuration.
# TYPE pilot_proxy_convergence_time histogram
pilot_proxy_convergence_time_bucket{le="0.1"} 7294
pilot_proxy_convergence_time_bucket{le="0.5"} 19518
pilot_proxy_convergence_time_bucket{le="1"} 19645
pilot_proxy_convergence_time_bucket{le="3"} 19708
pilot_proxy_convergence_time_bucket{le="5"} 19711
pilot_proxy_convergence_time_bucket{le="10"} 19711
pilot_proxy_convergence_time_bucket{le="20"} 19739
pilot_proxy_convergence_time_bucket{le="30"} 19739
pilot_proxy_convergence_time_bucket{le="+Inf"} 19739
pilot_proxy_convergence_time_sum 3543.8752276149867
pilot_proxy_convergence_time_count 19739
# HELP pilot_proxy_queue_time Time in seconds, a proxy is in the push queue before being dequeued.
# TYPE pilot_proxy_queue_time histogram
pilot_proxy_queue_time_bucket{le="0.1"} 19731
pilot_proxy_queue_time_bucket{le="0.5"} 19757
pilot_proxy_queue_time_bucket{le="1"} 19757
pilot_proxy_queue_time_bucket{le="3"} 19757
pilot_proxy_queue_time_bucket{le="5"} 19757
pilot_proxy_queue_time_bucket{le="10"} 19757
pilot_proxy_queue_time_bucket{le="20"} 19771
pilot_proxy_queue_time_bucket{le="30"} 19771
pilot_proxy_queue_time_bucket{le="+Inf"} 19771
pilot_proxy_queue_time_sum 232.4897493059999
pilot_proxy_queue_time_count 19771
# HELP pilot_push_triggers Total number of times a push was triggered, labeled by reason for the push.
# TYPE pilot_push_triggers counter
pilot_push_triggers{type="config"} 990
pilot_push_triggers{type="endpoint"} 31661
pilot_push_triggers{type="global"} 317
pilot_push_triggers{type="headlessendpoint"} 15675
pilot_push_triggers{type="proxy"} 428
pilot_push_triggers{type="secret"} 2020
pilot_push_triggers{type="service"} 449
# HELP pilot_pushcontext_init_seconds Total time in seconds Pilot takes to init pushContext.
# TYPE pilot_pushcontext_init_seconds histogram
pilot_pushcontext_init_seconds_bucket{le="0.01"} 869
pilot_pushcontext_init_seconds_bucket{le="0.1"} 884
pilot_pushcontext_init_seconds_bucket{le="0.5"} 892
pilot_pushcontext_init_seconds_bucket{le="1"} 894
pilot_pushcontext_init_seconds_bucket{le="3"} 897
pilot_pushcontext_init_seconds_bucket{le="5"} 899
pilot_pushcontext_init_seconds_bucket{le="+Inf"} 901
pilot_pushcontext_init_seconds_sum 44.105849424000006
pilot_pushcontext_init_seconds_count 901
# HELP pilot_services Total services known to pilot.
# TYPE pilot_services gauge
pilot_services 30
# HELP pilot_virt_services Total virtual services known to pilot.
# TYPE pilot_virt_services gauge
pilot_virt_services 12
# HELP pilot_vservice_dup_domain Virtual services with dup domains.
# TYPE pilot_vservice_dup_domain gauge
pilot_vservice_dup_domain 0
# HELP pilot_xds Number of endpoints connected to this pilot using XDS.
# TYPE pilot_xds gauge
pilot_xds{version="1.21.0"} 13
pilot_xds{version="1.21.1"} 6
# HELP pilot_xds_config_size_bytes Distribution of configuration sizes pushed to clients
# TYPE pilot_xds_config_size_bytes histogram
pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/envoy.config.cluster.v3.Cluster",le="1"} 0
pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/envoy.config.cluster.v3.Cluster",le="10000"} 0
pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/envoy.config.cluster.v3.Cluster",le="1e+06"} 25767
pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/envoy.config.cluster.v3.Cluster",le="4e+06"} 25767
pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/envoy.config.cluster.v3.Cluster",le="1e+07"} 25767
pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/envoy.config.cluster.v3.Cluster",le="4e+07"} 25767
pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/envoy.config.cluster.v3.Cluster",le="+Inf"} 25767
pilot_xds_config_size_bytes_sum{type="type.googleapis.com/envoy.config.cluster.v3.Cluster"} 1.214175871e+09
pilot_xds_config_size_bytes_count{type="type.googleapis.com/envoy.config.cluster.v3.Cluster"} 25767
pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/envoy.config.endpoint.v3.ClusterLoadAssignment",le="1"} 0
pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/envoy.config.endpoint.v3.ClusterLoadAssignment",le="10000"} 26751
pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/envoy.config.endpoint.v3.ClusterLoadAssignment",le="1e+06"} 26754
pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/envoy.config.endpoint.v3.ClusterLoadAssignment",le="4e+06"} 26754
pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/envoy.config.endpoint.v3.ClusterLoadAssignment",le="1e+07"} 26754
pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/envoy.config.endpoint.v3.ClusterLoadAssignment",le="4e+07"} 26754
pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/envoy.config.endpoint.v3.ClusterLoadAssignment",le="+Inf"} 26754
pilot_xds_config_size_bytes_sum{type="type.googleapis.com/envoy.config.endpoint.v3.ClusterLoadAssignment"} 8.1822059e+07
pilot_xds_config_size_bytes_count{type="type.googleapis.com/envoy.config.endpoint.v3.ClusterLoadAssignment"} 26754
pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/envoy.config.listener.v3.Listener",le="1"} 0
pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/envoy.config.listener.v3.Listener",le="10000"} 1357
pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/envoy.config.listener.v3.Listener",le="1e+06"} 25754
pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/envoy.config.listener.v3.Listener",le="4e+06"} 25754
pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/envoy.config.listener.v3.Listener",le="1e+07"} 25754
pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/envoy.config.listener.v3.Listener",le="4e+07"} 25754
pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/envoy.config.listener.v3.Listener",le="+Inf"} 25754
pilot_xds_config_size_bytes_sum{type="type.googleapis.com/envoy.config.listener.v3.Listener"} 2.280371455e+09
pilot_xds_config_size_bytes_count{type="type.googleapis.com/envoy.config.listener.v3.Listener"} 25754
pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/envoy.config.route.v3.RouteConfiguration",le="1"} 0
pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/envoy.config.route.v3.RouteConfiguration",le="10000"} 50
pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/envoy.config.route.v3.RouteConfiguration",le="1e+06"} 25803
pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/envoy.config.route.v3.RouteConfiguration",le="4e+06"} 25803
pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/envoy.config.route.v3.RouteConfiguration",le="1e+07"} 25803
pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/envoy.config.route.v3.RouteConfiguration",le="4e+07"} 25803
pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/envoy.config.route.v3.RouteConfiguration",le="+Inf"} 25803
pilot_xds_config_size_bytes_sum{type="type.googleapis.com/envoy.config.route.v3.RouteConfiguration"} 5.9816396e+08
pilot_xds_config_size_bytes_count{type="type.googleapis.com/envoy.config.route.v3.RouteConfiguration"} 25803
pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/envoy.extensions.transport_sockets.tls.v3.Secret",le="1"} 3
pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/envoy.extensions.transport_sockets.tls.v3.Secret",le="10000"} 506
pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/envoy.extensions.transport_sockets.tls.v3.Secret",le="1e+06"} 506
pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/envoy.extensions.transport_sockets.tls.v3.Secret",le="4e+06"} 506
pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/envoy.extensions.transport_sockets.tls.v3.Secret",le="1e+07"} 506
pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/envoy.extensions.transport_sockets.tls.v3.Secret",le="4e+07"} 506
pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/envoy.extensions.transport_sockets.tls.v3.Secret",le="+Inf"} 506
pilot_xds_config_size_bytes_sum{type="type.googleapis.com/envoy.extensions.transport_sockets.tls.v3.Secret"} 1.825387e+06
pilot_xds_config_size_bytes_count{type="type.googleapis.com/envoy.extensions.transport_sockets.tls.v3.Secret"} 506
pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/istio.networking.nds.v1.NameTable",le="1"} 0
pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/istio.networking.nds.v1.NameTable",le="10000"} 869
pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/istio.networking.nds.v1.NameTable",le="1e+06"} 869
pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/istio.networking.nds.v1.NameTable",le="4e+06"} 869
pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/istio.networking.nds.v1.NameTable",le="1e+07"} 869
pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/istio.networking.nds.v1.NameTable",le="4e+07"} 869
pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/istio.networking.nds.v1.NameTable",le="+Inf"} 869
pilot_xds_config_size_bytes_sum{type="type.googleapis.com/istio.networking.nds.v1.NameTable"} 2.868342e+06
pilot_xds_config_size_bytes_count{type="type.googleapis.com/istio.networking.nds.v1.NameTable"} 869
# HELP pilot_xds_expired_nonce Total number of XDS requests with an expired nonce.
# TYPE pilot_xds_expired_nonce counter
pilot_xds_expired_nonce{type="cds"} 66
pilot_xds_expired_nonce{type="eds"} 430
pilot_xds_expired_nonce{type="lds"} 179
pilot_xds_expired_nonce{type="rds"} 249
pilot_xds_expired_nonce{type="sds"} 2
# HELP pilot_xds_push_time Total time in seconds Pilot takes to push lds, rds, cds and eds.
# TYPE pilot_xds_push_time histogram
pilot_xds_push_time_bucket{type="cds",le="0.01"} 15206
pilot_xds_push_time_bucket{type="cds",le="0.1"} 21567
pilot_xds_push_time_bucket{type="cds",le="1"} 25736
pilot_xds_push_time_bucket{type="cds",le="3"} 25762
pilot_xds_push_time_bucket{type="cds",le="5"} 25767
pilot_xds_push_time_bucket{type="cds",le="10"} 25767
pilot_xds_push_time_bucket{type="cds",le="20"} 25767
pilot_xds_push_time_bucket{type="cds",le="30"} 25767
pilot_xds_push_time_bucket{type="cds",le="+Inf"} 25767
pilot_xds_push_time_sum{type="cds"} 1070.9526691310032
pilot_xds_push_time_count{type="cds"} 25767
pilot_xds_push_time_bucket{type="eds",le="0.01"} 21580
pilot_xds_push_time_bucket{type="eds",le="0.1"} 25817
pilot_xds_push_time_bucket{type="eds",le="1"} 26745
pilot_xds_push_time_bucket{type="eds",le="3"} 26754
pilot_xds_push_time_bucket{type="eds",le="5"} 26754
pilot_xds_push_time_bucket{type="eds",le="10"} 26754
pilot_xds_push_time_bucket{type="eds",le="20"} 26754
pilot_xds_push_time_bucket{type="eds",le="30"} 26754
pilot_xds_push_time_bucket{type="eds",le="+Inf"} 26754
pilot_xds_push_time_sum{type="eds"} 354.8241625710016
pilot_xds_push_time_count{type="eds"} 26754
pilot_xds_push_time_bucket{type="lds",le="0.01"} 14869
pilot_xds_push_time_bucket{type="lds",le="0.1"} 22975
pilot_xds_push_time_bucket{type="lds",le="1"} 25723
pilot_xds_push_time_bucket{type="lds",le="3"} 25742
pilot_xds_push_time_bucket{type="lds",le="5"} 25744
pilot_xds_push_time_bucket{type="lds",le="10"} 25750
pilot_xds_push_time_bucket{type="lds",le="20"} 25754
pilot_xds_push_time_bucket{type="lds",le="30"} 25754
pilot_xds_push_time_bucket{type="lds",le="+Inf"} 25754
pilot_xds_push_time_sum{type="lds"} 977.8968505030012
pilot_xds_push_time_count{type="lds"} 25754
pilot_xds_push_time_bucket{type="nds",le="0.01"} 853
pilot_xds_push_time_bucket{type="nds",le="0.1"} 867
pilot_xds_push_time_bucket{type="nds",le="1"} 869
pilot_xds_push_time_bucket{type="nds",le="3"} 869
pilot_xds_push_time_bucket{type="nds",le="5"} 869
pilot_xds_push_time_bucket{type="nds",le="10"} 869
pilot_xds_push_time_bucket{type="nds",le="20"} 869
pilot_xds_push_time_bucket{type="nds",le="30"} 869
pilot_xds_push_time_bucket{type="nds",le="+Inf"} 869
pilot_xds_push_time_sum{type="nds"} 2.135441606
pilot_xds_push_time_count{type="nds"} 869
pilot_xds_push_time_bucket{type="rds",le="0.01"} 18452
pilot_xds_push_time_bucket{type="rds",le="0.1"} 24488
pilot_xds_push_time_bucket{type="rds",le="1"} 25794
pilot_xds_push_time_bucket{type="rds",le="3"} 25800
pilot_xds_push_time_bucket{type="rds",le="5"} 25801
pilot_xds_push_time_bucket{type="rds",le="10"} 25803
pilot_xds_push_time_bucket{type="rds",le="20"} 25803
pilot_xds_push_time_bucket{type="rds",le="30"} 25803
pilot_xds_push_time_bucket{type="rds",le="+Inf"} 25803
pilot_xds_push_time_sum{type="rds"} 513.1267674609979
pilot_xds_push_time_count{type="rds"} 25803
pilot_xds_push_time_bucket{type="sds",le="0.01"} 499
pilot_xds_push_time_bucket{type="sds",le="0.1"} 500
pilot_xds_push_time_bucket{type="sds",le="1"} 505
pilot_xds_push_time_bucket{type="sds",le="3"} 505
pilot_xds_push_time_bucket{type="sds",le="5"} 506
pilot_xds_push_time_bucket{type="sds",le="10"} 506
pilot_xds_push_time_bucket{type="sds",le="20"} 506
pilot_xds_push_time_bucket{type="sds",le="30"} 506
pilot_xds_push_time_bucket{type="sds",le="+Inf"} 506
pilot_xds_push_time_sum{type="sds"} 5.303841941
pilot_xds_push_time_count{type="sds"} 506
# HELP pilot_xds_pushes Pilot build and send errors for lds, rds, cds and eds.
# TYPE pilot_xds_pushes counter
pilot_xds_pushes{type="cds"} 25767
pilot_xds_pushes{type="eds"} 26754
pilot_xds_pushes{type="lds"} 25754
pilot_xds_pushes{type="nds"} 869
pilot_xds_pushes{type="rds"} 25803
pilot_xds_pushes{type="sds"} 506
# HELP pilot_xds_send_time Total time in seconds Pilot takes to send generated configuration.
# TYPE pilot_xds_send_time histogram
pilot_xds_send_time_bucket{le="0.01"} 102564
pilot_xds_send_time_bucket{le="0.1"} 105260
pilot_xds_send_time_bucket{le="1"} 105443
pilot_xds_send_time_bucket{le="3"} 105450
pilot_xds_send_time_bucket{le="5"} 105451
pilot_xds_send_time_bucket{le="10"} 105453
pilot_xds_send_time_bucket{le="20"} 105453
pilot_xds_send_time_bucket{le="30"} 105453
pilot_xds_send_time_bucket{le="+Inf"} 105453
pilot_xds_send_time_sum 177.88388412999922
pilot_xds_send_time_count 105453
# HELP process_cpu_seconds_total Total user and system CPU time spent in seconds.
# TYPE process_cpu_seconds_total counter
process_cpu_seconds_total 3409.52
# HELP process_max_fds Maximum number of open file descriptors.
# TYPE process_max_fds gauge
process_max_fds 1.048576e+06
# HELP process_open_fds Number of open file descriptors.
# TYPE process_open_fds gauge
process_open_fds 36
# HELP process_resident_memory_bytes Resident memory size in bytes.
# TYPE process_resident_memory_bytes gauge
process_resident_memory_bytes 9.0271744e+07
# HELP process_start_time_seconds Start time of the process since unix epoch in seconds.
# TYPE process_start_time_seconds gauge
process_start_time_seconds 1.71369108567e+09
# HELP process_virtual_memory_bytes Virtual memory size in bytes.
# TYPE process_virtual_memory_bytes gauge
process_virtual_memory_bytes 1.409568768e+09
# HELP process_virtual_memory_max_bytes Maximum amount of virtual memory available in bytes.
# TYPE process_virtual_memory_max_bytes gauge
process_virtual_memory_max_bytes 1.8446744073709552e+19
# HELP sidecar_injection_requests_total Total number of sidecar injection requests.
# TYPE sidecar_injection_requests_total counter
sidecar_injection_requests_total 14247
# HELP sidecar_injection_skip_total Total number of skipped sidecar injection requests.
# TYPE sidecar_injection_skip_total counter
sidecar_injection_skip_total 14229
# HELP sidecar_injection_success_total Total number of successful sidecar injection requests.
# TYPE sidecar_injection_success_total counter
sidecar_injection_success_total 18
# HELP sidecar_injection_time_seconds Total time taken for injection in seconds.
# TYPE sidecar_injection_time_seconds histogram
sidecar_injection_time_seconds_bucket{le="0.1"} 14238
sidecar_injection_time_seconds_bucket{le="1"} 14243
sidecar_injection_time_seconds_bucket{le="3"} 14245
sidecar_injection_time_seconds_bucket{le="5"} 14247
sidecar_injection_time_seconds_bucket{le="10"} 14247
sidecar_injection_time_seconds_bucket{le="20"} 14247
sidecar_injection_time_seconds_bucket{le="30"} 14247
sidecar_injection_time_seconds_bucket{le="60"} 14247
sidecar_injection_time_seconds_bucket{le="+Inf"} 14247
sidecar_injection_time_seconds_sum 25.545463831999847
sidecar_injection_time_seconds_count 14247

BASH

`15017`: Kubernetes API Server

Kubernetes API의 Mutating Admission Webhook을 통해 k8s API Server로부터 sidecar injection을 위한 pod creation event 및 Istio resource(e.g. Gateway, VirtualService) validation을 위한 event를 수신한다.
참고로, istiod는 이 webhook과 Kubernetes WATCH API의 watch=true parameter 설정을 통해 상시 Kubernetes와 state를 동기화할 것으로 추정된다. watch=true 는 kubectl get pod -w 의 -w 에 해당한다. 내부 구현은 아래 링크의 첫번째에서는 Chunked Transfer Encoding 또는 Websocket을 논하며, 두번째의 공식 문서에서는 Chunked Transfer Encoding만 논한다. Persistent connection 기반이므로 push 방식으로 event를 수신할 것이다.
pkg/endpoints/handlers/watch.gokubernetes · 2026-10-16 업데이트
Kubernetes API ConceptsThe Kubernetes API is a resource-based (RESTful) programmatic interface provided via HTTP. It supports retrieving, creating, updating, and deleting primary resources via the standard HTTP verbs (POST, PUT, PATCH, DELETE, GET). For some resources, the API includes additional subresources that allow fine grained authorization (such as separate views for Pod details and log retrievals), and can accept and serve those resources in different representations for convenience or efficiency. Kubernetes supports efficient change notifications on resources via watches.
https://kubernetes.io/docs/reference/using-api/api-concepts/

Chunked Transfer Encoding은 server push를 위한 HTTP persistent connection 기법 중 하나이다.

Chunked transfer encodingChunked transfer encoding is a streaming data transfer mechanism available in Hypertext Transfer Protocol (HTTP) version 1.1, defined in RFC 9112 §7.1. In chunked transfer encoding, the data stream is divided into a series of non-overlapping "chunks". The chunks are sent out and received independently of one another. No knowledge of the data stream outside the currently-being-processed chunk is necessary for both the sender and the receiver at any given time.
https://en.wikipedia.org/wiki/Chunked_transfer_encoding

Istio-init

Istio proxy가 생성되기 전에 실행되는 Istio-init은 Istio proxy가 위치할 pod의 Iptable rule을 설정한다. 이 rule을 따르는 path는 DNS query(from app to DNS proxy)를 포함한 app과 Envoy 간 in/outbound traffic이다.

Istio proxy

Istio proxy는 내부적으로 Pilot agent, Envoy 두 개의 process로, DNS proxy는 Pilot agent의 일부로 동작한다. kubectl -n {namespace} exec -it {podname} -c istio-proxy -- netstat -tnl 명령으로 아래와 같이 Istio proxy가 노출한 port 확인이 가능하다.

Active Internet connections (only servers)
Proto Recv-Q Send-Q Local Address           Foreign Address         State      
tcp        0      0 0.0.0.0:80              0.0.0.0:*               LISTEN     
tcp        0      0 127.0.0.1:15053         0.0.0.0:*               LISTEN     
tcp        0      0 127.0.0.1:15004         0.0.0.0:*               LISTEN     
tcp        0      0 127.0.0.1:15000         0.0.0.0:*               LISTEN     
tcp        0      0 0.0.0.0:15021           0.0.0.0:*               LISTEN     
tcp        0      0 0.0.0.0:15006           0.0.0.0:*               LISTEN     
tcp        0      0 0.0.0.0:15001           0.0.0.0:*               LISTEN     
tcp        0      0 0.0.0.0:15090           0.0.0.0:*               LISTEN     
tcp6       0      0 :::80                   :::*                    LISTEN     
tcp6       0      0 :::15020                :::*                    LISTEN

BASH

아래 이어지는 port 별 설명 중 각 항목 제목은 포트와 해당 port를 사용하는 client를 나타낸다. 괄호 안은 해당 port를 노출하는 component 이다.

`15000` (Envoy): Admin

Envoy의 administration interface port이다.
kubectl exec -n {namespace} {podname} -c istio-proxy -- curl http://localhost:15000/clusters?format=json 와 같은 방식로 호출 가능하다.
전체 목록은 다음 참고.

Administration interface — envoy 1.31.0-dev-48d743 documentationEnvoy exposes a local administration interface that can be used to query and modify different aspects of the server:
https://www.envoyproxy.io/docs/envoy/latest/operations/admin

`15001` (Envoy): App container

Iptable rule에 의해 app의 outbound traffic이 이 port로 들어온다. 이후 해당 traffic을 destination service로 routing한다.

`15004` (Envoy): Debug

debugging용으로 istiod 의 8080 과 동일 역할이다.

`15006` (Envoy): external services

Iptable rule에 의해 app으로의 inbound traffic이 redirect되고, 이후 이 traffic은 app의 해당 traffic port로 전달된다.

`15020` (Pilot agent)

다수의 client가 각기 다른 목적으로 사용한다.

Health checking
- /healthz/ready: Envoy와 DNS proxy에 대한 health checking path. 15021 port로부터의 해당 요청을 받기도 한다. 15021 port 설명 참조.
- /app-health/: app의 readiness, liveness probing을 대신하는 path. Istio는 app probing path를 본 path로 변경하여 probing을 대신하며, ISTIO_KUBE_APP_PROBERS 환경 변수에 설정된 원래의 probing path로 probing request를 redirect 한다.
  이에 따라 Istio injection이 완료된 pod의 readiness, liveness path는 각각 /app-health/{app container name}/readyz, /app-health/{app container name}/livez으로 바뀐다.
  아래는 ISTIO_KUBE_APP_PROBERS 환경 변수 예제(app명은 dockebi)로, 원본과 실제 간 probing path mapping 현황을 보여준다.
```
- name: ISTIO_KUBE_APP_PROBERS
        value: >-
          {"/app-health/dockebi/livez":{"httpGet":{"path":"/v1/health","port":8080,"scheme":"HTTP"},"timeoutSeconds":1},"/app-health/dockebi/readyz":{"httpGet":{"path":"/v1/health","port":8080,"scheme":"HTTP"},"timeoutSeconds":1}}
```
  YAML
  아래는 관련 Istio 공식 문서이다.
  
  Health Checking of Istio ServicesShows how to do health checking for Istio services.
  https://istio.io/latest/docs/ops/configuration/mesh/app-health-check/

Prometheus: /stat/prometheus path로 scraping API를 노출하여 해당 sidecar 및 app의 metrics를 전한다. 이 request는 Envoy의 15090 port로도 전달되어, 최종적으로 Envoy의 metrics도 포함한 response를 전한다.

다음은 metrics 예로 kubectl -n cluster exec -it docserver-59f78d66f6-ldg79 -- curl localhost:15020/stats/prometheus 의 호출 결과로 Envoy의 항목은 제외한 결과다(펼쳐야 보인다).

# HELP istio_agent_cert_expiry_seconds The time remaining, in seconds, before the certificate chain will expire. A negative value indicates the cert is expired.
# TYPE istio_agent_cert_expiry_seconds gauge
istio_agent_cert_expiry_seconds{resource_name="default"} 70510.904807927
# HELP istio_agent_dns_requests_total Total number of DNS requests.
# TYPE istio_agent_dns_requests_total counter
istio_agent_dns_requests_total 8
# HELP istio_agent_dns_upstream_request_duration_seconds Total time in seconds Istio takes to get DNS response from upstream.
# TYPE istio_agent_dns_upstream_request_duration_seconds histogram
istio_agent_dns_upstream_request_duration_seconds_bucket{le="0.001"} 4
istio_agent_dns_upstream_request_duration_seconds_bucket{le="0.005"} 4
istio_agent_dns_upstream_request_duration_seconds_bucket{le="0.01"} 4
istio_agent_dns_upstream_request_duration_seconds_bucket{le="0.1"} 8
istio_agent_dns_upstream_request_duration_seconds_bucket{le="1"} 8
istio_agent_dns_upstream_request_duration_seconds_bucket{le="5"} 8
istio_agent_dns_upstream_request_duration_seconds_bucket{le="+Inf"} 8
istio_agent_dns_upstream_request_duration_seconds_sum 0.153970554
istio_agent_dns_upstream_request_duration_seconds_count 8
# HELP istio_agent_dns_upstream_requests_total Total number of DNS requests forwarded to upstream.
# TYPE istio_agent_dns_upstream_requests_total counter
istio_agent_dns_upstream_requests_total 8
# HELP istio_agent_endpoint_no_pod Endpoints without an associated pod.
# TYPE istio_agent_endpoint_no_pod gauge
istio_agent_endpoint_no_pod 0
# HELP istio_agent_envoy_connection_terminations The total number of connection errors from envoy
# TYPE istio_agent_envoy_connection_terminations counter
istio_agent_envoy_connection_terminations{type="cancelled"} 152
# HELP istio_agent_go_gc_duration_seconds A summary of the pause duration of garbage collection cycles.
# TYPE istio_agent_go_gc_duration_seconds summary
istio_agent_go_gc_duration_seconds{quantile="0"} 4.6568e-05
istio_agent_go_gc_duration_seconds{quantile="0.25"} 6.7989e-05
istio_agent_go_gc_duration_seconds{quantile="0.5"} 8.5569e-05
istio_agent_go_gc_duration_seconds{quantile="0.75"} 0.000108146
istio_agent_go_gc_duration_seconds{quantile="1"} 0.000300759
istio_agent_go_gc_duration_seconds_sum 0.206340268
istio_agent_go_gc_duration_seconds_count 2295
# HELP istio_agent_go_goroutines Number of goroutines that currently exist.
# TYPE istio_agent_go_goroutines gauge
istio_agent_go_goroutines 62
# HELP istio_agent_go_info Information about the Go environment.
# TYPE istio_agent_go_info gauge
istio_agent_go_info{version="go1.22.2"} 1
# HELP istio_agent_go_memstats_alloc_bytes Number of bytes allocated and still in use.
# TYPE istio_agent_go_memstats_alloc_bytes gauge
istio_agent_go_memstats_alloc_bytes 6.260272e+06
# HELP istio_agent_go_memstats_alloc_bytes_total Total number of bytes allocated, even if freed.
# TYPE istio_agent_go_memstats_alloc_bytes_total counter
istio_agent_go_memstats_alloc_bytes_total 1.209156264e+09
# HELP istio_agent_go_memstats_buck_hash_sys_bytes Number of bytes used by the profiling bucket hash table.
# TYPE istio_agent_go_memstats_buck_hash_sys_bytes gauge
istio_agent_go_memstats_buck_hash_sys_bytes 1.562057e+06
# HELP istio_agent_go_memstats_frees_total Total number of frees.
# TYPE istio_agent_go_memstats_frees_total counter
istio_agent_go_memstats_frees_total 1.2175711e+07
# HELP istio_agent_go_memstats_gc_sys_bytes Number of bytes used for garbage collection system metadata.
# TYPE istio_agent_go_memstats_gc_sys_bytes gauge
istio_agent_go_memstats_gc_sys_bytes 3.878968e+06
# HELP istio_agent_go_memstats_heap_alloc_bytes Number of heap bytes allocated and still in use.
# TYPE istio_agent_go_memstats_heap_alloc_bytes gauge
istio_agent_go_memstats_heap_alloc_bytes 6.260272e+06
# HELP istio_agent_go_memstats_heap_idle_bytes Number of heap bytes waiting to be used.
# TYPE istio_agent_go_memstats_heap_idle_bytes gauge
istio_agent_go_memstats_heap_idle_bytes 7.176192e+06
# HELP istio_agent_go_memstats_heap_inuse_bytes Number of heap bytes that are in use.
# TYPE istio_agent_go_memstats_heap_inuse_bytes gauge
istio_agent_go_memstats_heap_inuse_bytes 8.454144e+06
# HELP istio_agent_go_memstats_heap_objects Number of allocated objects.
# TYPE istio_agent_go_memstats_heap_objects gauge
istio_agent_go_memstats_heap_objects 33823
# HELP istio_agent_go_memstats_heap_released_bytes Number of heap bytes released to OS.
# TYPE istio_agent_go_memstats_heap_released_bytes gauge
istio_agent_go_memstats_heap_released_bytes 6.455296e+06
# HELP istio_agent_go_memstats_heap_sys_bytes Number of heap bytes obtained from system.
# TYPE istio_agent_go_memstats_heap_sys_bytes gauge
istio_agent_go_memstats_heap_sys_bytes 1.5630336e+07
# HELP istio_agent_go_memstats_last_gc_time_seconds Number of seconds since 1970 of last garbage collection.
# TYPE istio_agent_go_memstats_last_gc_time_seconds gauge
istio_agent_go_memstats_last_gc_time_seconds 1.714551098337904e+09
# HELP istio_agent_go_memstats_lookups_total Total number of pointer lookups.
# TYPE istio_agent_go_memstats_lookups_total counter
istio_agent_go_memstats_lookups_total 0
# HELP istio_agent_go_memstats_mallocs_total Total number of mallocs.
# TYPE istio_agent_go_memstats_mallocs_total counter
istio_agent_go_memstats_mallocs_total 1.2209534e+07
# HELP istio_agent_go_memstats_mcache_inuse_bytes Number of bytes in use by mcache structures.
# TYPE istio_agent_go_memstats_mcache_inuse_bytes gauge
istio_agent_go_memstats_mcache_inuse_bytes 1200
# HELP istio_agent_go_memstats_mcache_sys_bytes Number of bytes used for mcache structures obtained from system.
# TYPE istio_agent_go_memstats_mcache_sys_bytes gauge
istio_agent_go_memstats_mcache_sys_bytes 15600
# HELP istio_agent_go_memstats_mspan_inuse_bytes Number of bytes in use by mspan structures.
# TYPE istio_agent_go_memstats_mspan_inuse_bytes gauge
istio_agent_go_memstats_mspan_inuse_bytes 135040
# HELP istio_agent_go_memstats_mspan_sys_bytes Number of bytes used for mspan structures obtained from system.
# TYPE istio_agent_go_memstats_mspan_sys_bytes gauge
istio_agent_go_memstats_mspan_sys_bytes 195840
# HELP istio_agent_go_memstats_next_gc_bytes Number of heap bytes when next garbage collection will take place.
# TYPE istio_agent_go_memstats_next_gc_bytes gauge
istio_agent_go_memstats_next_gc_bytes 1.2744448e+07
# HELP istio_agent_go_memstats_other_sys_bytes Number of bytes used for other system allocations.
# TYPE istio_agent_go_memstats_other_sys_bytes gauge
istio_agent_go_memstats_other_sys_bytes 464151
# HELP istio_agent_go_memstats_stack_inuse_bytes Number of bytes in use by the stack allocator.
# TYPE istio_agent_go_memstats_stack_inuse_bytes gauge
istio_agent_go_memstats_stack_inuse_bytes 1.14688e+06
# HELP istio_agent_go_memstats_stack_sys_bytes Number of bytes obtained from system for stack allocator.
# TYPE istio_agent_go_memstats_stack_sys_bytes gauge
istio_agent_go_memstats_stack_sys_bytes 1.14688e+06
# HELP istio_agent_go_memstats_sys_bytes Number of bytes obtained from system.
# TYPE istio_agent_go_memstats_sys_bytes gauge
istio_agent_go_memstats_sys_bytes 2.2893832e+07
# HELP istio_agent_go_threads Number of OS threads created.
# TYPE istio_agent_go_threads gauge
istio_agent_go_threads 8
# HELP istio_agent_istiod_connection_terminations The total number of connection errors to Istiod
# TYPE istio_agent_istiod_connection_terminations counter
istio_agent_istiod_connection_terminations{type="cancelled"} 152
# HELP istio_agent_num_outgoing_requests Number of total outgoing requests (e.g. to a token exchange server, CA, etc.)
# TYPE istio_agent_num_outgoing_requests counter
istio_agent_num_outgoing_requests{request_type="csr"} 7
# HELP istio_agent_outgoing_latency The latency of outgoing requests (e.g. to a token exchange server, CA, etc.) in milliseconds.
# TYPE istio_agent_outgoing_latency counter
istio_agent_outgoing_latency{request_type="csr"} 305.123204
# HELP istio_agent_pilot_conflict_inbound_listener Number of conflicting inbound listeners.
# TYPE istio_agent_pilot_conflict_inbound_listener gauge
istio_agent_pilot_conflict_inbound_listener 0
# HELP istio_agent_pilot_conflict_outbound_listener_tcp_over_current_tcp Number of conflicting tcp listeners with current tcp listener.
# TYPE istio_agent_pilot_conflict_outbound_listener_tcp_over_current_tcp gauge
istio_agent_pilot_conflict_outbound_listener_tcp_over_current_tcp 0
# HELP istio_agent_pilot_destrule_subsets Duplicate subsets across destination rules for same host
# TYPE istio_agent_pilot_destrule_subsets gauge
istio_agent_pilot_destrule_subsets 0
# HELP istio_agent_pilot_dns_cluster_without_endpoints DNS clusters without endpoints caused by the endpoint field in STRICT_DNS type cluster is not set or the corresponding subset cannot select any endpoint
# TYPE istio_agent_pilot_dns_cluster_without_endpoints gauge
istio_agent_pilot_dns_cluster_without_endpoints 0
# HELP istio_agent_pilot_duplicate_envoy_clusters Duplicate envoy clusters caused by service entries with same hostname
# TYPE istio_agent_pilot_duplicate_envoy_clusters gauge
istio_agent_pilot_duplicate_envoy_clusters 0
# HELP istio_agent_pilot_eds_no_instances Number of clusters without instances.
# TYPE istio_agent_pilot_eds_no_instances gauge
istio_agent_pilot_eds_no_instances 0
# HELP istio_agent_pilot_endpoint_not_ready Endpoint found in unready state.
# TYPE istio_agent_pilot_endpoint_not_ready gauge
istio_agent_pilot_endpoint_not_ready 0
# HELP istio_agent_pilot_no_ip Pods not found in the endpoint table, possibly invalid.
# TYPE istio_agent_pilot_no_ip gauge
istio_agent_pilot_no_ip 0
# HELP istio_agent_pilot_proxy_convergence_time Delay in seconds between config change and a proxy receiving all required configuration.
# TYPE istio_agent_pilot_proxy_convergence_time histogram
istio_agent_pilot_proxy_convergence_time_bucket{le="0.1"} 0
istio_agent_pilot_proxy_convergence_time_bucket{le="0.5"} 0
istio_agent_pilot_proxy_convergence_time_bucket{le="1"} 1
istio_agent_pilot_proxy_convergence_time_bucket{le="3"} 6
istio_agent_pilot_proxy_convergence_time_bucket{le="5"} 6
istio_agent_pilot_proxy_convergence_time_bucket{le="10"} 6
istio_agent_pilot_proxy_convergence_time_bucket{le="20"} 6
istio_agent_pilot_proxy_convergence_time_bucket{le="30"} 6
istio_agent_pilot_proxy_convergence_time_bucket{le="+Inf"} 6
istio_agent_pilot_proxy_convergence_time_sum 7.602678296999999
istio_agent_pilot_proxy_convergence_time_count 6
# HELP istio_agent_pilot_proxy_queue_time Time in seconds, a proxy is in the push queue before being dequeued.
# TYPE istio_agent_pilot_proxy_queue_time histogram
istio_agent_pilot_proxy_queue_time_bucket{le="0.1"} 12
istio_agent_pilot_proxy_queue_time_bucket{le="0.5"} 12
istio_agent_pilot_proxy_queue_time_bucket{le="1"} 12
istio_agent_pilot_proxy_queue_time_bucket{le="3"} 12
istio_agent_pilot_proxy_queue_time_bucket{le="5"} 12
istio_agent_pilot_proxy_queue_time_bucket{le="10"} 12
istio_agent_pilot_proxy_queue_time_bucket{le="20"} 12
istio_agent_pilot_proxy_queue_time_bucket{le="30"} 12
istio_agent_pilot_proxy_queue_time_bucket{le="+Inf"} 12
istio_agent_pilot_proxy_queue_time_sum 0.00054037
istio_agent_pilot_proxy_queue_time_count 12
# HELP istio_agent_pilot_push_triggers Total number of times a push was triggered, labeled by reason for the push.
# TYPE istio_agent_pilot_push_triggers counter
istio_agent_pilot_push_triggers{type="secret"} 12
# HELP istio_agent_pilot_virt_services Total virtual services known to pilot.
# TYPE istio_agent_pilot_virt_services gauge
istio_agent_pilot_virt_services 0
# HELP istio_agent_pilot_vservice_dup_domain Virtual services with dup domains.
# TYPE istio_agent_pilot_vservice_dup_domain gauge
istio_agent_pilot_vservice_dup_domain 0
# HELP istio_agent_pilot_xds Number of endpoints connected to this pilot using XDS.
# TYPE istio_agent_pilot_xds gauge
istio_agent_pilot_xds{version="1.21.1"} 2
# HELP istio_agent_pilot_xds_config_size_bytes Distribution of configuration sizes pushed to clients
# TYPE istio_agent_pilot_xds_config_size_bytes histogram
istio_agent_pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/envoy.extensions.transport_sockets.tls.v3.Secret",le="1"} 0
istio_agent_pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/envoy.extensions.transport_sockets.tls.v3.Secret",le="10000"} 8
istio_agent_pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/envoy.extensions.transport_sockets.tls.v3.Secret",le="1e+06"} 8
istio_agent_pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/envoy.extensions.transport_sockets.tls.v3.Secret",le="4e+06"} 8
istio_agent_pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/envoy.extensions.transport_sockets.tls.v3.Secret",le="1e+07"} 8
istio_agent_pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/envoy.extensions.transport_sockets.tls.v3.Secret",le="4e+07"} 8
istio_agent_pilot_xds_config_size_bytes_bucket{type="type.googleapis.com/envoy.extensions.transport_sockets.tls.v3.Secret",le="+Inf"} 8
istio_agent_pilot_xds_config_size_bytes_sum{type="type.googleapis.com/envoy.extensions.transport_sockets.tls.v3.Secret"} 28993
istio_agent_pilot_xds_config_size_bytes_count{type="type.googleapis.com/envoy.extensions.transport_sockets.tls.v3.Secret"} 8
# HELP istio_agent_pilot_xds_push_time Total time in seconds Pilot takes to push lds, rds, cds and eds.
# TYPE istio_agent_pilot_xds_push_time histogram
istio_agent_pilot_xds_push_time_bucket{type="sds",le="0.01"} 2
istio_agent_pilot_xds_push_time_bucket{type="sds",le="0.1"} 2
istio_agent_pilot_xds_push_time_bucket{type="sds",le="1"} 3
istio_agent_pilot_xds_push_time_bucket{type="sds",le="3"} 8
istio_agent_pilot_xds_push_time_bucket{type="sds",le="5"} 8
istio_agent_pilot_xds_push_time_bucket{type="sds",le="10"} 8
istio_agent_pilot_xds_push_time_bucket{type="sds",le="20"} 8
istio_agent_pilot_xds_push_time_bucket{type="sds",le="30"} 8
istio_agent_pilot_xds_push_time_bucket{type="sds",le="+Inf"} 8
istio_agent_pilot_xds_push_time_sum{type="sds"} 7.602803301000002
istio_agent_pilot_xds_push_time_count{type="sds"} 8
# HELP istio_agent_pilot_xds_pushes Pilot build and send errors for lds, rds, cds and eds.
# TYPE istio_agent_pilot_xds_pushes counter
istio_agent_pilot_xds_pushes{type="sds"} 8
# HELP istio_agent_pilot_xds_send_time Total time in seconds Pilot takes to send generated configuration.
# TYPE istio_agent_pilot_xds_send_time histogram
istio_agent_pilot_xds_send_time_bucket{le="0.01"} 8
istio_agent_pilot_xds_send_time_bucket{le="0.1"} 8
istio_agent_pilot_xds_send_time_bucket{le="1"} 8
istio_agent_pilot_xds_send_time_bucket{le="3"} 8
istio_agent_pilot_xds_send_time_bucket{le="5"} 8
istio_agent_pilot_xds_send_time_bucket{le="10"} 8
istio_agent_pilot_xds_send_time_bucket{le="20"} 8
istio_agent_pilot_xds_send_time_bucket{le="30"} 8
istio_agent_pilot_xds_send_time_bucket{le="+Inf"} 8
istio_agent_pilot_xds_send_time_sum 0.000114317
istio_agent_pilot_xds_send_time_count 8
# HELP istio_agent_process_cpu_seconds_total Total user and system CPU time spent in seconds.
# TYPE istio_agent_process_cpu_seconds_total counter
istio_agent_process_cpu_seconds_total 114.63
# HELP istio_agent_process_max_fds Maximum number of open file descriptors.
# TYPE istio_agent_process_max_fds gauge
istio_agent_process_max_fds 1.048576e+06
# HELP istio_agent_process_open_fds Number of open file descriptors.
# TYPE istio_agent_process_open_fds gauge
istio_agent_process_open_fds 22
# HELP istio_agent_process_resident_memory_bytes Resident memory size in bytes.
# TYPE istio_agent_process_resident_memory_bytes gauge
istio_agent_process_resident_memory_bytes 2.8893184e+07
# HELP istio_agent_process_start_time_seconds Start time of the process since unix epoch in seconds.
# TYPE istio_agent_process_start_time_seconds gauge
istio_agent_process_start_time_seconds 1.71427609067e+09
# HELP istio_agent_process_virtual_memory_bytes Virtual memory size in bytes.
# TYPE istio_agent_process_virtual_memory_bytes gauge
istio_agent_process_virtual_memory_bytes 1.293365248e+09
# HELP istio_agent_process_virtual_memory_max_bytes Maximum amount of virtual memory available in bytes.
# TYPE istio_agent_process_virtual_memory_max_bytes gauge
istio_agent_process_virtual_memory_max_bytes 1.8446744073709552e+19
# HELP istio_agent_scrapes_total The total number of scrapes.
# TYPE istio_agent_scrapes_total counter
istio_agent_scrapes_total 4587
# HELP istio_agent_startup_duration_seconds The time from the process starting to being marked ready.
# TYPE istio_agent_startup_duration_seconds gauge
istio_agent_startup_duration_seconds 2.298028187
# HELP istio_agent_wasm_cache_entries number of Wasm remote fetch cache entries.
# TYPE istio_agent_wasm_cache_entries gauge
istio_agent_wasm_cache_entries 0
# HELP istio_agent_xds_proxy_requests The total number of Xds Proxy Requests
# TYPE istio_agent_xds_proxy_requests counter
istio_agent_xds_proxy_requests 1622
# HELP istio_agent_xds_proxy_responses The total number of Xds Proxy Responses
# TYPE istio_agent_xds_proxy_responses counter
istio_agent_xds_proxy_responses 851

BASH

Non-Kubernetes worloads(e.g. VM): Envoy와 DNS proxy 및 (설정할 경우) app에 대한 health checking 용도로, Kubernetes 이외의 workload에서 사용된다.
Debug: debugging용으로 istiod 의 8080 과 동일 역할이다.
- /quitquitquit: Pilot agent 프로세스 삭제
- /debug/ndsz: DNS proxy가 보유한 hostname 목록. istiod 의 NDS(Name Discovery Service) API를 통해 설정된 결과
- /debug/pprof: Golang의 profiling endpoint. 하위 path로 다양한 항목을 조회 가능하며, 전체 목록은 root 호출을 통한 결과(HTML)을 통해 확인 가능. 상세 내용은 다음 참조.
  
  Diagnostics - The Go Programming LanguageThe Go ecosystem provides a large suite of APIs and tools to diagnose logic and performance problems in Go programs. This page summarizes the available tools and helps Go users pick the right one for their specific problem.
  https://go.dev/doc/diagnostics#profiling

`15021` (Envoy): Kubelet

Istio proxy(Envoy 및 Pilot agent)에 대한 readiness / startup probing(liveness는 istio가 관여하지 않음) 용도로서, Envoy는 probing traffic를 15020 port의 Pilot agent로 route하여 실제는 15020 에서의 health checking의 결과가 반환된다. 상세 내용은 15020 port의 health checking 설명을 참조.
Readiness / Startup probing path: /heathz/ready

`15053` (DNS proxy): App container

Istio-init이 설정한 Iptable rule에 의해 App의 DNS lookup은 15053 port로 redirect되어 DNS proxy가 DNS lookup request를 처리한다.

`15090` (DNS proxy): App container

Envoy의 Prometheus metrics를 노출한다. 여기에는 XDS, connection, HTTP, outlier, health check, circuit-breaker stats 등이 포함된다.

아래는 kubectl -n cluster exec -it docserver-59f78d66f6-ldg79 -- curl localhost:15090/stats/prometheus 호출 결과다(펼쳐야 보인다).

# TYPE envoy_cluster_assignment_stale counter
envoy_cluster_assignment_stale{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_assignment_timeout_received counter
envoy_cluster_assignment_timeout_received{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_assignment_use_cached counter
envoy_cluster_assignment_use_cached{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_bind_errors counter
envoy_cluster_bind_errors{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_default_total_match_count counter
envoy_cluster_default_total_match_count{cluster_name="xds-grpc"} 1
# TYPE envoy_cluster_http2_dropped_headers_with_underscores counter
envoy_cluster_http2_dropped_headers_with_underscores{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_http2_goaway_sent counter
envoy_cluster_http2_goaway_sent{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_http2_header_overflow counter
envoy_cluster_http2_header_overflow{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_http2_headers_cb_no_stream counter
envoy_cluster_http2_headers_cb_no_stream{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_http2_inbound_empty_frames_flood counter
envoy_cluster_http2_inbound_empty_frames_flood{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_http2_inbound_priority_frames_flood counter
envoy_cluster_http2_inbound_priority_frames_flood{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_http2_inbound_window_update_frames_flood counter
envoy_cluster_http2_inbound_window_update_frames_flood{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_http2_keepalive_timeout counter
envoy_cluster_http2_keepalive_timeout{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_http2_metadata_empty_frames counter
envoy_cluster_http2_metadata_empty_frames{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_http2_outbound_control_flood counter
envoy_cluster_http2_outbound_control_flood{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_http2_outbound_flood counter
envoy_cluster_http2_outbound_flood{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_http2_requests_rejected_with_underscores_in_headers counter
envoy_cluster_http2_requests_rejected_with_underscores_in_headers{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_http2_rx_messaging_error counter
envoy_cluster_http2_rx_messaging_error{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_http2_rx_reset counter
envoy_cluster_http2_rx_reset{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_http2_stream_refused_errors counter
envoy_cluster_http2_stream_refused_errors{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_http2_trailers counter
envoy_cluster_http2_trailers{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_http2_tx_flush_timeout counter
envoy_cluster_http2_tx_flush_timeout{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_http2_tx_reset counter
envoy_cluster_http2_tx_reset{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_internal_upstream_rq counter
envoy_cluster_internal_upstream_rq{response_code="200",cluster_name="xds-grpc"} 153
envoy_cluster_internal_upstream_rq{response_code_class="2xx",cluster_name="xds-grpc"} 153
# TYPE envoy_cluster_internal_upstream_rq_completed counter
envoy_cluster_internal_upstream_rq_completed{cluster_name="xds-grpc"} 153
# TYPE envoy_cluster_lb_healthy_panic counter
envoy_cluster_lb_healthy_panic{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_lb_local_cluster_not_ok counter
envoy_cluster_lb_local_cluster_not_ok{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_lb_recalculate_zone_structures counter
envoy_cluster_lb_recalculate_zone_structures{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_lb_subsets_created counter
envoy_cluster_lb_subsets_created{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_lb_subsets_fallback counter
envoy_cluster_lb_subsets_fallback{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_lb_subsets_fallback_panic counter
envoy_cluster_lb_subsets_fallback_panic{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_lb_subsets_removed counter
envoy_cluster_lb_subsets_removed{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_lb_subsets_selected counter
envoy_cluster_lb_subsets_selected{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_lb_zone_cluster_too_small counter
envoy_cluster_lb_zone_cluster_too_small{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_lb_zone_no_capacity_left counter
envoy_cluster_lb_zone_no_capacity_left{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_lb_zone_number_differs counter
envoy_cluster_lb_zone_number_differs{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_lb_zone_routing_all_directly counter
envoy_cluster_lb_zone_routing_all_directly{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_lb_zone_routing_cross_zone counter
envoy_cluster_lb_zone_routing_cross_zone{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_lb_zone_routing_sampled counter
envoy_cluster_lb_zone_routing_sampled{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_membership_change counter
envoy_cluster_membership_change{cluster_name="xds-grpc"} 1
# TYPE envoy_cluster_original_dst_host_invalid counter
envoy_cluster_original_dst_host_invalid{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_retry_or_shadow_abandoned counter
envoy_cluster_retry_or_shadow_abandoned{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_update_attempt counter
envoy_cluster_update_attempt{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_update_empty counter
envoy_cluster_update_empty{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_update_failure counter
envoy_cluster_update_failure{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_update_no_rebuild counter
envoy_cluster_update_no_rebuild{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_update_success counter
envoy_cluster_update_success{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_upstream_cx_close_notify counter
envoy_cluster_upstream_cx_close_notify{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_upstream_cx_connect_attempts_exceeded counter
envoy_cluster_upstream_cx_connect_attempts_exceeded{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_upstream_cx_connect_fail counter
envoy_cluster_upstream_cx_connect_fail{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_upstream_cx_connect_timeout counter
envoy_cluster_upstream_cx_connect_timeout{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_upstream_cx_connect_with_0_rtt counter
envoy_cluster_upstream_cx_connect_with_0_rtt{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_upstream_cx_destroy counter
envoy_cluster_upstream_cx_destroy{cluster_name="xds-grpc"} 152
# TYPE envoy_cluster_upstream_cx_destroy_local counter
envoy_cluster_upstream_cx_destroy_local{cluster_name="xds-grpc"} 152
# TYPE envoy_cluster_upstream_cx_destroy_local_with_active_rq counter
envoy_cluster_upstream_cx_destroy_local_with_active_rq{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_upstream_cx_destroy_remote counter
envoy_cluster_upstream_cx_destroy_remote{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_upstream_cx_destroy_remote_with_active_rq counter
envoy_cluster_upstream_cx_destroy_remote_with_active_rq{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_upstream_cx_destroy_with_active_rq counter
envoy_cluster_upstream_cx_destroy_with_active_rq{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_upstream_cx_http1_total counter
envoy_cluster_upstream_cx_http1_total{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_upstream_cx_http2_total counter
envoy_cluster_upstream_cx_http2_total{cluster_name="xds-grpc"} 153
# TYPE envoy_cluster_upstream_cx_http3_total counter
envoy_cluster_upstream_cx_http3_total{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_upstream_cx_idle_timeout counter
envoy_cluster_upstream_cx_idle_timeout{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_upstream_cx_max_duration_reached counter
envoy_cluster_upstream_cx_max_duration_reached{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_upstream_cx_max_requests counter
envoy_cluster_upstream_cx_max_requests{cluster_name="xds-grpc"} 153
# TYPE envoy_cluster_upstream_cx_none_healthy counter
envoy_cluster_upstream_cx_none_healthy{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_upstream_cx_overflow counter
envoy_cluster_upstream_cx_overflow{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_upstream_cx_pool_overflow counter
envoy_cluster_upstream_cx_pool_overflow{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_upstream_cx_protocol_error counter
envoy_cluster_upstream_cx_protocol_error{cluster_name="xds-grpc"} 152
# TYPE envoy_cluster_upstream_cx_rx_bytes_total counter
envoy_cluster_upstream_cx_rx_bytes_total{cluster_name="xds-grpc"} 29785295
# TYPE envoy_cluster_upstream_cx_total counter
envoy_cluster_upstream_cx_total{cluster_name="xds-grpc"} 153
# TYPE envoy_cluster_upstream_cx_tx_bytes_total counter
envoy_cluster_upstream_cx_tx_bytes_total{cluster_name="xds-grpc"} 7085862
# TYPE envoy_cluster_upstream_flow_control_backed_up_total counter
envoy_cluster_upstream_flow_control_backed_up_total{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_upstream_flow_control_drained_total counter
envoy_cluster_upstream_flow_control_drained_total{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_upstream_flow_control_paused_reading_total counter
envoy_cluster_upstream_flow_control_paused_reading_total{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_upstream_flow_control_resumed_reading_total counter
envoy_cluster_upstream_flow_control_resumed_reading_total{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_upstream_http3_broken counter
envoy_cluster_upstream_http3_broken{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_upstream_internal_redirect_failed_total counter
envoy_cluster_upstream_internal_redirect_failed_total{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_upstream_internal_redirect_succeeded_total counter
envoy_cluster_upstream_internal_redirect_succeeded_total{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_upstream_rq counter
envoy_cluster_upstream_rq{response_code="200",cluster_name="xds-grpc"} 153
envoy_cluster_upstream_rq{response_code_class="2xx",cluster_name="xds-grpc"} 153
# TYPE envoy_cluster_upstream_rq_0rtt counter
envoy_cluster_upstream_rq_0rtt{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_upstream_rq_cancelled counter
envoy_cluster_upstream_rq_cancelled{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_upstream_rq_completed counter
envoy_cluster_upstream_rq_completed{cluster_name="xds-grpc"} 153
# TYPE envoy_cluster_upstream_rq_maintenance_mode counter
envoy_cluster_upstream_rq_maintenance_mode{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_upstream_rq_max_duration_reached counter
envoy_cluster_upstream_rq_max_duration_reached{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_upstream_rq_pending_failure_eject counter
envoy_cluster_upstream_rq_pending_failure_eject{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_upstream_rq_pending_overflow counter
envoy_cluster_upstream_rq_pending_overflow{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_upstream_rq_pending_total counter
envoy_cluster_upstream_rq_pending_total{cluster_name="xds-grpc"} 153
# TYPE envoy_cluster_upstream_rq_per_try_idle_timeout counter
envoy_cluster_upstream_rq_per_try_idle_timeout{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_upstream_rq_per_try_timeout counter
envoy_cluster_upstream_rq_per_try_timeout{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_upstream_rq_retry counter
envoy_cluster_upstream_rq_retry{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_upstream_rq_retry_backoff_exponential counter
envoy_cluster_upstream_rq_retry_backoff_exponential{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_upstream_rq_retry_backoff_ratelimited counter
envoy_cluster_upstream_rq_retry_backoff_ratelimited{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_upstream_rq_retry_limit_exceeded counter
envoy_cluster_upstream_rq_retry_limit_exceeded{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_upstream_rq_retry_overflow counter
envoy_cluster_upstream_rq_retry_overflow{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_upstream_rq_retry_success counter
envoy_cluster_upstream_rq_retry_success{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_upstream_rq_rx_reset counter
envoy_cluster_upstream_rq_rx_reset{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_upstream_rq_timeout counter
envoy_cluster_upstream_rq_timeout{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_upstream_rq_total counter
envoy_cluster_upstream_rq_total{cluster_name="xds-grpc"} 153
# TYPE envoy_cluster_upstream_rq_tx_reset counter
envoy_cluster_upstream_rq_tx_reset{cluster_name="xds-grpc"} 152
# TYPE envoy_cluster_manager_cds_init_fetch_timeout counter
envoy_cluster_manager_cds_init_fetch_timeout{} 0
# TYPE envoy_cluster_manager_cds_update_attempt counter
envoy_cluster_manager_cds_update_attempt{} 322
# TYPE envoy_cluster_manager_cds_update_failure counter
envoy_cluster_manager_cds_update_failure{} 152
# TYPE envoy_cluster_manager_cds_update_rejected counter
envoy_cluster_manager_cds_update_rejected{} 0
# TYPE envoy_cluster_manager_cds_update_success counter
envoy_cluster_manager_cds_update_success{} 169
# TYPE envoy_cluster_manager_cluster_added counter
envoy_cluster_manager_cluster_added{} 53
# TYPE envoy_cluster_manager_cluster_modified counter
envoy_cluster_manager_cluster_modified{} 6
# TYPE envoy_cluster_manager_cluster_removed counter
envoy_cluster_manager_cluster_removed{} 0
# TYPE envoy_cluster_manager_cluster_updated counter
envoy_cluster_manager_cluster_updated{} 77
# TYPE envoy_cluster_manager_cluster_updated_via_merge counter
envoy_cluster_manager_cluster_updated_via_merge{} 0
# TYPE envoy_cluster_manager_update_merge_cancelled counter
envoy_cluster_manager_update_merge_cancelled{} 0
# TYPE envoy_cluster_manager_update_out_of_merge_window counter
envoy_cluster_manager_update_out_of_merge_window{} 0
# TYPE istio_requests_total counter
istio_requests_total{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls"} 1615
istio_requests_total{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls"} 11
istio_requests_total{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown"} 1
# TYPE envoy_listener_manager_lds_init_fetch_timeout counter
envoy_listener_manager_lds_init_fetch_timeout{} 0
# TYPE envoy_listener_manager_lds_update_attempt counter
envoy_listener_manager_lds_update_attempt{} 322
# TYPE envoy_listener_manager_lds_update_failure counter
envoy_listener_manager_lds_update_failure{} 152
# TYPE envoy_listener_manager_lds_update_rejected counter
envoy_listener_manager_lds_update_rejected{} 0
# TYPE envoy_listener_manager_lds_update_success counter
envoy_listener_manager_lds_update_success{} 169
# TYPE envoy_listener_manager_listener_added counter
envoy_listener_manager_listener_added{} 42
# TYPE envoy_listener_manager_listener_create_failure counter
envoy_listener_manager_listener_create_failure{} 0
# TYPE envoy_listener_manager_listener_create_success counter
envoy_listener_manager_listener_create_success{} 42
# TYPE envoy_listener_manager_listener_in_place_updated counter
envoy_listener_manager_listener_in_place_updated{} 0
# TYPE envoy_listener_manager_listener_modified counter
envoy_listener_manager_listener_modified{} 0
# TYPE envoy_listener_manager_listener_removed counter
envoy_listener_manager_listener_removed{} 0
# TYPE envoy_listener_manager_listener_stopped counter
envoy_listener_manager_listener_stopped{} 0
# TYPE envoy_server_debug_assertion_failures counter
envoy_server_debug_assertion_failures{} 0
# TYPE envoy_server_dropped_stat_flushes counter
envoy_server_dropped_stat_flushes{} 0
# TYPE envoy_server_dynamic_unknown_fields counter
envoy_server_dynamic_unknown_fields{} 0
# TYPE envoy_server_envoy_bug_failures counter
envoy_server_envoy_bug_failures{} 0
# TYPE envoy_server_main_thread_watchdog_mega_miss counter
envoy_server_main_thread_watchdog_mega_miss{} 0
# TYPE envoy_server_main_thread_watchdog_miss counter
envoy_server_main_thread_watchdog_miss{} 21
# TYPE envoy_server_static_unknown_fields counter
envoy_server_static_unknown_fields{} 0
# TYPE envoy_server_wip_protos counter
envoy_server_wip_protos{} 0
# TYPE envoy_server_worker_0_watchdog_mega_miss counter
envoy_server_worker_0_watchdog_mega_miss{} 0
# TYPE envoy_server_worker_0_watchdog_miss counter
envoy_server_worker_0_watchdog_miss{} 0
# TYPE envoy_cluster_circuit_breakers_default_cx_open gauge
envoy_cluster_circuit_breakers_default_cx_open{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_circuit_breakers_default_cx_pool_open gauge
envoy_cluster_circuit_breakers_default_cx_pool_open{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_circuit_breakers_default_rq_open gauge
envoy_cluster_circuit_breakers_default_rq_open{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_circuit_breakers_default_rq_pending_open gauge
envoy_cluster_circuit_breakers_default_rq_pending_open{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_circuit_breakers_default_rq_retry_open gauge
envoy_cluster_circuit_breakers_default_rq_retry_open{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_circuit_breakers_high_cx_open gauge
envoy_cluster_circuit_breakers_high_cx_open{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_circuit_breakers_high_cx_pool_open gauge
envoy_cluster_circuit_breakers_high_cx_pool_open{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_circuit_breakers_high_rq_open gauge
envoy_cluster_circuit_breakers_high_rq_open{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_circuit_breakers_high_rq_pending_open gauge
envoy_cluster_circuit_breakers_high_rq_pending_open{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_circuit_breakers_high_rq_retry_open gauge
envoy_cluster_circuit_breakers_high_rq_retry_open{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_http2_deferred_stream_close gauge
envoy_cluster_http2_deferred_stream_close{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_http2_outbound_control_frames_active gauge
envoy_cluster_http2_outbound_control_frames_active{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_http2_outbound_frames_active gauge
envoy_cluster_http2_outbound_frames_active{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_http2_pending_send_bytes gauge
envoy_cluster_http2_pending_send_bytes{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_http2_streams_active gauge
envoy_cluster_http2_streams_active{cluster_name="xds-grpc"} 1
# TYPE envoy_cluster_lb_subsets_active gauge
envoy_cluster_lb_subsets_active{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_max_host_weight gauge
envoy_cluster_max_host_weight{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_membership_degraded gauge
envoy_cluster_membership_degraded{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_membership_excluded gauge
envoy_cluster_membership_excluded{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_membership_healthy gauge
envoy_cluster_membership_healthy{cluster_name="xds-grpc"} 1
# TYPE envoy_cluster_membership_total gauge
envoy_cluster_membership_total{cluster_name="xds-grpc"} 1
# TYPE envoy_cluster_upstream_cx_active gauge
envoy_cluster_upstream_cx_active{cluster_name="xds-grpc"} 1
# TYPE envoy_cluster_upstream_cx_rx_bytes_buffered gauge
envoy_cluster_upstream_cx_rx_bytes_buffered{cluster_name="xds-grpc"} 17
# TYPE envoy_cluster_upstream_cx_tx_bytes_buffered gauge
envoy_cluster_upstream_cx_tx_bytes_buffered{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_upstream_rq_active gauge
envoy_cluster_upstream_rq_active{cluster_name="xds-grpc"} 1
# TYPE envoy_cluster_upstream_rq_pending_active gauge
envoy_cluster_upstream_rq_pending_active{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_version gauge
envoy_cluster_version{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_warming_state gauge
envoy_cluster_warming_state{cluster_name="xds-grpc"} 0
# TYPE envoy_cluster_manager_active_clusters gauge
envoy_cluster_manager_active_clusters{} 53
# TYPE envoy_cluster_manager_cds_update_time gauge
envoy_cluster_manager_cds_update_time{} 1714550806244
# TYPE envoy_cluster_manager_cds_version gauge
envoy_cluster_manager_cds_version{} 5252528788253848149
# TYPE envoy_cluster_manager_warming_clusters gauge
envoy_cluster_manager_warming_clusters{} 0
# TYPE istio_build gauge
istio_build{component="proxy",tag="1.21.1"} 1
# TYPE envoy_listener_manager_lds_update_time gauge
envoy_listener_manager_lds_update_time{} 1714550806261
# TYPE envoy_listener_manager_lds_version gauge
envoy_listener_manager_lds_version{} 5252528788253848149
# TYPE envoy_listener_manager_total_filter_chains_draining gauge
envoy_listener_manager_total_filter_chains_draining{} 0
# TYPE envoy_listener_manager_total_listeners_active gauge
envoy_listener_manager_total_listeners_active{} 42
# TYPE envoy_listener_manager_total_listeners_draining gauge
envoy_listener_manager_total_listeners_draining{} 0
# TYPE envoy_listener_manager_total_listeners_warming gauge
envoy_listener_manager_total_listeners_warming{} 0
# TYPE envoy_listener_manager_workers_started gauge
envoy_listener_manager_workers_started{} 1
# TYPE envoy_server_compilation_settings_fips_mode gauge
envoy_server_compilation_settings_fips_mode{} 0
# TYPE envoy_server_concurrency gauge
envoy_server_concurrency{} 1
# TYPE envoy_server_days_until_first_cert_expiring gauge
envoy_server_days_until_first_cert_expiring{} 0
# TYPE envoy_server_hot_restart_epoch gauge
envoy_server_hot_restart_epoch{} 0
# TYPE envoy_server_live gauge
envoy_server_live{} 1
# TYPE envoy_server_memory_allocated gauge
envoy_server_memory_allocated{} 13206424
# TYPE envoy_server_memory_heap_size gauge
envoy_server_memory_heap_size{} 19922944
# TYPE envoy_server_memory_physical_size gauge
envoy_server_memory_physical_size{} 22544384
# TYPE envoy_server_parent_connections gauge
envoy_server_parent_connections{} 0
# TYPE envoy_server_seconds_until_first_ocsp_response_expiring gauge
envoy_server_seconds_until_first_ocsp_response_expiring{} 0
# TYPE envoy_server_state gauge
envoy_server_state{} 0
# TYPE envoy_server_stats_recent_lookups gauge
envoy_server_stats_recent_lookups{} 28259
# TYPE envoy_server_total_connections gauge
envoy_server_total_connections{} 2
# TYPE envoy_server_uptime gauge
envoy_server_uptime{} 275100
# TYPE envoy_server_version gauge
envoy_server_version{} 4617272
# TYPE envoy_cluster_upstream_cx_connect_ms histogram
envoy_cluster_upstream_cx_connect_ms_bucket{cluster_name="xds-grpc",le="0.5"} 148
envoy_cluster_upstream_cx_connect_ms_bucket{cluster_name="xds-grpc",le="1"} 148
envoy_cluster_upstream_cx_connect_ms_bucket{cluster_name="xds-grpc",le="5"} 152
envoy_cluster_upstream_cx_connect_ms_bucket{cluster_name="xds-grpc",le="10"} 152
envoy_cluster_upstream_cx_connect_ms_bucket{cluster_name="xds-grpc",le="25"} 152
envoy_cluster_upstream_cx_connect_ms_bucket{cluster_name="xds-grpc",le="50"} 152
envoy_cluster_upstream_cx_connect_ms_bucket{cluster_name="xds-grpc",le="100"} 153
envoy_cluster_upstream_cx_connect_ms_bucket{cluster_name="xds-grpc",le="250"} 153
envoy_cluster_upstream_cx_connect_ms_bucket{cluster_name="xds-grpc",le="500"} 153
envoy_cluster_upstream_cx_connect_ms_bucket{cluster_name="xds-grpc",le="1000"} 153
envoy_cluster_upstream_cx_connect_ms_bucket{cluster_name="xds-grpc",le="2500"} 153
envoy_cluster_upstream_cx_connect_ms_bucket{cluster_name="xds-grpc",le="5000"} 153
envoy_cluster_upstream_cx_connect_ms_bucket{cluster_name="xds-grpc",le="10000"} 153
envoy_cluster_upstream_cx_connect_ms_bucket{cluster_name="xds-grpc",le="30000"} 153
envoy_cluster_upstream_cx_connect_ms_bucket{cluster_name="xds-grpc",le="60000"} 153
envoy_cluster_upstream_cx_connect_ms_bucket{cluster_name="xds-grpc",le="300000"} 153
envoy_cluster_upstream_cx_connect_ms_bucket{cluster_name="xds-grpc",le="600000"} 153
envoy_cluster_upstream_cx_connect_ms_bucket{cluster_name="xds-grpc",le="1800000"} 153
envoy_cluster_upstream_cx_connect_ms_bucket{cluster_name="xds-grpc",le="3600000"} 153
envoy_cluster_upstream_cx_connect_ms_bucket{cluster_name="xds-grpc",le="+Inf"} 153
envoy_cluster_upstream_cx_connect_ms_sum{cluster_name="xds-grpc"} 100.7000000000000028421709430404
envoy_cluster_upstream_cx_connect_ms_count{cluster_name="xds-grpc"} 153
# TYPE envoy_cluster_upstream_cx_length_ms histogram
envoy_cluster_upstream_cx_length_ms_bucket{cluster_name="xds-grpc",le="0.5"} 0
envoy_cluster_upstream_cx_length_ms_bucket{cluster_name="xds-grpc",le="1"} 0
envoy_cluster_upstream_cx_length_ms_bucket{cluster_name="xds-grpc",le="5"} 0
envoy_cluster_upstream_cx_length_ms_bucket{cluster_name="xds-grpc",le="10"} 0
envoy_cluster_upstream_cx_length_ms_bucket{cluster_name="xds-grpc",le="25"} 0
envoy_cluster_upstream_cx_length_ms_bucket{cluster_name="xds-grpc",le="50"} 0
envoy_cluster_upstream_cx_length_ms_bucket{cluster_name="xds-grpc",le="100"} 0
envoy_cluster_upstream_cx_length_ms_bucket{cluster_name="xds-grpc",le="250"} 0
envoy_cluster_upstream_cx_length_ms_bucket{cluster_name="xds-grpc",le="500"} 0
envoy_cluster_upstream_cx_length_ms_bucket{cluster_name="xds-grpc",le="1000"} 0
envoy_cluster_upstream_cx_length_ms_bucket{cluster_name="xds-grpc",le="2500"} 0
envoy_cluster_upstream_cx_length_ms_bucket{cluster_name="xds-grpc",le="5000"} 0
envoy_cluster_upstream_cx_length_ms_bucket{cluster_name="xds-grpc",le="10000"} 0
envoy_cluster_upstream_cx_length_ms_bucket{cluster_name="xds-grpc",le="30000"} 0
envoy_cluster_upstream_cx_length_ms_bucket{cluster_name="xds-grpc",le="60000"} 0
envoy_cluster_upstream_cx_length_ms_bucket{cluster_name="xds-grpc",le="300000"} 0
envoy_cluster_upstream_cx_length_ms_bucket{cluster_name="xds-grpc",le="600000"} 0
envoy_cluster_upstream_cx_length_ms_bucket{cluster_name="xds-grpc",le="1800000"} 77
envoy_cluster_upstream_cx_length_ms_bucket{cluster_name="xds-grpc",le="3600000"} 152
envoy_cluster_upstream_cx_length_ms_bucket{cluster_name="xds-grpc",le="+Inf"} 152
envoy_cluster_upstream_cx_length_ms_sum{cluster_name="xds-grpc"} 274400000
envoy_cluster_upstream_cx_length_ms_count{cluster_name="xds-grpc"} 152
# TYPE envoy_cluster_manager_cds_update_duration histogram
envoy_cluster_manager_cds_update_duration_bucket{le="0.5"} 0
envoy_cluster_manager_cds_update_duration_bucket{le="1"} 0
envoy_cluster_manager_cds_update_duration_bucket{le="5"} 0
envoy_cluster_manager_cds_update_duration_bucket{le="10"} 43
envoy_cluster_manager_cds_update_duration_bucket{le="25"} 89
envoy_cluster_manager_cds_update_duration_bucket{le="50"} 120
envoy_cluster_manager_cds_update_duration_bucket{le="100"} 159
envoy_cluster_manager_cds_update_duration_bucket{le="250"} 168
envoy_cluster_manager_cds_update_duration_bucket{le="500"} 169
envoy_cluster_manager_cds_update_duration_bucket{le="1000"} 169
envoy_cluster_manager_cds_update_duration_bucket{le="2500"} 169
envoy_cluster_manager_cds_update_duration_bucket{le="5000"} 169
envoy_cluster_manager_cds_update_duration_bucket{le="10000"} 169
envoy_cluster_manager_cds_update_duration_bucket{le="30000"} 169
envoy_cluster_manager_cds_update_duration_bucket{le="60000"} 169
envoy_cluster_manager_cds_update_duration_bucket{le="300000"} 169
envoy_cluster_manager_cds_update_duration_bucket{le="600000"} 169
envoy_cluster_manager_cds_update_duration_bucket{le="1800000"} 169
envoy_cluster_manager_cds_update_duration_bucket{le="3600000"} 169
envoy_cluster_manager_cds_update_duration_bucket{le="+Inf"} 169
envoy_cluster_manager_cds_update_duration_sum{} 6412.1499999999996362021192908287
envoy_cluster_manager_cds_update_duration_count{} 169
# TYPE istio_request_bytes histogram
istio_request_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="0.5"} 0
istio_request_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="1"} 0
istio_request_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="5"} 0
istio_request_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="10"} 0
istio_request_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="25"} 0
istio_request_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="50"} 0
istio_request_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="100"} 0
istio_request_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="250"} 0
istio_request_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="500"} 0
istio_request_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="1000"} 0
istio_request_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="2500"} 1615
istio_request_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="5000"} 1615
istio_request_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="10000"} 1615
istio_request_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="30000"} 1615
istio_request_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="60000"} 1615
istio_request_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="300000"} 1615
istio_request_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="600000"} 1615
istio_request_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="1800000"} 1615
istio_request_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="3600000"} 1615
istio_request_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="+Inf"} 1615
istio_request_bytes_sum{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls"} 2343750
istio_request_bytes_count{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls"} 1615
istio_request_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="0.5"} 0
istio_request_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="1"} 0
istio_request_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="5"} 0
istio_request_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="10"} 0
istio_request_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="25"} 0
istio_request_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="50"} 0
istio_request_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="100"} 0
istio_request_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="250"} 0
istio_request_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="500"} 0
istio_request_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="1000"} 0
istio_request_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="2500"} 11
istio_request_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="5000"} 11
istio_request_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="10000"} 11
istio_request_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="30000"} 11
istio_request_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="60000"} 11
istio_request_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="300000"} 11
istio_request_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="600000"} 11
istio_request_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="1800000"} 11
istio_request_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="3600000"} 11
istio_request_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="+Inf"} 11
istio_request_bytes_sum{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls"} 16650
istio_request_bytes_count{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls"} 11
istio_request_bytes_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="0.5"} 0
istio_request_bytes_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="1"} 0
istio_request_bytes_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="5"} 0
istio_request_bytes_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="10"} 0
istio_request_bytes_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="25"} 0
istio_request_bytes_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="50"} 0
istio_request_bytes_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="100"} 1
istio_request_bytes_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="250"} 1
istio_request_bytes_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="500"} 1
istio_request_bytes_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="1000"} 1
istio_request_bytes_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="2500"} 1
istio_request_bytes_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="5000"} 1
istio_request_bytes_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="10000"} 1
istio_request_bytes_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="30000"} 1
istio_request_bytes_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="60000"} 1
istio_request_bytes_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="300000"} 1
istio_request_bytes_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="600000"} 1
istio_request_bytes_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="1800000"} 1
istio_request_bytes_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="3600000"} 1
istio_request_bytes_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="+Inf"} 1
istio_request_bytes_sum{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown"} 74.5
istio_request_bytes_count{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown"} 1
# TYPE istio_request_duration_milliseconds histogram
istio_request_duration_milliseconds_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="0.5"} 986
istio_request_duration_milliseconds_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="1"} 986
istio_request_duration_milliseconds_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="5"} 1608
istio_request_duration_milliseconds_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="10"} 1611
istio_request_duration_milliseconds_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="25"} 1611
istio_request_duration_milliseconds_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="50"} 1613
istio_request_duration_milliseconds_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="100"} 1614
istio_request_duration_milliseconds_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="250"} 1614
istio_request_duration_milliseconds_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="500"} 1614
istio_request_duration_milliseconds_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="1000"} 1615
istio_request_duration_milliseconds_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="2500"} 1615
istio_request_duration_milliseconds_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="5000"} 1615
istio_request_duration_milliseconds_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="10000"} 1615
istio_request_duration_milliseconds_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="30000"} 1615
istio_request_duration_milliseconds_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="60000"} 1615
istio_request_duration_milliseconds_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="300000"} 1615
istio_request_duration_milliseconds_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="600000"} 1615
istio_request_duration_milliseconds_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="1800000"} 1615
istio_request_duration_milliseconds_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="3600000"} 1615
istio_request_duration_milliseconds_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="+Inf"} 1615
istio_request_duration_milliseconds_sum{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls"} 1502.75
istio_request_duration_milliseconds_count{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls"} 1615
istio_request_duration_milliseconds_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="0.5"} 4
istio_request_duration_milliseconds_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="1"} 4
istio_request_duration_milliseconds_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="5"} 10
istio_request_duration_milliseconds_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="10"} 10
istio_request_duration_milliseconds_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="25"} 10
istio_request_duration_milliseconds_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="50"} 11
istio_request_duration_milliseconds_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="100"} 11
istio_request_duration_milliseconds_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="250"} 11
istio_request_duration_milliseconds_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="500"} 11
istio_request_duration_milliseconds_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="1000"} 11
istio_request_duration_milliseconds_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="2500"} 11
istio_request_duration_milliseconds_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="5000"} 11
istio_request_duration_milliseconds_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="10000"} 11
istio_request_duration_milliseconds_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="30000"} 11
istio_request_duration_milliseconds_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="60000"} 11
istio_request_duration_milliseconds_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="300000"} 11
istio_request_duration_milliseconds_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="600000"} 11
istio_request_duration_milliseconds_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="1800000"} 11
istio_request_duration_milliseconds_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="3600000"} 11
istio_request_duration_milliseconds_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="+Inf"} 11
istio_request_duration_milliseconds_sum{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls"} 39.799999999999997157829056959599
istio_request_duration_milliseconds_count{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls"} 11
istio_request_duration_milliseconds_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="0.5"} 0
istio_request_duration_milliseconds_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="1"} 0
istio_request_duration_milliseconds_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="5"} 0
istio_request_duration_milliseconds_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="10"} 0
istio_request_duration_milliseconds_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="25"} 0
istio_request_duration_milliseconds_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="50"} 0
istio_request_duration_milliseconds_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="100"} 0
istio_request_duration_milliseconds_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="250"} 0
istio_request_duration_milliseconds_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="500"} 1
istio_request_duration_milliseconds_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="1000"} 1
istio_request_duration_milliseconds_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="2500"} 1
istio_request_duration_milliseconds_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="5000"} 1
istio_request_duration_milliseconds_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="10000"} 1
istio_request_duration_milliseconds_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="30000"} 1
istio_request_duration_milliseconds_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="60000"} 1
istio_request_duration_milliseconds_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="300000"} 1
istio_request_duration_milliseconds_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="600000"} 1
istio_request_duration_milliseconds_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="1800000"} 1
istio_request_duration_milliseconds_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="3600000"} 1
istio_request_duration_milliseconds_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="+Inf"} 1
istio_request_duration_milliseconds_sum{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown"} 335
istio_request_duration_milliseconds_count{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown"} 1
# TYPE istio_response_bytes histogram
istio_response_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="0.5"} 0
istio_response_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="1"} 0
istio_response_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="5"} 0
istio_response_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="10"} 0
istio_response_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="25"} 0
istio_response_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="50"} 0
istio_response_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="100"} 0
istio_response_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="250"} 0
istio_response_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="500"} 0
istio_response_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="1000"} 0
istio_response_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="2500"} 1253
istio_response_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="5000"} 1253
istio_response_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="10000"} 1253
istio_response_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="30000"} 1253
istio_response_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="60000"} 1253
istio_response_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="300000"} 1569
istio_response_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="600000"} 1585
istio_response_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="1800000"} 1615
istio_response_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="3600000"} 1615
istio_response_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="+Inf"} 1615
istio_response_bytes_sum{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls"} 100141550
istio_response_bytes_count{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="200",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls"} 1615
istio_response_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="0.5"} 0
istio_response_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="1"} 0
istio_response_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="5"} 0
istio_response_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="10"} 0
istio_response_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="25"} 0
istio_response_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="50"} 0
istio_response_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="100"} 0
istio_response_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="250"} 0
istio_response_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="500"} 0
istio_response_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="1000"} 0
istio_response_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="2500"} 11
istio_response_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="5000"} 11
istio_response_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="10000"} 11
istio_response_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="30000"} 11
istio_response_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="60000"} 11
istio_response_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="300000"} 11
istio_response_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="600000"} 11
istio_response_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="1800000"} 11
istio_response_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="3600000"} 11
istio_response_bytes_bucket{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls",le="+Inf"} 11
istio_response_bytes_sum{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls"} 15450
istio_response_bytes_count{reporter="destination",source_workload="default-gateway-istio",source_canonical_service="default-gateway-istio",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="spiffe://cluster.local/ns/cluster/sa/default-gateway-istio",source_app="unknown",source_version="unknown",source_cluster="Kubernetes",destination_workload="docserver",destination_workload_namespace="cluster",destination_principal="spiffe://cluster.local/ns/cluster/sa/default",destination_app="docserver",destination_version="latest",destination_service="docserver.cluster.svc.cluster.local",destination_canonical_service="docserver",destination_canonical_revision="latest",destination_service_name="docserver",destination_service_namespace="cluster",destination_cluster="Kubernetes",request_protocol="http",response_code="404",grpc_response_status="",response_flags="-",connection_security_policy="mutual_tls"} 11
istio_response_bytes_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="0.5"} 0
istio_response_bytes_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="1"} 0
istio_response_bytes_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="5"} 0
istio_response_bytes_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="10"} 0
istio_response_bytes_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="25"} 0
istio_response_bytes_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="50"} 0
istio_response_bytes_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="100"} 0
istio_response_bytes_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="250"} 0
istio_response_bytes_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="500"} 0
istio_response_bytes_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="1000"} 1
istio_response_bytes_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="2500"} 1
istio_response_bytes_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="5000"} 1
istio_response_bytes_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="10000"} 1
istio_response_bytes_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="30000"} 1
istio_response_bytes_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="60000"} 1
istio_response_bytes_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="300000"} 1
istio_response_bytes_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="600000"} 1
istio_response_bytes_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="1800000"} 1
istio_response_bytes_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="3600000"} 1
istio_response_bytes_bucket{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown",le="+Inf"} 1
istio_response_bytes_sum{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown"} 815
istio_response_bytes_count{reporter="source",source_workload="docserver",source_canonical_service="docserver",source_canonical_revision="latest",source_workload_namespace="cluster",source_principal="unknown",source_app="docserver",source_version="latest",source_cluster="Kubernetes",destination_workload="unknown",destination_workload_namespace="unknown",destination_principal="unknown",destination_app="unknown",destination_version="unknown",destination_service="google.com",destination_canonical_service="unknown",destination_canonical_revision="latest",destination_service_name="PassthroughCluster",destination_service_namespace="unknown",destination_cluster="unknown",request_protocol="http",response_code="301",grpc_response_status="",response_flags="-",connection_security_policy="unknown"} 1
# TYPE envoy_listener_manager_lds_update_duration histogram
envoy_listener_manager_lds_update_duration_bucket{le="0.5"} 0
envoy_listener_manager_lds_update_duration_bucket{le="1"} 0
envoy_listener_manager_lds_update_duration_bucket{le="5"} 0
envoy_listener_manager_lds_update_duration_bucket{le="10"} 0
envoy_listener_manager_lds_update_duration_bucket{le="25"} 46
envoy_listener_manager_lds_update_duration_bucket{le="50"} 59
envoy_listener_manager_lds_update_duration_bucket{le="100"} 116
envoy_listener_manager_lds_update_duration_bucket{le="250"} 168
envoy_listener_manager_lds_update_duration_bucket{le="500"} 169
envoy_listener_manager_lds_update_duration_bucket{le="1000"} 169
envoy_listener_manager_lds_update_duration_bucket{le="2500"} 169
envoy_listener_manager_lds_update_duration_bucket{le="5000"} 169
envoy_listener_manager_lds_update_duration_bucket{le="10000"} 169
envoy_listener_manager_lds_update_duration_bucket{le="30000"} 169
envoy_listener_manager_lds_update_duration_bucket{le="60000"} 169
envoy_listener_manager_lds_update_duration_bucket{le="300000"} 169
envoy_listener_manager_lds_update_duration_bucket{le="600000"} 169
envoy_listener_manager_lds_update_duration_bucket{le="1800000"} 169
envoy_listener_manager_lds_update_duration_bucket{le="3600000"} 169
envoy_listener_manager_lds_update_duration_bucket{le="+Inf"} 169
envoy_listener_manager_lds_update_duration_sum{} 12953
envoy_listener_manager_lds_update_duration_count{} 169
# TYPE envoy_server_initialization_time_ms histogram
envoy_server_initialization_time_ms_bucket{le="0.5"} 0
envoy_server_initialization_time_ms_bucket{le="1"} 0
envoy_server_initialization_time_ms_bucket{le="5"} 0
envoy_server_initialization_time_ms_bucket{le="10"} 0
envoy_server_initialization_time_ms_bucket{le="25"} 0
envoy_server_initialization_time_ms_bucket{le="50"} 0
envoy_server_initialization_time_ms_bucket{le="100"} 0
envoy_server_initialization_time_ms_bucket{le="250"} 0
envoy_server_initialization_time_ms_bucket{le="500"} 0
envoy_server_initialization_time_ms_bucket{le="1000"} 0
envoy_server_initialization_time_ms_bucket{le="2500"} 1
envoy_server_initialization_time_ms_bucket{le="5000"} 1
envoy_server_initialization_time_ms_bucket{le="10000"} 1
envoy_server_initialization_time_ms_bucket{le="30000"} 1
envoy_server_initialization_time_ms_bucket{le="60000"} 1
envoy_server_initialization_time_ms_bucket{le="300000"} 1
envoy_server_initialization_time_ms_bucket{le="600000"} 1
envoy_server_initialization_time_ms_bucket{le="1800000"} 1
envoy_server_initialization_time_ms_bucket{le="3600000"} 1
envoy_server_initialization_time_ms_bucket{le="+Inf"} 1
envoy_server_initialization_time_ms_sum{} 1350
envoy_server_initialization_time_ms_count{} 1

BASH

Istio Internals by port

Introduction

Motivation

Internal Architecture by Port

`istiod`

`8080`: Kubelet, Debug

`9876`: Admin

`15010`: Istio proxy (plain text)

`15012`: Istio proxy (TLS, mTLS)

`15014`: Prometheus

`15017`: Kubernetes API Server

Istio-init

Istio proxy

`15000` (Envoy): Admin

`15001` (Envoy): App container

`15004` (Envoy): Debug

`15006` (Envoy): external services

`15020` (Pilot agent)

`15021` (Envoy): Kubelet

`15053` (DNS proxy): App container

`15090` (DNS proxy): App container

Comments

블로그 검색

Istio Internals by port

Introduction

Motivation

Internal Architecture by Port

istiod

8080: Kubelet, Debug

9876: Admin

15010: Istio proxy (plain text)

15012: Istio proxy (TLS, mTLS)

15014: Prometheus

15017: Kubernetes API Server

Istio-init

Istio proxy

15000 (Envoy): Admin

15001 (Envoy): App container

15004 (Envoy): Debug

15006 (Envoy): external services

15020 (Pilot agent)

15021 (Envoy): Kubelet

15053 (DNS proxy): App container

15090 (DNS proxy): App container

Comments

`istiod`

`8080`: Kubelet, Debug

`9876`: Admin

`15010`: Istio proxy (plain text)

`15012`: Istio proxy (TLS, mTLS)

`15014`: Prometheus

`15017`: Kubernetes API Server

`15000` (Envoy): Admin

`15001` (Envoy): App container

`15004` (Envoy): Debug

`15006` (Envoy): external services

`15020` (Pilot agent)

`15021` (Envoy): Kubelet

`15053` (DNS proxy): App container

`15090` (DNS proxy): App container