| Status for GSLBLoadBalancingChannel (butterknife) |
| Started: Fri Dec 5 19:44:34 2025 -- up 3 hr 38 min 38 sec Built on Dec 5 2025 16:11:08 (1764979868) Built at rbex-enqueue-targets@oqs20.prod.google.com: Built as //cloud/ai/platform/dataplane/cardolan:vertex-genai-dataplane Build label: cloud-ml.vertex-genai-dataplane_20251205.04_p0 Built target blaze-out/k8-opt/bin/cloud/ai/platform/dataplane/cardolan/vertex-genai-dataplane Build options: fdo=XFDO Built for gcc-4.X.Y-crosstool-v18-llvm-grtev4-k8.k8 Built from changelist 840844128 with baseline 840844128 in a mint client based on //depot/google3 Task BNS: /bns/yudfwra/borg/yudfwra/bns/cloud-ml-vertex-genai-dataplane-staging-jobs/staging-qual-us.vertex-genai-dataplane/2 Ports: esf.2.staging-qual-us.vertex-genai-dataplane.cloud-ml-vertex-genai-dataplane-staging-jobs.yudfwra.borg.google.com:8126 2.staging-qual-us.vertex-genai-dataplane.cloud-ml-vertex-genai-dataplane-staging-jobs.yudfwra.borg.google.com:26015 borgenvelope.2.staging-qual-us.vertex-genai-dataplane.cloud-ml-vertex-genai-dataplane-staging-jobs.yudfwra.borg.google.com:26016 Profiling Links: censusprofilez?seconds=30 (CPU profile with go/census tags, 30 seconds): esf:8126 26015 borgenvelope:26016 censusheapz (heap usage with go/census tags): esf:8126 26015 borgenvelope:26016 peakheapz (peak heap usage): esf:8126 26015 borgenvelope:26016 deltacontentionz?seconds=10 (contention, 10 seconds): esf:8126 26015 borgenvelope:26016 threadz (thread stacks): esf:8126 26015 borgenvelope:26016 mmapz (mmap() usage): esf:8126 26015 borgenvelope:26016 contentionz (legacy contention): esf:8126 26015 borgenvelope:26016 Active RPC Experiments Stubby: stubby_default_subsetting, go/inline-psp, 1rpc, gRPC: channelz_use_v2_for_v1_api, channelz_use_v2_for_v1_service, channelz_zviz, chttp2_bound_write_size, deprecate_keep_grpc_initialized, error_flatten, event_engine_channelz_socket_info, event_engine_client, event_engine_dns, event_engine_dns_non_client_channel, event_engine_listener, event_engine_callback_cq, event_engine_secure_endpoint, google_no_envelope_resolver, graceful_external_connection_failure, lbns_support_in_address_resolver, loas2_protect_memory_optimization, max_inflight_pings_strict_limit, monitoring_experiment, namecheck_core_lib, privacy_context_single_encoding, prod2cloud_w3c_trace, rr_wrr_connect_from_random_index, tsi_frame_protector_without_locks, | Running on yudfwra-ak8.prod.google.com Platform: arcadia milan Process size: 14582MiB Memory usage: 1849MiB Load avg (1m): 32.36 View process information, endpoints View variables, flags, streamz, request logs Links: code, g3doc, continuous pprof, automon Distributed traces: view, change parameters Remote Logs: INFO WARNING ERROR STDOUT STDERR |
| Status for service blade:spanner-global-prober Automon |
| Balancer Channel : Channel Stats /mbns/local/loadbalancer/servers/butterknife-prod/balancers |
| Server | Reconnects | Pending | Method | Count | Latency (ms) | RPC Errors | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Min. | Hr. | Tot. | Min. | Hr. | Tot. | Min. | Hr. | Tot. | ||||||||||
| /mbns/local/loadbalancer/servers/butterknife-prod/balancers | 1 | 0 | * | 0 | 0 | 0 | 0 | 0 | 0 | |||||||||
| /mbns/local/loadbalancer/servers/butterknife-prod/balancers | 1 | 0 | * | 0 | 0 | 0 | 0 | 0 | 0 | |||||||||
| BalancerChannelControl.* | 0 | 0 | 0 | 0 | 0 | 0 | ||||||||||||
| /bns/yudfwra/borg/yudfwra/bns/bladeservice-prod/bladeservice_dsc.load_balancer_common/4 | 0 | 0 | BalancerChannelControl.* | 0 | 0 | 0 | 0 | 0 | 0 | |||||||||
| /bns/yudfwra/borg/yudfwra/bns/bladeservice-prod/bladeservice_dsc.load_balancer_common/2 | 0 | 0 | BalancerChannelControl.* | 0 | 0 | 0 | 0 | 0 | 0 | |||||||||
| /bns/yudfwra/borg/yudfwra/bns/bladeservice-prod/bladeservice_dsc.load_balancer_common/0 | 0 | 0 | BalancerChannelControl.* | 0 | 0 | 0 | 0 | 0 | 0 | |||||||||
| /bns/yudfwra/borg/yudfwra/bns/bladeservice-prod/bladeservice_dsc.load_balancer_common/1 | 0 | 0 | BalancerChannelControl.* | 0 | 0 | 0 | 0 | 0 | 0 | |||||||||
| /bns/yudfwra/borg/yudfwra/bns/bladeservice-prod/bladeservice_dsc.load_balancer_common/3 | 1 | 0 | BalancerChannelControl.* | 0 | 0 | 0 | 0 | 0 | 0 | |||||||||
| Primary : yudfwra : /bns/yudfwra/borg/yudfwra/bns/spanner/global.span_prober : Channel Stats /bns/yudfwra/borg/yudfwra/bns/spanner/global.span_prober |
| Server | Reconnects | Pending | Method | Count | Latency (ms) | RPC Errors | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Min. | Hr. | Tot. | Min. | Hr. | Tot. | Min. | Hr. | Tot. | ||||||||||
| /bns/yudfwra/borg/yudfwra/bns/spanner/global.span_prober | 2 | 0 | * | 0 | 0 | 0 | 0 | 0 | 0 | |||||||||
| ProberService.* | 0 | 0 | 0 | 0 | 0 | 0 | ||||||||||||
| /bns/yudfwra/borg/yudfwra/bns/spanner/global.span_prober/1 | 2 | 0 | ProberService.* | 0 | 0 | 0 | 0 | 0 | 0 | |||||||||
| Failover : lcdfwe : /bns/lcdfwe/borg/lcdfwe/bns/spanner/global.span_prober : Channel Stats /bns/lcdfwe/borg/lcdfwe/bns/spanner/global.span_prober |
| Server | Reconnects | Pending | Method | Count | Latency (ms) | RPC Errors | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Min. | Hr. | Tot. | Min. | Hr. | Tot. | Min. | Hr. | Tot. | ||||||||||
| /bns/lcdfwe/borg/lcdfwe/bns/spanner/global.span_prober | 0 | 0 | * | 0 | 0 | 0 | 0 | 0 | 0 | |||||||||
| ProberService.* | 0 | 0 | 0 | 0 | 0 | 0 | ||||||||||||
| /bns/lcdfwe/borg/lcdfwe/bns/spanner/global.span_prober/1 | 0 | 0 | ProberService.* | 0 | 0 | 0 | 0 | 0 | 0 | |||||||||
| Failover : rs : /bns/rs/borg/rs/bns/spanner/global.span_prober : Channel Stats /bns/rs/borg/rs/bns/spanner/global.span_prober |
| Server | Reconnects | Pending | Method | Count | Latency (ms) | RPC Errors | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Min. | Hr. | Tot. | Min. | Hr. | Tot. | Min. | Hr. | Tot. | ||||||||||
| /bns/rs/borg/rs/bns/spanner/global.span_prober | 0 | 0 | * | 0 | 0 | 0 | 0 | 0 | 0 | |||||||||
| ProberService.* | 0 | 0 | 0 | 0 | 0 | 0 | ||||||||||||
| /bns/rs/borg/rs/bns/spanner/global.span_prober/1 | 0 | 0 | ProberService.* | 0 | 0 | 0 | 0 | 0 | 0 | |||||||||
| Failover : rt : /bns/rt/borg/rt/bns/spanner/global.span_prober : Channel Stats /bns/rt/borg/rt/bns/spanner/global.span_prober |
| Server | Reconnects | Pending | Method | Count | Latency (ms) | RPC Errors | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Min. | Hr. | Tot. | Min. | Hr. | Tot. | Min. | Hr. | Tot. | ||||||||||
| /bns/rt/borg/rt/bns/spanner/global.span_prober | 0 | 0 | * | 0 | 0 | 0 | 0 | 0 | 0 | |||||||||
| ProberService.* | 0 | 0 | 0 | 0 | 0 | 0 | ||||||||||||
| /bns/rt/borg/rt/bns/spanner/global.span_prober/1 | 0 | 0 | ProberService.* | 0 | 0 | 0 | 0 | 0 | 0 | |||||||||
| Failover : yudfwnl : /bns/yudfwnl/borg/yudfwnl/bns/spanner/global.span_prober : Channel Stats /bns/yudfwnl/borg/yudfwnl/bns/spanner/global.span_prober |
| Server | Reconnects | Pending | Method | Count | Latency (ms) | RPC Errors | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Min. | Hr. | Tot. | Min. | Hr. | Tot. | Min. | Hr. | Tot. | ||||||||||
| /bns/yudfwnl/borg/yudfwnl/bns/spanner/global.span_prober | 0 | 0 | * | 0 | 0 | 0 | 0 | 0 | 0 | |||||||||
| ProberService.* | 0 | 0 | 0 | 0 | 0 | 0 | ||||||||||||
| /bns/yudfwnl/borg/yudfwnl/bns/spanner/global.span_prober/1 | 0 | 0 | ProberService.* | 0 | 0 | 0 | 0 | 0 | 0 | |||||||||
| Total RPCs sent through Fallback Channel: 0 : Channel Stats /mbns/local/loadbalancer/fallback/9FA/blade_spanner-global-prober |
| Server | Reconnects | Pending | Method | Count | Latency (ms) | RPC Errors | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Min. | Hr. | Tot. | Min. | Hr. | Tot. | Min. | Hr. | Tot. | ||||||||||
| /mbns/local/loadbalancer/fallback/9FA/blade_spanner-global-prober | 0 | 0 | * | 0 | 0 | 0 | 0 | 0 | 0 | |||||||||