| Settings for experiment groups V1pTopLevelRetriesConfig_Enabled_Study |
| Started: Fri Dec 5 19:44:36 2025 -- up 1 hr 24 min 04 sec Built on Dec 5 2025 16:11:08 (1764979868) Built at rbex-enqueue-targets@oqs20.prod.google.com: Built as //cloud/ai/platform/dataplane/cardolan:vertex-genai-dataplane Build label: cloud-ml.vertex-genai-dataplane_20251205.04_p0 Built target blaze-out/k8-opt/bin/cloud/ai/platform/dataplane/cardolan/vertex-genai-dataplane Build options: fdo=XFDO Built for gcc-4.X.Y-crosstool-v18-llvm-grtev4-k8.k8 Built from changelist 840844128 with baseline 840844128 in a mint client based on //depot/google3 Task BNS: /bns/yudfwra/borg/yudfwra/bns/cloud-ml-vertex-genai-dataplane-staging-jobs/staging-qual-us.vertex-genai-dataplane/1 Ports: esf.1.staging-qual-us.vertex-genai-dataplane.cloud-ml-vertex-genai-dataplane-staging-jobs.yudfwra.borg.google.com:8111 1.staging-qual-us.vertex-genai-dataplane.cloud-ml-vertex-genai-dataplane-staging-jobs.yudfwra.borg.google.com:25948 borgenvelope.1.staging-qual-us.vertex-genai-dataplane.cloud-ml-vertex-genai-dataplane-staging-jobs.yudfwra.borg.google.com:25949 Profiling Links: censusprofilez?seconds=30 (CPU profile with go/census tags, 30 seconds): esf:8111 25948 borgenvelope:25949 censusheapz (heap usage with go/census tags): esf:8111 25948 borgenvelope:25949 peakheapz (peak heap usage): esf:8111 25948 borgenvelope:25949 deltacontentionz?seconds=10 (contention, 10 seconds): esf:8111 25948 borgenvelope:25949 threadz (thread stacks): esf:8111 25948 borgenvelope:25949 mmapz (mmap() usage): esf:8111 25948 borgenvelope:25949 contentionz (legacy contention): esf:8111 25948 borgenvelope:25949 Active RPC Experiments Stubby: stubby_default_subsetting, go/inline-psp, 1rpc, gRPC: channelz_use_v2_for_v1_api, channelz_use_v2_for_v1_service, channelz_zviz, chttp2_bound_write_size, deprecate_keep_grpc_initialized, error_flatten, event_engine_channelz_socket_info, event_engine_client, event_engine_dns, event_engine_dns_non_client_channel, event_engine_listener, event_engine_callback_cq, event_engine_secure_endpoint, google_no_envelope_resolver, graceful_external_connection_failure, lbns_support_in_address_resolver, loas2_protect_memory_optimization, max_inflight_pings_strict_limit, monitoring_experiment, namecheck_core_lib, privacy_context_single_encoding, prod2cloud_w3c_trace, rr_wrr_connect_from_random_index, tsi_frame_protector_without_locks, | Running on yudfwra-ca2.prod.google.com Platform: arcadia milan Process size: 13433MiB Memory usage: 2076MiB Load avg (1m): 51.44 View process information, endpoints View variables, flags, streamz, request logs Links: code, g3doc, continuous pprof, automon Distributed traces: view, change parameters Remote Logs: INFO WARNING ERROR STDOUT STDERR |
Name: V1pTopLevelRetriesConfig_Enabled_Study::Group Experiment group: V1pTopLevelRetriesConfig_Enabled_Study Owner email: sushantsingh@google.com,tiancong@google.com,tparth@google.com,rishiag@google.com,sushantj@google.com Description: Experiment Group V1pTopLevelRetriesConfig_Enabled_Study::Group: layer-defining experiment. mendel source: http://google3/googledata/experiments/vertex_ai/dataplane_prediction_common/studies/V1pTopLevelRetriesConfig_Enabled_Study.gcl tracking_bug: b/411131238 Query proportion: 100.00% Cookie mods count: 1000 Cookie mods: [0, 1000) Experiment layer: V1pTopLevelRetriesConfigEnabledStudyLayer Define domain: V1pTopLevelRetriesConfig_Enabled_Study__Group__Domain Control experiment id: 102877830 Phase: NORMAL Diversion key: 2 Status: ACTIVE Managed traffic allocation: MENDEL_RESERVATION End date: never Condition index: 1002
Name: V1pTopLevelRetriesConfig_Enabled_Study::Control Experiment group: V1pTopLevelRetriesConfig_Enabled_Study Owner email: sushantsingh@google.com,tiancong@google.com,tparth@google.com,rishiag@google.com,sushantj@google.com Is_aggregate_experiment: true Description: Control for study mendel source: http://google3/googledata/experiments/vertex_ai/dataplane_prediction_common/studies/V1pTopLevelRetriesConfig_Enabled_Study.gcl launch_cal: NOT_REQUIRED Query proportion: 0.00% Experiment layer: V1pTopLevelRetriesConfig_Enabled_Study__Group__V1pTopLevelRetriesConfigEnabledStudyLayer Control experiment id: 102877831 Phase: NORMAL Diversion key: 2 Status: ACTIVE Managed traffic allocation: NOT_MANAGED End date: never (or end date of V1pTopLevelRetriesConfig_Enabled_Study__Group__Domain if earlier) Condition index: -1
Name: V1pTopLevelRetriesConfig_Enabled_Study::Control::DevAllowlist Experiment group: V1pTopLevelRetriesConfig_Enabled_Study Owner email: sushantsingh@google.com,tiancong@google.com,tparth@google.com,rishiag@google.com,sushantj@google.com Aggregate experiment id: 102877831 Description: Dev partition for projects allowlisted by the owner mendel source: http://google3/googledata/experiments/vertex_ai/dataplane_prediction_common/studies/V1pTopLevelRetriesConfig_Enabled_Study.gcl launch_cal: NOT_REQUIRED Query proportion: 0.00% Experiment layer: V1pTopLevelRetriesConfig_Enabled_Study__Group__V1pTopLevelRetriesConfigEnabledStudyLayer Control experiment id: 102877832 Phase: NORMAL Diversion key: 2 Status: ACTIVE Managed traffic allocation: NOT_MANAGED End date: never (or end date of V1pTopLevelRetriesConfig_Enabled_Study__Group__Domain if earlier) Condition index: 0
Name: V1pTopLevelRetriesConfig_Enabled_Study::Control::Dev Experiment group: V1pTopLevelRetriesConfig_Enabled_Study Owner email: sushantsingh@google.com,tiancong@google.com,tparth@google.com,rishiag@google.com,sushantj@google.com Aggregate experiment id: 102877831 Description: Dev partition mendel source: http://google3/googledata/experiments/vertex_ai/dataplane_prediction_common/studies/V1pTopLevelRetriesConfig_Enabled_Study.gcl launch_cal: NOT_REQUIRED Query proportion: 0.00% Experiment layer: V1pTopLevelRetriesConfig_Enabled_Study__Group__V1pTopLevelRetriesConfigEnabledStudyLayer Control experiment id: 102877833 Phase: NORMAL Diversion key: 2 Status: ACTIVE Managed traffic allocation: NOT_MANAGED End date: never (or end date of V1pTopLevelRetriesConfig_Enabled_Study__Group__Domain if earlier) Condition index: 0
Name: V1pTopLevelRetriesConfig_Enabled_Study::Control::StagingAllowlist Experiment group: V1pTopLevelRetriesConfig_Enabled_Study Owner email: sushantsingh@google.com,tiancong@google.com,tparth@google.com,rishiag@google.com,sushantj@google.com Aggregate experiment id: 102877831 Description: StagingQual partition for projects allowlisted by the owner mendel source: http://google3/googledata/experiments/vertex_ai/dataplane_prediction_common/studies/V1pTopLevelRetriesConfig_Enabled_Study.gcl launch_cal: NOT_REQUIRED Query proportion: 100.00% Cookie mods count: 1000 Cookie mods: [0, 1000) Experiment layer: V1pTopLevelRetriesConfig_Enabled_Study__Group__V1pTopLevelRetriesConfigEnabledStudyLayer Control experiment id: 102877834 Phase: NORMAL Diversion key: 2 Status: ACTIVE Managed traffic allocation: MENDEL_RESERVATION End date: never (or end date of V1pTopLevelRetriesConfig_Enabled_Study__Group__Domain if earlier) Condition index: 654
Name: V1pTopLevelRetriesConfig_Enabled_Study::Control::StagingQual Experiment group: V1pTopLevelRetriesConfig_Enabled_Study Owner email: sushantsingh@google.com,tiancong@google.com,tparth@google.com,rishiag@google.com,sushantj@google.com Aggregate experiment id: 102877831 Description: StagingQual partition mendel source: http://google3/googledata/experiments/vertex_ai/dataplane_prediction_common/studies/V1pTopLevelRetriesConfig_Enabled_Study.gcl launch_cal: NOT_REQUIRED Query proportion: 100.00% Cookie mods count: 1000 Cookie mods: [0, 1000) Experiment layer: V1pTopLevelRetriesConfig_Enabled_Study__Group__V1pTopLevelRetriesConfigEnabledStudyLayer Control experiment id: 102877835 Phase: NORMAL Diversion key: 2 Status: ACTIVE Managed traffic allocation: MENDEL_RESERVATION End date: never (or end date of V1pTopLevelRetriesConfig_Enabled_Study__Group__Domain if earlier) Condition index: 710
Name: V1pTopLevelRetriesConfig_Enabled_Study::Control::ProdWaveCanary Experiment group: V1pTopLevelRetriesConfig_Enabled_Study Owner email: sushantsingh@google.com,tiancong@google.com,tparth@google.com,rishiag@google.com,sushantj@google.com Aggregate experiment id: 102877831 Description: ProdWaveCanary partition mendel source: http://google3/googledata/experiments/vertex_ai/dataplane_prediction_common/studies/V1pTopLevelRetriesConfig_Enabled_Study.gcl launch_cal: NOT_REQUIRED Query proportion: 0.00% Experiment layer: V1pTopLevelRetriesConfig_Enabled_Study__Group__V1pTopLevelRetriesConfigEnabledStudyLayer Control experiment id: 102877836 Phase: NORMAL Diversion key: 2 Status: ACTIVE Managed traffic allocation: NOT_MANAGED End date: never (or end date of V1pTopLevelRetriesConfig_Enabled_Study__Group__Domain if earlier) Condition index: 0
Name: V1pTopLevelRetriesConfig_Enabled_Study::Control::ProdAllowlistWave0 Experiment group: V1pTopLevelRetriesConfig_Enabled_Study Owner email: sushantsingh@google.com,tiancong@google.com,tparth@google.com,rishiag@google.com,sushantj@google.com Aggregate experiment id: 102877831 Description: Prod partition for Wave0 Allowlist mendel source: http://google3/googledata/experiments/vertex_ai/dataplane_prediction_common/studies/V1pTopLevelRetriesConfig_Enabled_Study.gcl launch_cal: NOT_REQUIRED Query proportion: 0.00% Experiment layer: V1pTopLevelRetriesConfig_Enabled_Study__Group__V1pTopLevelRetriesConfigEnabledStudyLayer Control experiment id: 102877837 Phase: NORMAL Diversion key: 2 Status: ACTIVE Managed traffic allocation: NOT_MANAGED End date: never (or end date of V1pTopLevelRetriesConfig_Enabled_Study__Group__Domain if earlier) Condition index: 0
Name: V1pTopLevelRetriesConfig_Enabled_Study::Control::ProdWave0 Experiment group: V1pTopLevelRetriesConfig_Enabled_Study Owner email: sushantsingh@google.com,tiancong@google.com,tparth@google.com,rishiag@google.com,sushantj@google.com Aggregate experiment id: 102877831 Description: Prod partition for Wave0 mendel source: http://google3/googledata/experiments/vertex_ai/dataplane_prediction_common/studies/V1pTopLevelRetriesConfig_Enabled_Study.gcl launch_cal: NOT_REQUIRED Query proportion: 0.00% Experiment layer: V1pTopLevelRetriesConfig_Enabled_Study__Group__V1pTopLevelRetriesConfigEnabledStudyLayer Control experiment id: 102877838 Phase: NORMAL Diversion key: 2 Status: ACTIVE Managed traffic allocation: NOT_MANAGED End date: never (or end date of V1pTopLevelRetriesConfig_Enabled_Study__Group__Domain if earlier) Condition index: 0
Name: V1pTopLevelRetriesConfig_Enabled_Study::Control::ProdAllowlistWave1 Experiment group: V1pTopLevelRetriesConfig_Enabled_Study Owner email: sushantsingh@google.com,tiancong@google.com,tparth@google.com,rishiag@google.com,sushantj@google.com Aggregate experiment id: 102877831 Description: Prod partition for Wave1 Allowlist mendel source: http://google3/googledata/experiments/vertex_ai/dataplane_prediction_common/studies/V1pTopLevelRetriesConfig_Enabled_Study.gcl launch_cal: NOT_REQUIRED Query proportion: 0.00% Experiment layer: V1pTopLevelRetriesConfig_Enabled_Study__Group__V1pTopLevelRetriesConfigEnabledStudyLayer Control experiment id: 102877839 Phase: NORMAL Diversion key: 2 Status: ACTIVE Managed traffic allocation: NOT_MANAGED End date: never (or end date of V1pTopLevelRetriesConfig_Enabled_Study__Group__Domain if earlier) Condition index: 0
Name: V1pTopLevelRetriesConfig_Enabled_Study::Control::ProdWave1 Experiment group: V1pTopLevelRetriesConfig_Enabled_Study Owner email: sushantsingh@google.com,tiancong@google.com,tparth@google.com,rishiag@google.com,sushantj@google.com Aggregate experiment id: 102877831 Description: Prod partition for Wave1 mendel source: http://google3/googledata/experiments/vertex_ai/dataplane_prediction_common/studies/V1pTopLevelRetriesConfig_Enabled_Study.gcl launch_cal: NOT_REQUIRED Query proportion: 0.00% Experiment layer: V1pTopLevelRetriesConfig_Enabled_Study__Group__V1pTopLevelRetriesConfigEnabledStudyLayer Control experiment id: 102877840 Phase: NORMAL Diversion key: 2 Status: ACTIVE Managed traffic allocation: NOT_MANAGED End date: never (or end date of V1pTopLevelRetriesConfig_Enabled_Study__Group__Domain if earlier) Condition index: 0
Name: V1pTopLevelRetriesConfig_Enabled_Study::Control::ProdAllowlistWave2 Experiment group: V1pTopLevelRetriesConfig_Enabled_Study Owner email: sushantsingh@google.com,tiancong@google.com,tparth@google.com,rishiag@google.com,sushantj@google.com Aggregate experiment id: 102877831 Description: Prod partition for Wave2 Allowlist mendel source: http://google3/googledata/experiments/vertex_ai/dataplane_prediction_common/studies/V1pTopLevelRetriesConfig_Enabled_Study.gcl launch_cal: NOT_REQUIRED Query proportion: 0.00% Experiment layer: V1pTopLevelRetriesConfig_Enabled_Study__Group__V1pTopLevelRetriesConfigEnabledStudyLayer Control experiment id: 102877841 Phase: NORMAL Diversion key: 2 Status: ACTIVE Managed traffic allocation: NOT_MANAGED End date: never (or end date of V1pTopLevelRetriesConfig_Enabled_Study__Group__Domain if earlier) Condition index: 0
Name: V1pTopLevelRetriesConfig_Enabled_Study::Control::ProdWave2 Experiment group: V1pTopLevelRetriesConfig_Enabled_Study Owner email: sushantsingh@google.com,tiancong@google.com,tparth@google.com,rishiag@google.com,sushantj@google.com Aggregate experiment id: 102877831 Description: Prod partition for Wave2 mendel source: http://google3/googledata/experiments/vertex_ai/dataplane_prediction_common/studies/V1pTopLevelRetriesConfig_Enabled_Study.gcl launch_cal: NOT_REQUIRED Query proportion: 0.00% Experiment layer: V1pTopLevelRetriesConfig_Enabled_Study__Group__V1pTopLevelRetriesConfigEnabledStudyLayer Control experiment id: 102877842 Phase: NORMAL Diversion key: 2 Status: ACTIVE Managed traffic allocation: NOT_MANAGED End date: never (or end date of V1pTopLevelRetriesConfig_Enabled_Study__Group__Domain if earlier) Condition index: 0
Name: V1pTopLevelRetriesConfig_Enabled_Study::Control::ProdAllowlistWave3 Experiment group: V1pTopLevelRetriesConfig_Enabled_Study Owner email: sushantsingh@google.com,tiancong@google.com,tparth@google.com,rishiag@google.com,sushantj@google.com Aggregate experiment id: 102877831 Description: Prod partition for Wave3 Allowlist mendel source: http://google3/googledata/experiments/vertex_ai/dataplane_prediction_common/studies/V1pTopLevelRetriesConfig_Enabled_Study.gcl launch_cal: NOT_REQUIRED Query proportion: 0.00% Experiment layer: V1pTopLevelRetriesConfig_Enabled_Study__Group__V1pTopLevelRetriesConfigEnabledStudyLayer Control experiment id: 102877843 Phase: NORMAL Diversion key: 2 Status: ACTIVE Managed traffic allocation: NOT_MANAGED End date: never (or end date of V1pTopLevelRetriesConfig_Enabled_Study__Group__Domain if earlier) Condition index: 0
Name: V1pTopLevelRetriesConfig_Enabled_Study::Control::ProdWave3 Experiment group: V1pTopLevelRetriesConfig_Enabled_Study Owner email: sushantsingh@google.com,tiancong@google.com,tparth@google.com,rishiag@google.com,sushantj@google.com Aggregate experiment id: 102877831 Description: Prod partition for Wave3 mendel source: http://google3/googledata/experiments/vertex_ai/dataplane_prediction_common/studies/V1pTopLevelRetriesConfig_Enabled_Study.gcl launch_cal: NOT_REQUIRED Query proportion: 0.00% Experiment layer: V1pTopLevelRetriesConfig_Enabled_Study__Group__V1pTopLevelRetriesConfigEnabledStudyLayer Control experiment id: 102877844 Phase: NORMAL Diversion key: 2 Status: ACTIVE Managed traffic allocation: NOT_MANAGED End date: never (or end date of V1pTopLevelRetriesConfig_Enabled_Study__Group__Domain if earlier) Condition index: 0
Name: V1pTopLevelRetriesConfig_Enabled_Study::Control::ProdAllowlistWave4 Experiment group: V1pTopLevelRetriesConfig_Enabled_Study Owner email: sushantsingh@google.com,tiancong@google.com,tparth@google.com,rishiag@google.com,sushantj@google.com Aggregate experiment id: 102877831 Description: Prod partition for Wave4 Allowlist mendel source: http://google3/googledata/experiments/vertex_ai/dataplane_prediction_common/studies/V1pTopLevelRetriesConfig_Enabled_Study.gcl launch_cal: NOT_REQUIRED Query proportion: 0.00% Experiment layer: V1pTopLevelRetriesConfig_Enabled_Study__Group__V1pTopLevelRetriesConfigEnabledStudyLayer Control experiment id: 102877845 Phase: NORMAL Diversion key: 2 Status: ACTIVE Managed traffic allocation: NOT_MANAGED End date: never (or end date of V1pTopLevelRetriesConfig_Enabled_Study__Group__Domain if earlier) Condition index: 0
Name: V1pTopLevelRetriesConfig_Enabled_Study::Control::ProdWave4 Experiment group: V1pTopLevelRetriesConfig_Enabled_Study Owner email: sushantsingh@google.com,tiancong@google.com,tparth@google.com,rishiag@google.com,sushantj@google.com Aggregate experiment id: 102877831 Description: Prod partition for Wave4 mendel source: http://google3/googledata/experiments/vertex_ai/dataplane_prediction_common/studies/V1pTopLevelRetriesConfig_Enabled_Study.gcl launch_cal: NOT_REQUIRED Query proportion: 0.00% Experiment layer: V1pTopLevelRetriesConfig_Enabled_Study__Group__V1pTopLevelRetriesConfigEnabledStudyLayer Control experiment id: 102877846 Phase: NORMAL Diversion key: 2 Status: ACTIVE Managed traffic allocation: NOT_MANAGED End date: never (or end date of V1pTopLevelRetriesConfig_Enabled_Study__Group__Domain if earlier) Condition index: 0
Name: V1pTopLevelRetriesConfig_Enabled_Study::Control::ProdAllowlistWave5 Experiment group: V1pTopLevelRetriesConfig_Enabled_Study Owner email: sushantsingh@google.com,tiancong@google.com,tparth@google.com,rishiag@google.com,sushantj@google.com Aggregate experiment id: 102877831 Description: Prod partition for Wave5 Allowlist mendel source: http://google3/googledata/experiments/vertex_ai/dataplane_prediction_common/studies/V1pTopLevelRetriesConfig_Enabled_Study.gcl launch_cal: NOT_REQUIRED Query proportion: 0.00% Experiment layer: V1pTopLevelRetriesConfig_Enabled_Study__Group__V1pTopLevelRetriesConfigEnabledStudyLayer Control experiment id: 102877847 Phase: NORMAL Diversion key: 2 Status: ACTIVE Managed traffic allocation: NOT_MANAGED End date: never (or end date of V1pTopLevelRetriesConfig_Enabled_Study__Group__Domain if earlier) Condition index: 0
Name: V1pTopLevelRetriesConfig_Enabled_Study::Control::ProdWave5 Experiment group: V1pTopLevelRetriesConfig_Enabled_Study Owner email: sushantsingh@google.com,tiancong@google.com,tparth@google.com,rishiag@google.com,sushantj@google.com Aggregate experiment id: 102877831 Description: Prod partition for Wave5 mendel source: http://google3/googledata/experiments/vertex_ai/dataplane_prediction_common/studies/V1pTopLevelRetriesConfig_Enabled_Study.gcl launch_cal: NOT_REQUIRED Query proportion: 0.00% Experiment layer: V1pTopLevelRetriesConfig_Enabled_Study__Group__V1pTopLevelRetriesConfigEnabledStudyLayer Control experiment id: 102877848 Phase: NORMAL Diversion key: 2 Status: ACTIVE Managed traffic allocation: NOT_MANAGED End date: never (or end date of V1pTopLevelRetriesConfig_Enabled_Study__Group__Domain if earlier) Condition index: 0
Name: V1pTopLevelRetriesConfig_Enabled_Study::Control::ProdAllowlistGlobal Experiment group: V1pTopLevelRetriesConfig_Enabled_Study Owner email: sushantsingh@google.com,tiancong@google.com,tparth@google.com,rishiag@google.com,sushantj@google.com Aggregate experiment id: 102877831 Description: Prod partition for WaveGlobal Allowlist mendel source: http://google3/googledata/experiments/vertex_ai/dataplane_prediction_common/studies/V1pTopLevelRetriesConfig_Enabled_Study.gcl launch_cal: NOT_REQUIRED Query proportion: 0.00% Experiment layer: V1pTopLevelRetriesConfig_Enabled_Study__Group__V1pTopLevelRetriesConfigEnabledStudyLayer Control experiment id: 102877849 Phase: NORMAL Diversion key: 2 Status: ACTIVE Managed traffic allocation: NOT_MANAGED End date: never (or end date of V1pTopLevelRetriesConfig_Enabled_Study__Group__Domain if earlier) Condition index: 0
Name: V1pTopLevelRetriesConfig_Enabled_Study::Control::ProdWaveGlobal Experiment group: V1pTopLevelRetriesConfig_Enabled_Study Owner email: sushantsingh@google.com,tiancong@google.com,tparth@google.com,rishiag@google.com,sushantj@google.com Aggregate experiment id: 102877831 Description: Prod partition for WaveGlobal mendel source: http://google3/googledata/experiments/vertex_ai/dataplane_prediction_common/studies/V1pTopLevelRetriesConfig_Enabled_Study.gcl launch_cal: NOT_REQUIRED Query proportion: 0.00% Experiment layer: V1pTopLevelRetriesConfig_Enabled_Study__Group__V1pTopLevelRetriesConfigEnabledStudyLayer Control experiment id: 102877850 Phase: NORMAL Diversion key: 2 Status: ACTIVE Managed traffic allocation: NOT_MANAGED End date: never (or end date of V1pTopLevelRetriesConfig_Enabled_Study__Group__Domain if earlier) Condition index: 0
Name: V1pTopLevelRetriesConfig_Enabled_Study::Control::FakeDenylists Experiment group: V1pTopLevelRetriesConfig_Enabled_Study Owner email: sushantsingh@google.com,tiancong@google.com,tparth@google.com,rishiag@google.com,sushantj@google.com Aggregate experiment id: 102877831 Description: Partition for denylists to make the compiler happy. DO NOT USE. mendel source: http://google3/googledata/experiments/vertex_ai/dataplane_prediction_common/studies/V1pTopLevelRetriesConfig_Enabled_Study.gcl launch_cal: NOT_REQUIRED Query proportion: 0.00% Experiment layer: V1pTopLevelRetriesConfig_Enabled_Study__Group__V1pTopLevelRetriesConfigEnabledStudyLayer Control experiment id: 102877851 Phase: NORMAL Diversion key: 2 Status: ACTIVE Managed traffic allocation: NOT_MANAGED End date: never (or end date of V1pTopLevelRetriesConfig_Enabled_Study__Group__Domain if earlier) Condition index: 0
Name: V1pTopLevelRetriesConfig_Enabled_Study::Experiment1 Experiment group: V1pTopLevelRetriesConfig_Enabled_Study Owner email: sushantsingh@google.com,tiancong@google.com,tparth@google.com,rishiag@google.com,sushantj@google.com Is_aggregate_experiment: true Description: Experiment1 for study. mendel source: http://google3/googledata/experiments/vertex_ai/dataplane_prediction_common/studies/V1pTopLevelRetriesConfig_Enabled_Study.gcl launch_cal: NOT_REQUIRED Query proportion: 0.00% Experiment layer: V1pTopLevelRetriesConfig_Enabled_Study__Group__V1pTopLevelRetriesConfigEnabledStudyLayer Control experiment id: 102877852 Phase: NORMAL Diversion key: 2 Status: ACTIVE Managed traffic allocation: NOT_MANAGED End date: never (or end date of V1pTopLevelRetriesConfig_Enabled_Study__Group__Domain if earlier) Condition index: -1
V1pTopLevelRetriesConfig__enabled: 'name: "V1pTopLevelRetriesConfig__enabled"
type: BOOL
base_value: "TRUE"
id: 0
'
V1pTopLevelRetriesConfig__retries_config: 'name: "V1pTopLevelRetriesConfig__retries_config"
type: PROTO_BINARY_BASE64
sub_type: "cloud_ai_platform_dataplane_prediction_proto.CardolanRetriesConfig"
base_value: "config_id: \"retries_config_experiment_1\"\nmodel_ids: \"gemini-[2-5].*\"\nrequest_types: \"dedicated-critical_plus\"\nrequest_types: \"shared-critical\"\nrequest_types: \"shared-sheddable_plus\"\nerror_codes: RESOURCE_EXHAUSTED\nerror_codes: UNAVAILABLE\nerror_codes: INTERNAL\nretry_strategy {\n min_delay {\n seconds: 5\n }\n max_delay {\n seconds: 15\n }\n max_retries: 2\n request_deadline_fraction: 1\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE\n threshold: 0.2\n threshold_duration {\n seconds: 300\n }\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE_LONG_CONTEXT\n threshold: 0.05\n threshold_duration {\n seconds: 300\n }\n}\nretry_threshold_fallback_behavior: RETRY_THRESHOLD_FALLBACK_BEHAVIOR_CLOSE\n"
modifier {
value_operator: OVERRIDE
base_value: "config_id: \"retries_config_experiment_1\"\nmodel_ids: \"gemini-[2-5].*\"\nrequest_types: \"dedicated-critical_plus\"\nrequest_types: \"shared-critical\"\nrequest_types: \"shared-sheddable_plus\"\nerror_codes: RESOURCE_EXHAUSTED\nerror_codes: UNAVAILABLE\nerror_codes: INTERNAL\nretry_strategy {\n min_delay {\n seconds: 5\n }\n max_delay {\n seconds: 15\n }\n max_retries: 2\n request_deadline_fraction: 1\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE\n threshold: 0.2\n threshold_duration {\n seconds: 300\n }\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE_LONG_CONTEXT\n threshold: 0.05\n threshold_duration {\n seconds: 300\n }\n}\nretry_threshold_fallback_behavior: RETRY_THRESHOLD_FALLBACK_BEHAVIOR_CLOSE\nrequest_source: REQUEST_SOURCE_FLEX_API\n"
condition_group {
}
condition_index: 374
}
id: 0
'
Name: V1pTopLevelRetriesConfig_Enabled_Study::Experiment1::DevAllowlist Experiment group: V1pTopLevelRetriesConfig_Enabled_Study Owner email: sushantsingh@google.com,tiancong@google.com,tparth@google.com,rishiag@google.com,sushantj@google.com Aggregate experiment id: 102877852 Description: Dev partition for projects allowlisted by the owner mendel source: http://google3/googledata/experiments/vertex_ai/dataplane_prediction_common/studies/V1pTopLevelRetriesConfig_Enabled_Study.gcl launch_cal: NOT_REQUIRED Query proportion: 0.00% Experiment layer: V1pTopLevelRetriesConfig_Enabled_Study__Group__V1pTopLevelRetriesConfigEnabledStudyLayer Control experiment id: 102877853 Phase: NORMAL Diversion key: 2 Status: ACTIVE Managed traffic allocation: NOT_MANAGED End date: never (or end date of V1pTopLevelRetriesConfig_Enabled_Study__Group__Domain if earlier) Condition index: 0
V1pTopLevelRetriesConfig__enabled: 'name: "V1pTopLevelRetriesConfig__enabled"
type: BOOL
base_value: "TRUE"
id: 0
'
V1pTopLevelRetriesConfig__retries_config: 'name: "V1pTopLevelRetriesConfig__retries_config"
type: PROTO_BINARY_BASE64
sub_type: "cloud_ai_platform_dataplane_prediction_proto.CardolanRetriesConfig"
base_value: "config_id: \"retries_config_experiment_1\"\nmodel_ids: \"gemini-[2-5].*\"\nrequest_types: \"dedicated-critical_plus\"\nrequest_types: \"shared-critical\"\nrequest_types: \"shared-sheddable_plus\"\nerror_codes: RESOURCE_EXHAUSTED\nerror_codes: UNAVAILABLE\nerror_codes: INTERNAL\nretry_strategy {\n min_delay {\n seconds: 5\n }\n max_delay {\n seconds: 15\n }\n max_retries: 2\n request_deadline_fraction: 1\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE\n threshold: 0.2\n threshold_duration {\n seconds: 300\n }\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE_LONG_CONTEXT\n threshold: 0.05\n threshold_duration {\n seconds: 300\n }\n}\nretry_threshold_fallback_behavior: RETRY_THRESHOLD_FALLBACK_BEHAVIOR_CLOSE\n"
modifier {
value_operator: OVERRIDE
base_value: "config_id: \"retries_config_experiment_1\"\nmodel_ids: \"gemini-[2-5].*\"\nrequest_types: \"dedicated-critical_plus\"\nrequest_types: \"shared-critical\"\nrequest_types: \"shared-sheddable_plus\"\nerror_codes: RESOURCE_EXHAUSTED\nerror_codes: UNAVAILABLE\nerror_codes: INTERNAL\nretry_strategy {\n min_delay {\n seconds: 5\n }\n max_delay {\n seconds: 15\n }\n max_retries: 2\n request_deadline_fraction: 1\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE\n threshold: 0.2\n threshold_duration {\n seconds: 300\n }\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE_LONG_CONTEXT\n threshold: 0.05\n threshold_duration {\n seconds: 300\n }\n}\nretry_threshold_fallback_behavior: RETRY_THRESHOLD_FALLBACK_BEHAVIOR_CLOSE\nrequest_source: REQUEST_SOURCE_FLEX_API\n"
condition_group {
}
condition_index: 374
}
id: 0
'
Name: V1pTopLevelRetriesConfig_Enabled_Study::Experiment1::Dev Experiment group: V1pTopLevelRetriesConfig_Enabled_Study Owner email: sushantsingh@google.com,tiancong@google.com,tparth@google.com,rishiag@google.com,sushantj@google.com Aggregate experiment id: 102877852 Description: Dev partition mendel source: http://google3/googledata/experiments/vertex_ai/dataplane_prediction_common/studies/V1pTopLevelRetriesConfig_Enabled_Study.gcl launch_cal: NOT_REQUIRED Query proportion: 0.00% Experiment layer: V1pTopLevelRetriesConfig_Enabled_Study__Group__V1pTopLevelRetriesConfigEnabledStudyLayer Control experiment id: 102877854 Phase: NORMAL Diversion key: 2 Status: ACTIVE Managed traffic allocation: NOT_MANAGED End date: never (or end date of V1pTopLevelRetriesConfig_Enabled_Study__Group__Domain if earlier) Condition index: 0
V1pTopLevelRetriesConfig__enabled: 'name: "V1pTopLevelRetriesConfig__enabled"
type: BOOL
base_value: "TRUE"
id: 0
'
V1pTopLevelRetriesConfig__retries_config: 'name: "V1pTopLevelRetriesConfig__retries_config"
type: PROTO_BINARY_BASE64
sub_type: "cloud_ai_platform_dataplane_prediction_proto.CardolanRetriesConfig"
base_value: "config_id: \"retries_config_experiment_1\"\nmodel_ids: \"gemini-[2-5].*\"\nrequest_types: \"dedicated-critical_plus\"\nrequest_types: \"shared-critical\"\nrequest_types: \"shared-sheddable_plus\"\nerror_codes: RESOURCE_EXHAUSTED\nerror_codes: UNAVAILABLE\nerror_codes: INTERNAL\nretry_strategy {\n min_delay {\n seconds: 5\n }\n max_delay {\n seconds: 15\n }\n max_retries: 2\n request_deadline_fraction: 1\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE\n threshold: 0.2\n threshold_duration {\n seconds: 300\n }\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE_LONG_CONTEXT\n threshold: 0.05\n threshold_duration {\n seconds: 300\n }\n}\nretry_threshold_fallback_behavior: RETRY_THRESHOLD_FALLBACK_BEHAVIOR_CLOSE\n"
modifier {
value_operator: OVERRIDE
base_value: "config_id: \"retries_config_experiment_1\"\nmodel_ids: \"gemini-[2-5].*\"\nrequest_types: \"dedicated-critical_plus\"\nrequest_types: \"shared-critical\"\nrequest_types: \"shared-sheddable_plus\"\nerror_codes: RESOURCE_EXHAUSTED\nerror_codes: UNAVAILABLE\nerror_codes: INTERNAL\nretry_strategy {\n min_delay {\n seconds: 5\n }\n max_delay {\n seconds: 15\n }\n max_retries: 2\n request_deadline_fraction: 1\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE\n threshold: 0.2\n threshold_duration {\n seconds: 300\n }\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE_LONG_CONTEXT\n threshold: 0.05\n threshold_duration {\n seconds: 300\n }\n}\nretry_threshold_fallback_behavior: RETRY_THRESHOLD_FALLBACK_BEHAVIOR_CLOSE\nrequest_source: REQUEST_SOURCE_FLEX_API\n"
condition_group {
}
condition_index: 374
}
id: 0
'
Name: V1pTopLevelRetriesConfig_Enabled_Study::Experiment1::StagingAllowlist Experiment group: V1pTopLevelRetriesConfig_Enabled_Study Owner email: sushantsingh@google.com,tiancong@google.com,tparth@google.com,rishiag@google.com,sushantj@google.com Aggregate experiment id: 102877852 Description: StagingQual partition for projects allowlisted by the owner mendel source: http://google3/googledata/experiments/vertex_ai/dataplane_prediction_common/studies/V1pTopLevelRetriesConfig_Enabled_Study.gcl launch_cal: NOT_REQUIRED Query proportion: 100.00% Cookie mods count: 1000 Cookie mods: [1000, 2000) Experiment layer: V1pTopLevelRetriesConfig_Enabled_Study__Group__V1pTopLevelRetriesConfigEnabledStudyLayer Control experiment id: 102877855 Phase: NORMAL Diversion key: 2 Status: ACTIVE Managed traffic allocation: MENDEL_RESERVATION End date: never (or end date of V1pTopLevelRetriesConfig_Enabled_Study__Group__Domain if earlier) Condition index: 654
V1pTopLevelRetriesConfig__enabled: 'name: "V1pTopLevelRetriesConfig__enabled"
type: BOOL
base_value: "TRUE"
id: 0
'
V1pTopLevelRetriesConfig__retries_config: 'name: "V1pTopLevelRetriesConfig__retries_config"
type: PROTO_BINARY_BASE64
sub_type: "cloud_ai_platform_dataplane_prediction_proto.CardolanRetriesConfig"
base_value: "config_id: \"retries_config_experiment_1\"\nmodel_ids: \"gemini-[2-5].*\"\nrequest_types: \"dedicated-critical_plus\"\nrequest_types: \"shared-critical\"\nrequest_types: \"shared-sheddable_plus\"\nerror_codes: RESOURCE_EXHAUSTED\nerror_codes: UNAVAILABLE\nerror_codes: INTERNAL\nretry_strategy {\n min_delay {\n seconds: 5\n }\n max_delay {\n seconds: 15\n }\n max_retries: 2\n request_deadline_fraction: 1\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE\n threshold: 0.2\n threshold_duration {\n seconds: 300\n }\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE_LONG_CONTEXT\n threshold: 0.05\n threshold_duration {\n seconds: 300\n }\n}\nretry_threshold_fallback_behavior: RETRY_THRESHOLD_FALLBACK_BEHAVIOR_CLOSE\n"
modifier {
value_operator: OVERRIDE
base_value: "config_id: \"retries_config_experiment_1\"\nmodel_ids: \"gemini-[2-5].*\"\nrequest_types: \"dedicated-critical_plus\"\nrequest_types: \"shared-critical\"\nrequest_types: \"shared-sheddable_plus\"\nerror_codes: RESOURCE_EXHAUSTED\nerror_codes: UNAVAILABLE\nerror_codes: INTERNAL\nretry_strategy {\n min_delay {\n seconds: 5\n }\n max_delay {\n seconds: 15\n }\n max_retries: 2\n request_deadline_fraction: 1\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE\n threshold: 0.2\n threshold_duration {\n seconds: 300\n }\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE_LONG_CONTEXT\n threshold: 0.05\n threshold_duration {\n seconds: 300\n }\n}\nretry_threshold_fallback_behavior: RETRY_THRESHOLD_FALLBACK_BEHAVIOR_CLOSE\nrequest_source: REQUEST_SOURCE_FLEX_API\n"
condition_group {
}
condition_index: 374
}
id: 0
'
Name: V1pTopLevelRetriesConfig_Enabled_Study::Experiment1::StagingQual Experiment group: V1pTopLevelRetriesConfig_Enabled_Study Owner email: sushantsingh@google.com,tiancong@google.com,tparth@google.com,rishiag@google.com,sushantj@google.com Aggregate experiment id: 102877852 Description: StagingQual partition mendel source: http://google3/googledata/experiments/vertex_ai/dataplane_prediction_common/studies/V1pTopLevelRetriesConfig_Enabled_Study.gcl launch_cal: NOT_REQUIRED Query proportion: 100.00% Cookie mods count: 1000 Cookie mods: [1000, 2000) Experiment layer: V1pTopLevelRetriesConfig_Enabled_Study__Group__V1pTopLevelRetriesConfigEnabledStudyLayer Control experiment id: 102877856 Phase: NORMAL Diversion key: 2 Status: ACTIVE Managed traffic allocation: MENDEL_RESERVATION End date: never (or end date of V1pTopLevelRetriesConfig_Enabled_Study__Group__Domain if earlier) Condition index: 710
V1pTopLevelRetriesConfig__enabled: 'name: "V1pTopLevelRetriesConfig__enabled"
type: BOOL
base_value: "TRUE"
id: 0
'
V1pTopLevelRetriesConfig__retries_config: 'name: "V1pTopLevelRetriesConfig__retries_config"
type: PROTO_BINARY_BASE64
sub_type: "cloud_ai_platform_dataplane_prediction_proto.CardolanRetriesConfig"
base_value: "config_id: \"retries_config_experiment_1\"\nmodel_ids: \"gemini-[2-5].*\"\nrequest_types: \"dedicated-critical_plus\"\nrequest_types: \"shared-critical\"\nrequest_types: \"shared-sheddable_plus\"\nerror_codes: RESOURCE_EXHAUSTED\nerror_codes: UNAVAILABLE\nerror_codes: INTERNAL\nretry_strategy {\n min_delay {\n seconds: 5\n }\n max_delay {\n seconds: 15\n }\n max_retries: 2\n request_deadline_fraction: 1\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE\n threshold: 0.2\n threshold_duration {\n seconds: 300\n }\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE_LONG_CONTEXT\n threshold: 0.05\n threshold_duration {\n seconds: 300\n }\n}\nretry_threshold_fallback_behavior: RETRY_THRESHOLD_FALLBACK_BEHAVIOR_CLOSE\n"
modifier {
value_operator: OVERRIDE
base_value: "config_id: \"retries_config_experiment_1\"\nmodel_ids: \"gemini-[2-5].*\"\nrequest_types: \"dedicated-critical_plus\"\nrequest_types: \"shared-critical\"\nrequest_types: \"shared-sheddable_plus\"\nerror_codes: RESOURCE_EXHAUSTED\nerror_codes: UNAVAILABLE\nerror_codes: INTERNAL\nretry_strategy {\n min_delay {\n seconds: 5\n }\n max_delay {\n seconds: 15\n }\n max_retries: 2\n request_deadline_fraction: 1\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE\n threshold: 0.2\n threshold_duration {\n seconds: 300\n }\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE_LONG_CONTEXT\n threshold: 0.05\n threshold_duration {\n seconds: 300\n }\n}\nretry_threshold_fallback_behavior: RETRY_THRESHOLD_FALLBACK_BEHAVIOR_CLOSE\nrequest_source: REQUEST_SOURCE_FLEX_API\n"
condition_group {
}
condition_index: 374
}
id: 0
'
Name: V1pTopLevelRetriesConfig_Enabled_Study::Experiment1::ProdWaveCanary Experiment group: V1pTopLevelRetriesConfig_Enabled_Study Owner email: sushantsingh@google.com,tiancong@google.com,tparth@google.com,rishiag@google.com,sushantj@google.com Aggregate experiment id: 102877852 Description: ProdWaveCanary partition mendel source: http://google3/googledata/experiments/vertex_ai/dataplane_prediction_common/studies/V1pTopLevelRetriesConfig_Enabled_Study.gcl launch_cal: NOT_REQUIRED Query proportion: 0.00% Experiment layer: V1pTopLevelRetriesConfig_Enabled_Study__Group__V1pTopLevelRetriesConfigEnabledStudyLayer Control experiment id: 102877857 Phase: NORMAL Diversion key: 2 Status: ACTIVE Managed traffic allocation: NOT_MANAGED End date: never (or end date of V1pTopLevelRetriesConfig_Enabled_Study__Group__Domain if earlier) Condition index: 0
V1pTopLevelRetriesConfig__enabled: 'name: "V1pTopLevelRetriesConfig__enabled"
type: BOOL
base_value: "TRUE"
id: 0
'
V1pTopLevelRetriesConfig__retries_config: 'name: "V1pTopLevelRetriesConfig__retries_config"
type: PROTO_BINARY_BASE64
sub_type: "cloud_ai_platform_dataplane_prediction_proto.CardolanRetriesConfig"
base_value: "config_id: \"retries_config_experiment_1\"\nmodel_ids: \"gemini-[2-5].*\"\nrequest_types: \"dedicated-critical_plus\"\nrequest_types: \"shared-critical\"\nrequest_types: \"shared-sheddable_plus\"\nerror_codes: RESOURCE_EXHAUSTED\nerror_codes: UNAVAILABLE\nerror_codes: INTERNAL\nretry_strategy {\n min_delay {\n seconds: 5\n }\n max_delay {\n seconds: 15\n }\n max_retries: 2\n request_deadline_fraction: 1\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE\n threshold: 0.2\n threshold_duration {\n seconds: 300\n }\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE_LONG_CONTEXT\n threshold: 0.05\n threshold_duration {\n seconds: 300\n }\n}\nretry_threshold_fallback_behavior: RETRY_THRESHOLD_FALLBACK_BEHAVIOR_CLOSE\n"
modifier {
value_operator: OVERRIDE
base_value: "config_id: \"retries_config_experiment_1\"\nmodel_ids: \"gemini-[2-5].*\"\nrequest_types: \"dedicated-critical_plus\"\nrequest_types: \"shared-critical\"\nrequest_types: \"shared-sheddable_plus\"\nerror_codes: RESOURCE_EXHAUSTED\nerror_codes: UNAVAILABLE\nerror_codes: INTERNAL\nretry_strategy {\n min_delay {\n seconds: 5\n }\n max_delay {\n seconds: 15\n }\n max_retries: 2\n request_deadline_fraction: 1\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE\n threshold: 0.2\n threshold_duration {\n seconds: 300\n }\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE_LONG_CONTEXT\n threshold: 0.05\n threshold_duration {\n seconds: 300\n }\n}\nretry_threshold_fallback_behavior: RETRY_THRESHOLD_FALLBACK_BEHAVIOR_CLOSE\nrequest_source: REQUEST_SOURCE_FLEX_API\n"
condition_group {
}
condition_index: 374
}
id: 0
'
Name: V1pTopLevelRetriesConfig_Enabled_Study::Experiment1::ProdAllowlistWave0 Experiment group: V1pTopLevelRetriesConfig_Enabled_Study Owner email: sushantsingh@google.com,tiancong@google.com,tparth@google.com,rishiag@google.com,sushantj@google.com Aggregate experiment id: 102877852 Description: Prod partition for Wave0 Allowlist mendel source: http://google3/googledata/experiments/vertex_ai/dataplane_prediction_common/studies/V1pTopLevelRetriesConfig_Enabled_Study.gcl launch_cal: NOT_REQUIRED Query proportion: 0.00% Experiment layer: V1pTopLevelRetriesConfig_Enabled_Study__Group__V1pTopLevelRetriesConfigEnabledStudyLayer Control experiment id: 102877858 Phase: NORMAL Diversion key: 2 Status: ACTIVE Managed traffic allocation: NOT_MANAGED End date: never (or end date of V1pTopLevelRetriesConfig_Enabled_Study__Group__Domain if earlier) Condition index: 0
V1pTopLevelRetriesConfig__enabled: 'name: "V1pTopLevelRetriesConfig__enabled"
type: BOOL
base_value: "TRUE"
id: 0
'
V1pTopLevelRetriesConfig__retries_config: 'name: "V1pTopLevelRetriesConfig__retries_config"
type: PROTO_BINARY_BASE64
sub_type: "cloud_ai_platform_dataplane_prediction_proto.CardolanRetriesConfig"
base_value: "config_id: \"retries_config_experiment_1\"\nmodel_ids: \"gemini-[2-5].*\"\nrequest_types: \"dedicated-critical_plus\"\nrequest_types: \"shared-critical\"\nrequest_types: \"shared-sheddable_plus\"\nerror_codes: RESOURCE_EXHAUSTED\nerror_codes: UNAVAILABLE\nerror_codes: INTERNAL\nretry_strategy {\n min_delay {\n seconds: 5\n }\n max_delay {\n seconds: 15\n }\n max_retries: 2\n request_deadline_fraction: 1\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE\n threshold: 0.2\n threshold_duration {\n seconds: 300\n }\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE_LONG_CONTEXT\n threshold: 0.05\n threshold_duration {\n seconds: 300\n }\n}\nretry_threshold_fallback_behavior: RETRY_THRESHOLD_FALLBACK_BEHAVIOR_CLOSE\n"
modifier {
value_operator: OVERRIDE
base_value: "config_id: \"retries_config_experiment_1\"\nmodel_ids: \"gemini-[2-5].*\"\nrequest_types: \"dedicated-critical_plus\"\nrequest_types: \"shared-critical\"\nrequest_types: \"shared-sheddable_plus\"\nerror_codes: RESOURCE_EXHAUSTED\nerror_codes: UNAVAILABLE\nerror_codes: INTERNAL\nretry_strategy {\n min_delay {\n seconds: 5\n }\n max_delay {\n seconds: 15\n }\n max_retries: 2\n request_deadline_fraction: 1\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE\n threshold: 0.2\n threshold_duration {\n seconds: 300\n }\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE_LONG_CONTEXT\n threshold: 0.05\n threshold_duration {\n seconds: 300\n }\n}\nretry_threshold_fallback_behavior: RETRY_THRESHOLD_FALLBACK_BEHAVIOR_CLOSE\nrequest_source: REQUEST_SOURCE_FLEX_API\n"
condition_group {
}
condition_index: 374
}
id: 0
'
Name: V1pTopLevelRetriesConfig_Enabled_Study::Experiment1::ProdWave0 Experiment group: V1pTopLevelRetriesConfig_Enabled_Study Owner email: sushantsingh@google.com,tiancong@google.com,tparth@google.com,rishiag@google.com,sushantj@google.com Aggregate experiment id: 102877852 Description: Prod partition for Wave0 mendel source: http://google3/googledata/experiments/vertex_ai/dataplane_prediction_common/studies/V1pTopLevelRetriesConfig_Enabled_Study.gcl launch_cal: NOT_REQUIRED Query proportion: 0.00% Experiment layer: V1pTopLevelRetriesConfig_Enabled_Study__Group__V1pTopLevelRetriesConfigEnabledStudyLayer Control experiment id: 102877859 Phase: NORMAL Diversion key: 2 Status: ACTIVE Managed traffic allocation: NOT_MANAGED End date: never (or end date of V1pTopLevelRetriesConfig_Enabled_Study__Group__Domain if earlier) Condition index: 0
V1pTopLevelRetriesConfig__enabled: 'name: "V1pTopLevelRetriesConfig__enabled"
type: BOOL
base_value: "TRUE"
id: 0
'
V1pTopLevelRetriesConfig__retries_config: 'name: "V1pTopLevelRetriesConfig__retries_config"
type: PROTO_BINARY_BASE64
sub_type: "cloud_ai_platform_dataplane_prediction_proto.CardolanRetriesConfig"
base_value: "config_id: \"retries_config_experiment_1\"\nmodel_ids: \"gemini-[2-5].*\"\nrequest_types: \"dedicated-critical_plus\"\nrequest_types: \"shared-critical\"\nrequest_types: \"shared-sheddable_plus\"\nerror_codes: RESOURCE_EXHAUSTED\nerror_codes: UNAVAILABLE\nerror_codes: INTERNAL\nretry_strategy {\n min_delay {\n seconds: 5\n }\n max_delay {\n seconds: 15\n }\n max_retries: 2\n request_deadline_fraction: 1\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE\n threshold: 0.2\n threshold_duration {\n seconds: 300\n }\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE_LONG_CONTEXT\n threshold: 0.05\n threshold_duration {\n seconds: 300\n }\n}\nretry_threshold_fallback_behavior: RETRY_THRESHOLD_FALLBACK_BEHAVIOR_CLOSE\n"
modifier {
value_operator: OVERRIDE
base_value: "config_id: \"retries_config_experiment_1\"\nmodel_ids: \"gemini-[2-5].*\"\nrequest_types: \"dedicated-critical_plus\"\nrequest_types: \"shared-critical\"\nrequest_types: \"shared-sheddable_plus\"\nerror_codes: RESOURCE_EXHAUSTED\nerror_codes: UNAVAILABLE\nerror_codes: INTERNAL\nretry_strategy {\n min_delay {\n seconds: 5\n }\n max_delay {\n seconds: 15\n }\n max_retries: 2\n request_deadline_fraction: 1\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE\n threshold: 0.2\n threshold_duration {\n seconds: 300\n }\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE_LONG_CONTEXT\n threshold: 0.05\n threshold_duration {\n seconds: 300\n }\n}\nretry_threshold_fallback_behavior: RETRY_THRESHOLD_FALLBACK_BEHAVIOR_CLOSE\nrequest_source: REQUEST_SOURCE_FLEX_API\n"
condition_group {
}
condition_index: 374
}
id: 0
'
Name: V1pTopLevelRetriesConfig_Enabled_Study::Experiment1::ProdAllowlistWave1 Experiment group: V1pTopLevelRetriesConfig_Enabled_Study Owner email: sushantsingh@google.com,tiancong@google.com,tparth@google.com,rishiag@google.com,sushantj@google.com Aggregate experiment id: 102877852 Description: Prod partition for Wave1 Allowlist mendel source: http://google3/googledata/experiments/vertex_ai/dataplane_prediction_common/studies/V1pTopLevelRetriesConfig_Enabled_Study.gcl launch_cal: NOT_REQUIRED Query proportion: 0.00% Experiment layer: V1pTopLevelRetriesConfig_Enabled_Study__Group__V1pTopLevelRetriesConfigEnabledStudyLayer Control experiment id: 102877860 Phase: NORMAL Diversion key: 2 Status: ACTIVE Managed traffic allocation: NOT_MANAGED End date: never (or end date of V1pTopLevelRetriesConfig_Enabled_Study__Group__Domain if earlier) Condition index: 0
V1pTopLevelRetriesConfig__enabled: 'name: "V1pTopLevelRetriesConfig__enabled"
type: BOOL
base_value: "TRUE"
id: 0
'
V1pTopLevelRetriesConfig__retries_config: 'name: "V1pTopLevelRetriesConfig__retries_config"
type: PROTO_BINARY_BASE64
sub_type: "cloud_ai_platform_dataplane_prediction_proto.CardolanRetriesConfig"
base_value: "config_id: \"retries_config_experiment_1\"\nmodel_ids: \"gemini-[2-5].*\"\nrequest_types: \"dedicated-critical_plus\"\nrequest_types: \"shared-critical\"\nrequest_types: \"shared-sheddable_plus\"\nerror_codes: RESOURCE_EXHAUSTED\nerror_codes: UNAVAILABLE\nerror_codes: INTERNAL\nretry_strategy {\n min_delay {\n seconds: 5\n }\n max_delay {\n seconds: 15\n }\n max_retries: 2\n request_deadline_fraction: 1\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE\n threshold: 0.2\n threshold_duration {\n seconds: 300\n }\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE_LONG_CONTEXT\n threshold: 0.05\n threshold_duration {\n seconds: 300\n }\n}\nretry_threshold_fallback_behavior: RETRY_THRESHOLD_FALLBACK_BEHAVIOR_CLOSE\n"
modifier {
value_operator: OVERRIDE
base_value: "config_id: \"retries_config_experiment_1\"\nmodel_ids: \"gemini-[2-5].*\"\nrequest_types: \"dedicated-critical_plus\"\nrequest_types: \"shared-critical\"\nrequest_types: \"shared-sheddable_plus\"\nerror_codes: RESOURCE_EXHAUSTED\nerror_codes: UNAVAILABLE\nerror_codes: INTERNAL\nretry_strategy {\n min_delay {\n seconds: 5\n }\n max_delay {\n seconds: 15\n }\n max_retries: 2\n request_deadline_fraction: 1\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE\n threshold: 0.2\n threshold_duration {\n seconds: 300\n }\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE_LONG_CONTEXT\n threshold: 0.05\n threshold_duration {\n seconds: 300\n }\n}\nretry_threshold_fallback_behavior: RETRY_THRESHOLD_FALLBACK_BEHAVIOR_CLOSE\nrequest_source: REQUEST_SOURCE_FLEX_API\n"
condition_group {
}
condition_index: 374
}
id: 0
'
Name: V1pTopLevelRetriesConfig_Enabled_Study::Experiment1::ProdWave1 Experiment group: V1pTopLevelRetriesConfig_Enabled_Study Owner email: sushantsingh@google.com,tiancong@google.com,tparth@google.com,rishiag@google.com,sushantj@google.com Aggregate experiment id: 102877852 Description: Prod partition for Wave1 mendel source: http://google3/googledata/experiments/vertex_ai/dataplane_prediction_common/studies/V1pTopLevelRetriesConfig_Enabled_Study.gcl launch_cal: NOT_REQUIRED Query proportion: 0.00% Experiment layer: V1pTopLevelRetriesConfig_Enabled_Study__Group__V1pTopLevelRetriesConfigEnabledStudyLayer Control experiment id: 102877861 Phase: NORMAL Diversion key: 2 Status: ACTIVE Managed traffic allocation: NOT_MANAGED End date: never (or end date of V1pTopLevelRetriesConfig_Enabled_Study__Group__Domain if earlier) Condition index: 0
V1pTopLevelRetriesConfig__enabled: 'name: "V1pTopLevelRetriesConfig__enabled"
type: BOOL
base_value: "TRUE"
id: 0
'
V1pTopLevelRetriesConfig__retries_config: 'name: "V1pTopLevelRetriesConfig__retries_config"
type: PROTO_BINARY_BASE64
sub_type: "cloud_ai_platform_dataplane_prediction_proto.CardolanRetriesConfig"
base_value: "config_id: \"retries_config_experiment_1\"\nmodel_ids: \"gemini-[2-5].*\"\nrequest_types: \"dedicated-critical_plus\"\nrequest_types: \"shared-critical\"\nrequest_types: \"shared-sheddable_plus\"\nerror_codes: RESOURCE_EXHAUSTED\nerror_codes: UNAVAILABLE\nerror_codes: INTERNAL\nretry_strategy {\n min_delay {\n seconds: 5\n }\n max_delay {\n seconds: 15\n }\n max_retries: 2\n request_deadline_fraction: 1\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE\n threshold: 0.2\n threshold_duration {\n seconds: 300\n }\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE_LONG_CONTEXT\n threshold: 0.05\n threshold_duration {\n seconds: 300\n }\n}\nretry_threshold_fallback_behavior: RETRY_THRESHOLD_FALLBACK_BEHAVIOR_CLOSE\n"
modifier {
value_operator: OVERRIDE
base_value: "config_id: \"retries_config_experiment_1\"\nmodel_ids: \"gemini-[2-5].*\"\nrequest_types: \"dedicated-critical_plus\"\nrequest_types: \"shared-critical\"\nrequest_types: \"shared-sheddable_plus\"\nerror_codes: RESOURCE_EXHAUSTED\nerror_codes: UNAVAILABLE\nerror_codes: INTERNAL\nretry_strategy {\n min_delay {\n seconds: 5\n }\n max_delay {\n seconds: 15\n }\n max_retries: 2\n request_deadline_fraction: 1\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE\n threshold: 0.2\n threshold_duration {\n seconds: 300\n }\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE_LONG_CONTEXT\n threshold: 0.05\n threshold_duration {\n seconds: 300\n }\n}\nretry_threshold_fallback_behavior: RETRY_THRESHOLD_FALLBACK_BEHAVIOR_CLOSE\nrequest_source: REQUEST_SOURCE_FLEX_API\n"
condition_group {
}
condition_index: 374
}
id: 0
'
Name: V1pTopLevelRetriesConfig_Enabled_Study::Experiment1::ProdAllowlistWave2 Experiment group: V1pTopLevelRetriesConfig_Enabled_Study Owner email: sushantsingh@google.com,tiancong@google.com,tparth@google.com,rishiag@google.com,sushantj@google.com Aggregate experiment id: 102877852 Description: Prod partition for Wave2 Allowlist mendel source: http://google3/googledata/experiments/vertex_ai/dataplane_prediction_common/studies/V1pTopLevelRetriesConfig_Enabled_Study.gcl launch_cal: NOT_REQUIRED Query proportion: 0.00% Experiment layer: V1pTopLevelRetriesConfig_Enabled_Study__Group__V1pTopLevelRetriesConfigEnabledStudyLayer Control experiment id: 102877862 Phase: NORMAL Diversion key: 2 Status: ACTIVE Managed traffic allocation: NOT_MANAGED End date: never (or end date of V1pTopLevelRetriesConfig_Enabled_Study__Group__Domain if earlier) Condition index: 0
V1pTopLevelRetriesConfig__enabled: 'name: "V1pTopLevelRetriesConfig__enabled"
type: BOOL
base_value: "TRUE"
id: 0
'
V1pTopLevelRetriesConfig__retries_config: 'name: "V1pTopLevelRetriesConfig__retries_config"
type: PROTO_BINARY_BASE64
sub_type: "cloud_ai_platform_dataplane_prediction_proto.CardolanRetriesConfig"
base_value: "config_id: \"retries_config_experiment_1\"\nmodel_ids: \"gemini-[2-5].*\"\nrequest_types: \"dedicated-critical_plus\"\nrequest_types: \"shared-critical\"\nrequest_types: \"shared-sheddable_plus\"\nerror_codes: RESOURCE_EXHAUSTED\nerror_codes: UNAVAILABLE\nerror_codes: INTERNAL\nretry_strategy {\n min_delay {\n seconds: 5\n }\n max_delay {\n seconds: 15\n }\n max_retries: 2\n request_deadline_fraction: 1\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE\n threshold: 0.2\n threshold_duration {\n seconds: 300\n }\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE_LONG_CONTEXT\n threshold: 0.05\n threshold_duration {\n seconds: 300\n }\n}\nretry_threshold_fallback_behavior: RETRY_THRESHOLD_FALLBACK_BEHAVIOR_CLOSE\n"
modifier {
value_operator: OVERRIDE
base_value: "config_id: \"retries_config_experiment_1\"\nmodel_ids: \"gemini-[2-5].*\"\nrequest_types: \"dedicated-critical_plus\"\nrequest_types: \"shared-critical\"\nrequest_types: \"shared-sheddable_plus\"\nerror_codes: RESOURCE_EXHAUSTED\nerror_codes: UNAVAILABLE\nerror_codes: INTERNAL\nretry_strategy {\n min_delay {\n seconds: 5\n }\n max_delay {\n seconds: 15\n }\n max_retries: 2\n request_deadline_fraction: 1\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE\n threshold: 0.2\n threshold_duration {\n seconds: 300\n }\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE_LONG_CONTEXT\n threshold: 0.05\n threshold_duration {\n seconds: 300\n }\n}\nretry_threshold_fallback_behavior: RETRY_THRESHOLD_FALLBACK_BEHAVIOR_CLOSE\nrequest_source: REQUEST_SOURCE_FLEX_API\n"
condition_group {
}
condition_index: 374
}
id: 0
'
Name: V1pTopLevelRetriesConfig_Enabled_Study::Experiment1::ProdWave2 Experiment group: V1pTopLevelRetriesConfig_Enabled_Study Owner email: sushantsingh@google.com,tiancong@google.com,tparth@google.com,rishiag@google.com,sushantj@google.com Aggregate experiment id: 102877852 Description: Prod partition for Wave2 mendel source: http://google3/googledata/experiments/vertex_ai/dataplane_prediction_common/studies/V1pTopLevelRetriesConfig_Enabled_Study.gcl launch_cal: NOT_REQUIRED Query proportion: 0.00% Experiment layer: V1pTopLevelRetriesConfig_Enabled_Study__Group__V1pTopLevelRetriesConfigEnabledStudyLayer Control experiment id: 102877863 Phase: NORMAL Diversion key: 2 Status: ACTIVE Managed traffic allocation: NOT_MANAGED End date: never (or end date of V1pTopLevelRetriesConfig_Enabled_Study__Group__Domain if earlier) Condition index: 0
V1pTopLevelRetriesConfig__enabled: 'name: "V1pTopLevelRetriesConfig__enabled"
type: BOOL
base_value: "TRUE"
id: 0
'
V1pTopLevelRetriesConfig__retries_config: 'name: "V1pTopLevelRetriesConfig__retries_config"
type: PROTO_BINARY_BASE64
sub_type: "cloud_ai_platform_dataplane_prediction_proto.CardolanRetriesConfig"
base_value: "config_id: \"retries_config_experiment_1\"\nmodel_ids: \"gemini-[2-5].*\"\nrequest_types: \"dedicated-critical_plus\"\nrequest_types: \"shared-critical\"\nrequest_types: \"shared-sheddable_plus\"\nerror_codes: RESOURCE_EXHAUSTED\nerror_codes: UNAVAILABLE\nerror_codes: INTERNAL\nretry_strategy {\n min_delay {\n seconds: 5\n }\n max_delay {\n seconds: 15\n }\n max_retries: 2\n request_deadline_fraction: 1\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE\n threshold: 0.2\n threshold_duration {\n seconds: 300\n }\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE_LONG_CONTEXT\n threshold: 0.05\n threshold_duration {\n seconds: 300\n }\n}\nretry_threshold_fallback_behavior: RETRY_THRESHOLD_FALLBACK_BEHAVIOR_CLOSE\n"
modifier {
value_operator: OVERRIDE
base_value: "config_id: \"retries_config_experiment_1\"\nmodel_ids: \"gemini-[2-5].*\"\nrequest_types: \"dedicated-critical_plus\"\nrequest_types: \"shared-critical\"\nrequest_types: \"shared-sheddable_plus\"\nerror_codes: RESOURCE_EXHAUSTED\nerror_codes: UNAVAILABLE\nerror_codes: INTERNAL\nretry_strategy {\n min_delay {\n seconds: 5\n }\n max_delay {\n seconds: 15\n }\n max_retries: 2\n request_deadline_fraction: 1\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE\n threshold: 0.2\n threshold_duration {\n seconds: 300\n }\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE_LONG_CONTEXT\n threshold: 0.05\n threshold_duration {\n seconds: 300\n }\n}\nretry_threshold_fallback_behavior: RETRY_THRESHOLD_FALLBACK_BEHAVIOR_CLOSE\nrequest_source: REQUEST_SOURCE_FLEX_API\n"
condition_group {
}
condition_index: 374
}
id: 0
'
Name: V1pTopLevelRetriesConfig_Enabled_Study::Experiment1::ProdAllowlistWave3 Experiment group: V1pTopLevelRetriesConfig_Enabled_Study Owner email: sushantsingh@google.com,tiancong@google.com,tparth@google.com,rishiag@google.com,sushantj@google.com Aggregate experiment id: 102877852 Description: Prod partition for Wave3 Allowlist mendel source: http://google3/googledata/experiments/vertex_ai/dataplane_prediction_common/studies/V1pTopLevelRetriesConfig_Enabled_Study.gcl launch_cal: NOT_REQUIRED Query proportion: 0.00% Experiment layer: V1pTopLevelRetriesConfig_Enabled_Study__Group__V1pTopLevelRetriesConfigEnabledStudyLayer Control experiment id: 102877864 Phase: NORMAL Diversion key: 2 Status: ACTIVE Managed traffic allocation: NOT_MANAGED End date: never (or end date of V1pTopLevelRetriesConfig_Enabled_Study__Group__Domain if earlier) Condition index: 0
V1pTopLevelRetriesConfig__enabled: 'name: "V1pTopLevelRetriesConfig__enabled"
type: BOOL
base_value: "TRUE"
id: 0
'
V1pTopLevelRetriesConfig__retries_config: 'name: "V1pTopLevelRetriesConfig__retries_config"
type: PROTO_BINARY_BASE64
sub_type: "cloud_ai_platform_dataplane_prediction_proto.CardolanRetriesConfig"
base_value: "config_id: \"retries_config_experiment_1\"\nmodel_ids: \"gemini-[2-5].*\"\nrequest_types: \"dedicated-critical_plus\"\nrequest_types: \"shared-critical\"\nrequest_types: \"shared-sheddable_plus\"\nerror_codes: RESOURCE_EXHAUSTED\nerror_codes: UNAVAILABLE\nerror_codes: INTERNAL\nretry_strategy {\n min_delay {\n seconds: 5\n }\n max_delay {\n seconds: 15\n }\n max_retries: 2\n request_deadline_fraction: 1\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE\n threshold: 0.2\n threshold_duration {\n seconds: 300\n }\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE_LONG_CONTEXT\n threshold: 0.05\n threshold_duration {\n seconds: 300\n }\n}\nretry_threshold_fallback_behavior: RETRY_THRESHOLD_FALLBACK_BEHAVIOR_CLOSE\n"
modifier {
value_operator: OVERRIDE
base_value: "config_id: \"retries_config_experiment_1\"\nmodel_ids: \"gemini-[2-5].*\"\nrequest_types: \"dedicated-critical_plus\"\nrequest_types: \"shared-critical\"\nrequest_types: \"shared-sheddable_plus\"\nerror_codes: RESOURCE_EXHAUSTED\nerror_codes: UNAVAILABLE\nerror_codes: INTERNAL\nretry_strategy {\n min_delay {\n seconds: 5\n }\n max_delay {\n seconds: 15\n }\n max_retries: 2\n request_deadline_fraction: 1\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE\n threshold: 0.2\n threshold_duration {\n seconds: 300\n }\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE_LONG_CONTEXT\n threshold: 0.05\n threshold_duration {\n seconds: 300\n }\n}\nretry_threshold_fallback_behavior: RETRY_THRESHOLD_FALLBACK_BEHAVIOR_CLOSE\nrequest_source: REQUEST_SOURCE_FLEX_API\n"
condition_group {
}
condition_index: 374
}
id: 0
'
Name: V1pTopLevelRetriesConfig_Enabled_Study::Experiment1::ProdWave3 Experiment group: V1pTopLevelRetriesConfig_Enabled_Study Owner email: sushantsingh@google.com,tiancong@google.com,tparth@google.com,rishiag@google.com,sushantj@google.com Aggregate experiment id: 102877852 Description: Prod partition for Wave3 mendel source: http://google3/googledata/experiments/vertex_ai/dataplane_prediction_common/studies/V1pTopLevelRetriesConfig_Enabled_Study.gcl launch_cal: NOT_REQUIRED Query proportion: 0.00% Experiment layer: V1pTopLevelRetriesConfig_Enabled_Study__Group__V1pTopLevelRetriesConfigEnabledStudyLayer Control experiment id: 102877865 Phase: NORMAL Diversion key: 2 Status: ACTIVE Managed traffic allocation: NOT_MANAGED End date: never (or end date of V1pTopLevelRetriesConfig_Enabled_Study__Group__Domain if earlier) Condition index: 0
V1pTopLevelRetriesConfig__enabled: 'name: "V1pTopLevelRetriesConfig__enabled"
type: BOOL
base_value: "TRUE"
id: 0
'
V1pTopLevelRetriesConfig__retries_config: 'name: "V1pTopLevelRetriesConfig__retries_config"
type: PROTO_BINARY_BASE64
sub_type: "cloud_ai_platform_dataplane_prediction_proto.CardolanRetriesConfig"
base_value: "config_id: \"retries_config_experiment_1\"\nmodel_ids: \"gemini-[2-5].*\"\nrequest_types: \"dedicated-critical_plus\"\nrequest_types: \"shared-critical\"\nrequest_types: \"shared-sheddable_plus\"\nerror_codes: RESOURCE_EXHAUSTED\nerror_codes: UNAVAILABLE\nerror_codes: INTERNAL\nretry_strategy {\n min_delay {\n seconds: 5\n }\n max_delay {\n seconds: 15\n }\n max_retries: 2\n request_deadline_fraction: 1\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE\n threshold: 0.2\n threshold_duration {\n seconds: 300\n }\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE_LONG_CONTEXT\n threshold: 0.05\n threshold_duration {\n seconds: 300\n }\n}\nretry_threshold_fallback_behavior: RETRY_THRESHOLD_FALLBACK_BEHAVIOR_CLOSE\n"
modifier {
value_operator: OVERRIDE
base_value: "config_id: \"retries_config_experiment_1\"\nmodel_ids: \"gemini-[2-5].*\"\nrequest_types: \"dedicated-critical_plus\"\nrequest_types: \"shared-critical\"\nrequest_types: \"shared-sheddable_plus\"\nerror_codes: RESOURCE_EXHAUSTED\nerror_codes: UNAVAILABLE\nerror_codes: INTERNAL\nretry_strategy {\n min_delay {\n seconds: 5\n }\n max_delay {\n seconds: 15\n }\n max_retries: 2\n request_deadline_fraction: 1\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE\n threshold: 0.2\n threshold_duration {\n seconds: 300\n }\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE_LONG_CONTEXT\n threshold: 0.05\n threshold_duration {\n seconds: 300\n }\n}\nretry_threshold_fallback_behavior: RETRY_THRESHOLD_FALLBACK_BEHAVIOR_CLOSE\nrequest_source: REQUEST_SOURCE_FLEX_API\n"
condition_group {
}
condition_index: 374
}
id: 0
'
Name: V1pTopLevelRetriesConfig_Enabled_Study::Experiment1::ProdAllowlistWave4 Experiment group: V1pTopLevelRetriesConfig_Enabled_Study Owner email: sushantsingh@google.com,tiancong@google.com,tparth@google.com,rishiag@google.com,sushantj@google.com Aggregate experiment id: 102877852 Description: Prod partition for Wave4 Allowlist mendel source: http://google3/googledata/experiments/vertex_ai/dataplane_prediction_common/studies/V1pTopLevelRetriesConfig_Enabled_Study.gcl launch_cal: NOT_REQUIRED Query proportion: 0.00% Experiment layer: V1pTopLevelRetriesConfig_Enabled_Study__Group__V1pTopLevelRetriesConfigEnabledStudyLayer Control experiment id: 102877866 Phase: NORMAL Diversion key: 2 Status: ACTIVE Managed traffic allocation: NOT_MANAGED End date: never (or end date of V1pTopLevelRetriesConfig_Enabled_Study__Group__Domain if earlier) Condition index: 0
V1pTopLevelRetriesConfig__enabled: 'name: "V1pTopLevelRetriesConfig__enabled"
type: BOOL
base_value: "TRUE"
id: 0
'
V1pTopLevelRetriesConfig__retries_config: 'name: "V1pTopLevelRetriesConfig__retries_config"
type: PROTO_BINARY_BASE64
sub_type: "cloud_ai_platform_dataplane_prediction_proto.CardolanRetriesConfig"
base_value: "config_id: \"retries_config_experiment_1\"\nmodel_ids: \"gemini-[2-5].*\"\nrequest_types: \"dedicated-critical_plus\"\nrequest_types: \"shared-critical\"\nrequest_types: \"shared-sheddable_plus\"\nerror_codes: RESOURCE_EXHAUSTED\nerror_codes: UNAVAILABLE\nerror_codes: INTERNAL\nretry_strategy {\n min_delay {\n seconds: 5\n }\n max_delay {\n seconds: 15\n }\n max_retries: 2\n request_deadline_fraction: 1\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE\n threshold: 0.2\n threshold_duration {\n seconds: 300\n }\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE_LONG_CONTEXT\n threshold: 0.05\n threshold_duration {\n seconds: 300\n }\n}\nretry_threshold_fallback_behavior: RETRY_THRESHOLD_FALLBACK_BEHAVIOR_CLOSE\n"
modifier {
value_operator: OVERRIDE
base_value: "config_id: \"retries_config_experiment_1\"\nmodel_ids: \"gemini-[2-5].*\"\nrequest_types: \"dedicated-critical_plus\"\nrequest_types: \"shared-critical\"\nrequest_types: \"shared-sheddable_plus\"\nerror_codes: RESOURCE_EXHAUSTED\nerror_codes: UNAVAILABLE\nerror_codes: INTERNAL\nretry_strategy {\n min_delay {\n seconds: 5\n }\n max_delay {\n seconds: 15\n }\n max_retries: 2\n request_deadline_fraction: 1\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE\n threshold: 0.2\n threshold_duration {\n seconds: 300\n }\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE_LONG_CONTEXT\n threshold: 0.05\n threshold_duration {\n seconds: 300\n }\n}\nretry_threshold_fallback_behavior: RETRY_THRESHOLD_FALLBACK_BEHAVIOR_CLOSE\nrequest_source: REQUEST_SOURCE_FLEX_API\n"
condition_group {
}
condition_index: 374
}
id: 0
'
Name: V1pTopLevelRetriesConfig_Enabled_Study::Experiment1::ProdWave4 Experiment group: V1pTopLevelRetriesConfig_Enabled_Study Owner email: sushantsingh@google.com,tiancong@google.com,tparth@google.com,rishiag@google.com,sushantj@google.com Aggregate experiment id: 102877852 Description: Prod partition for Wave4 mendel source: http://google3/googledata/experiments/vertex_ai/dataplane_prediction_common/studies/V1pTopLevelRetriesConfig_Enabled_Study.gcl launch_cal: NOT_REQUIRED Query proportion: 0.00% Experiment layer: V1pTopLevelRetriesConfig_Enabled_Study__Group__V1pTopLevelRetriesConfigEnabledStudyLayer Control experiment id: 102877867 Phase: NORMAL Diversion key: 2 Status: ACTIVE Managed traffic allocation: NOT_MANAGED End date: never (or end date of V1pTopLevelRetriesConfig_Enabled_Study__Group__Domain if earlier) Condition index: 0
V1pTopLevelRetriesConfig__enabled: 'name: "V1pTopLevelRetriesConfig__enabled"
type: BOOL
base_value: "TRUE"
id: 0
'
V1pTopLevelRetriesConfig__retries_config: 'name: "V1pTopLevelRetriesConfig__retries_config"
type: PROTO_BINARY_BASE64
sub_type: "cloud_ai_platform_dataplane_prediction_proto.CardolanRetriesConfig"
base_value: "config_id: \"retries_config_experiment_1\"\nmodel_ids: \"gemini-[2-5].*\"\nrequest_types: \"dedicated-critical_plus\"\nrequest_types: \"shared-critical\"\nrequest_types: \"shared-sheddable_plus\"\nerror_codes: RESOURCE_EXHAUSTED\nerror_codes: UNAVAILABLE\nerror_codes: INTERNAL\nretry_strategy {\n min_delay {\n seconds: 5\n }\n max_delay {\n seconds: 15\n }\n max_retries: 2\n request_deadline_fraction: 1\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE\n threshold: 0.2\n threshold_duration {\n seconds: 300\n }\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE_LONG_CONTEXT\n threshold: 0.05\n threshold_duration {\n seconds: 300\n }\n}\nretry_threshold_fallback_behavior: RETRY_THRESHOLD_FALLBACK_BEHAVIOR_CLOSE\n"
modifier {
value_operator: OVERRIDE
base_value: "config_id: \"retries_config_experiment_1\"\nmodel_ids: \"gemini-[2-5].*\"\nrequest_types: \"dedicated-critical_plus\"\nrequest_types: \"shared-critical\"\nrequest_types: \"shared-sheddable_plus\"\nerror_codes: RESOURCE_EXHAUSTED\nerror_codes: UNAVAILABLE\nerror_codes: INTERNAL\nretry_strategy {\n min_delay {\n seconds: 5\n }\n max_delay {\n seconds: 15\n }\n max_retries: 2\n request_deadline_fraction: 1\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE\n threshold: 0.2\n threshold_duration {\n seconds: 300\n }\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE_LONG_CONTEXT\n threshold: 0.05\n threshold_duration {\n seconds: 300\n }\n}\nretry_threshold_fallback_behavior: RETRY_THRESHOLD_FALLBACK_BEHAVIOR_CLOSE\nrequest_source: REQUEST_SOURCE_FLEX_API\n"
condition_group {
}
condition_index: 374
}
id: 0
'
Name: V1pTopLevelRetriesConfig_Enabled_Study::Experiment1::ProdAllowlistWave5 Experiment group: V1pTopLevelRetriesConfig_Enabled_Study Owner email: sushantsingh@google.com,tiancong@google.com,tparth@google.com,rishiag@google.com,sushantj@google.com Aggregate experiment id: 102877852 Description: Prod partition for Wave5 Allowlist mendel source: http://google3/googledata/experiments/vertex_ai/dataplane_prediction_common/studies/V1pTopLevelRetriesConfig_Enabled_Study.gcl launch_cal: NOT_REQUIRED Query proportion: 0.00% Experiment layer: V1pTopLevelRetriesConfig_Enabled_Study__Group__V1pTopLevelRetriesConfigEnabledStudyLayer Control experiment id: 102877868 Phase: NORMAL Diversion key: 2 Status: ACTIVE Managed traffic allocation: NOT_MANAGED End date: never (or end date of V1pTopLevelRetriesConfig_Enabled_Study__Group__Domain if earlier) Condition index: 0
V1pTopLevelRetriesConfig__enabled: 'name: "V1pTopLevelRetriesConfig__enabled"
type: BOOL
base_value: "TRUE"
id: 0
'
V1pTopLevelRetriesConfig__retries_config: 'name: "V1pTopLevelRetriesConfig__retries_config"
type: PROTO_BINARY_BASE64
sub_type: "cloud_ai_platform_dataplane_prediction_proto.CardolanRetriesConfig"
base_value: "config_id: \"retries_config_experiment_1\"\nmodel_ids: \"gemini-[2-5].*\"\nrequest_types: \"dedicated-critical_plus\"\nrequest_types: \"shared-critical\"\nrequest_types: \"shared-sheddable_plus\"\nerror_codes: RESOURCE_EXHAUSTED\nerror_codes: UNAVAILABLE\nerror_codes: INTERNAL\nretry_strategy {\n min_delay {\n seconds: 5\n }\n max_delay {\n seconds: 15\n }\n max_retries: 2\n request_deadline_fraction: 1\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE\n threshold: 0.2\n threshold_duration {\n seconds: 300\n }\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE_LONG_CONTEXT\n threshold: 0.05\n threshold_duration {\n seconds: 300\n }\n}\nretry_threshold_fallback_behavior: RETRY_THRESHOLD_FALLBACK_BEHAVIOR_CLOSE\n"
modifier {
value_operator: OVERRIDE
base_value: "config_id: \"retries_config_experiment_1\"\nmodel_ids: \"gemini-[2-5].*\"\nrequest_types: \"dedicated-critical_plus\"\nrequest_types: \"shared-critical\"\nrequest_types: \"shared-sheddable_plus\"\nerror_codes: RESOURCE_EXHAUSTED\nerror_codes: UNAVAILABLE\nerror_codes: INTERNAL\nretry_strategy {\n min_delay {\n seconds: 5\n }\n max_delay {\n seconds: 15\n }\n max_retries: 2\n request_deadline_fraction: 1\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE\n threshold: 0.2\n threshold_duration {\n seconds: 300\n }\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE_LONG_CONTEXT\n threshold: 0.05\n threshold_duration {\n seconds: 300\n }\n}\nretry_threshold_fallback_behavior: RETRY_THRESHOLD_FALLBACK_BEHAVIOR_CLOSE\nrequest_source: REQUEST_SOURCE_FLEX_API\n"
condition_group {
}
condition_index: 374
}
id: 0
'
Name: V1pTopLevelRetriesConfig_Enabled_Study::Experiment1::ProdWave5 Experiment group: V1pTopLevelRetriesConfig_Enabled_Study Owner email: sushantsingh@google.com,tiancong@google.com,tparth@google.com,rishiag@google.com,sushantj@google.com Aggregate experiment id: 102877852 Description: Prod partition for Wave5 mendel source: http://google3/googledata/experiments/vertex_ai/dataplane_prediction_common/studies/V1pTopLevelRetriesConfig_Enabled_Study.gcl launch_cal: NOT_REQUIRED Query proportion: 0.00% Experiment layer: V1pTopLevelRetriesConfig_Enabled_Study__Group__V1pTopLevelRetriesConfigEnabledStudyLayer Control experiment id: 102877869 Phase: NORMAL Diversion key: 2 Status: ACTIVE Managed traffic allocation: NOT_MANAGED End date: never (or end date of V1pTopLevelRetriesConfig_Enabled_Study__Group__Domain if earlier) Condition index: 0
V1pTopLevelRetriesConfig__enabled: 'name: "V1pTopLevelRetriesConfig__enabled"
type: BOOL
base_value: "TRUE"
id: 0
'
V1pTopLevelRetriesConfig__retries_config: 'name: "V1pTopLevelRetriesConfig__retries_config"
type: PROTO_BINARY_BASE64
sub_type: "cloud_ai_platform_dataplane_prediction_proto.CardolanRetriesConfig"
base_value: "config_id: \"retries_config_experiment_1\"\nmodel_ids: \"gemini-[2-5].*\"\nrequest_types: \"dedicated-critical_plus\"\nrequest_types: \"shared-critical\"\nrequest_types: \"shared-sheddable_plus\"\nerror_codes: RESOURCE_EXHAUSTED\nerror_codes: UNAVAILABLE\nerror_codes: INTERNAL\nretry_strategy {\n min_delay {\n seconds: 5\n }\n max_delay {\n seconds: 15\n }\n max_retries: 2\n request_deadline_fraction: 1\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE\n threshold: 0.2\n threshold_duration {\n seconds: 300\n }\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE_LONG_CONTEXT\n threshold: 0.05\n threshold_duration {\n seconds: 300\n }\n}\nretry_threshold_fallback_behavior: RETRY_THRESHOLD_FALLBACK_BEHAVIOR_CLOSE\n"
modifier {
value_operator: OVERRIDE
base_value: "config_id: \"retries_config_experiment_1\"\nmodel_ids: \"gemini-[2-5].*\"\nrequest_types: \"dedicated-critical_plus\"\nrequest_types: \"shared-critical\"\nrequest_types: \"shared-sheddable_plus\"\nerror_codes: RESOURCE_EXHAUSTED\nerror_codes: UNAVAILABLE\nerror_codes: INTERNAL\nretry_strategy {\n min_delay {\n seconds: 5\n }\n max_delay {\n seconds: 15\n }\n max_retries: 2\n request_deadline_fraction: 1\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE\n threshold: 0.2\n threshold_duration {\n seconds: 300\n }\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE_LONG_CONTEXT\n threshold: 0.05\n threshold_duration {\n seconds: 300\n }\n}\nretry_threshold_fallback_behavior: RETRY_THRESHOLD_FALLBACK_BEHAVIOR_CLOSE\nrequest_source: REQUEST_SOURCE_FLEX_API\n"
condition_group {
}
condition_index: 374
}
id: 0
'
Name: V1pTopLevelRetriesConfig_Enabled_Study::Experiment1::ProdAllowlistGlobal Experiment group: V1pTopLevelRetriesConfig_Enabled_Study Owner email: sushantsingh@google.com,tiancong@google.com,tparth@google.com,rishiag@google.com,sushantj@google.com Aggregate experiment id: 102877852 Description: Prod partition for WaveGlobal Allowlist mendel source: http://google3/googledata/experiments/vertex_ai/dataplane_prediction_common/studies/V1pTopLevelRetriesConfig_Enabled_Study.gcl launch_cal: NOT_REQUIRED Query proportion: 0.00% Experiment layer: V1pTopLevelRetriesConfig_Enabled_Study__Group__V1pTopLevelRetriesConfigEnabledStudyLayer Control experiment id: 102877870 Phase: NORMAL Diversion key: 2 Status: ACTIVE Managed traffic allocation: NOT_MANAGED End date: never (or end date of V1pTopLevelRetriesConfig_Enabled_Study__Group__Domain if earlier) Condition index: 0
V1pTopLevelRetriesConfig__enabled: 'name: "V1pTopLevelRetriesConfig__enabled"
type: BOOL
base_value: "TRUE"
id: 0
'
V1pTopLevelRetriesConfig__retries_config: 'name: "V1pTopLevelRetriesConfig__retries_config"
type: PROTO_BINARY_BASE64
sub_type: "cloud_ai_platform_dataplane_prediction_proto.CardolanRetriesConfig"
base_value: "config_id: \"retries_config_experiment_1\"\nmodel_ids: \"gemini-[2-5].*\"\nrequest_types: \"dedicated-critical_plus\"\nrequest_types: \"shared-critical\"\nrequest_types: \"shared-sheddable_plus\"\nerror_codes: RESOURCE_EXHAUSTED\nerror_codes: UNAVAILABLE\nerror_codes: INTERNAL\nretry_strategy {\n min_delay {\n seconds: 5\n }\n max_delay {\n seconds: 15\n }\n max_retries: 2\n request_deadline_fraction: 1\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE\n threshold: 0.2\n threshold_duration {\n seconds: 300\n }\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE_LONG_CONTEXT\n threshold: 0.05\n threshold_duration {\n seconds: 300\n }\n}\nretry_threshold_fallback_behavior: RETRY_THRESHOLD_FALLBACK_BEHAVIOR_CLOSE\n"
modifier {
value_operator: OVERRIDE
base_value: "config_id: \"retries_config_experiment_1\"\nmodel_ids: \"gemini-[2-5].*\"\nrequest_types: \"dedicated-critical_plus\"\nrequest_types: \"shared-critical\"\nrequest_types: \"shared-sheddable_plus\"\nerror_codes: RESOURCE_EXHAUSTED\nerror_codes: UNAVAILABLE\nerror_codes: INTERNAL\nretry_strategy {\n min_delay {\n seconds: 5\n }\n max_delay {\n seconds: 15\n }\n max_retries: 2\n request_deadline_fraction: 1\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE\n threshold: 0.2\n threshold_duration {\n seconds: 300\n }\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE_LONG_CONTEXT\n threshold: 0.05\n threshold_duration {\n seconds: 300\n }\n}\nretry_threshold_fallback_behavior: RETRY_THRESHOLD_FALLBACK_BEHAVIOR_CLOSE\nrequest_source: REQUEST_SOURCE_FLEX_API\n"
condition_group {
}
condition_index: 374
}
id: 0
'
Name: V1pTopLevelRetriesConfig_Enabled_Study::Experiment1::ProdWaveGlobal Experiment group: V1pTopLevelRetriesConfig_Enabled_Study Owner email: sushantsingh@google.com,tiancong@google.com,tparth@google.com,rishiag@google.com,sushantj@google.com Aggregate experiment id: 102877852 Description: Prod partition for WaveGlobal mendel source: http://google3/googledata/experiments/vertex_ai/dataplane_prediction_common/studies/V1pTopLevelRetriesConfig_Enabled_Study.gcl launch_cal: NOT_REQUIRED Query proportion: 0.00% Experiment layer: V1pTopLevelRetriesConfig_Enabled_Study__Group__V1pTopLevelRetriesConfigEnabledStudyLayer Control experiment id: 102877871 Phase: NORMAL Diversion key: 2 Status: ACTIVE Managed traffic allocation: NOT_MANAGED End date: never (or end date of V1pTopLevelRetriesConfig_Enabled_Study__Group__Domain if earlier) Condition index: 0
V1pTopLevelRetriesConfig__enabled: 'name: "V1pTopLevelRetriesConfig__enabled"
type: BOOL
base_value: "TRUE"
id: 0
'
V1pTopLevelRetriesConfig__retries_config: 'name: "V1pTopLevelRetriesConfig__retries_config"
type: PROTO_BINARY_BASE64
sub_type: "cloud_ai_platform_dataplane_prediction_proto.CardolanRetriesConfig"
base_value: "config_id: \"retries_config_experiment_1\"\nmodel_ids: \"gemini-[2-5].*\"\nrequest_types: \"dedicated-critical_plus\"\nrequest_types: \"shared-critical\"\nrequest_types: \"shared-sheddable_plus\"\nerror_codes: RESOURCE_EXHAUSTED\nerror_codes: UNAVAILABLE\nerror_codes: INTERNAL\nretry_strategy {\n min_delay {\n seconds: 5\n }\n max_delay {\n seconds: 15\n }\n max_retries: 2\n request_deadline_fraction: 1\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE\n threshold: 0.2\n threshold_duration {\n seconds: 300\n }\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE_LONG_CONTEXT\n threshold: 0.05\n threshold_duration {\n seconds: 300\n }\n}\nretry_threshold_fallback_behavior: RETRY_THRESHOLD_FALLBACK_BEHAVIOR_CLOSE\n"
modifier {
value_operator: OVERRIDE
base_value: "config_id: \"retries_config_experiment_1\"\nmodel_ids: \"gemini-[2-5].*\"\nrequest_types: \"dedicated-critical_plus\"\nrequest_types: \"shared-critical\"\nrequest_types: \"shared-sheddable_plus\"\nerror_codes: RESOURCE_EXHAUSTED\nerror_codes: UNAVAILABLE\nerror_codes: INTERNAL\nretry_strategy {\n min_delay {\n seconds: 5\n }\n max_delay {\n seconds: 15\n }\n max_retries: 2\n request_deadline_fraction: 1\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE\n threshold: 0.2\n threshold_duration {\n seconds: 300\n }\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE_LONG_CONTEXT\n threshold: 0.05\n threshold_duration {\n seconds: 300\n }\n}\nretry_threshold_fallback_behavior: RETRY_THRESHOLD_FALLBACK_BEHAVIOR_CLOSE\nrequest_source: REQUEST_SOURCE_FLEX_API\n"
condition_group {
}
condition_index: 374
}
id: 0
'
Name: V1pTopLevelRetriesConfig_Enabled_Study::Experiment1::FakeDenylists Experiment group: V1pTopLevelRetriesConfig_Enabled_Study Owner email: sushantsingh@google.com,tiancong@google.com,tparth@google.com,rishiag@google.com,sushantj@google.com Aggregate experiment id: 102877852 Description: Partition for denylists to make the compiler happy. DO NOT USE. mendel source: http://google3/googledata/experiments/vertex_ai/dataplane_prediction_common/studies/V1pTopLevelRetriesConfig_Enabled_Study.gcl launch_cal: NOT_REQUIRED Query proportion: 0.00% Experiment layer: V1pTopLevelRetriesConfig_Enabled_Study__Group__V1pTopLevelRetriesConfigEnabledStudyLayer Control experiment id: 102877872 Phase: NORMAL Diversion key: 2 Status: ACTIVE Managed traffic allocation: NOT_MANAGED End date: never (or end date of V1pTopLevelRetriesConfig_Enabled_Study__Group__Domain if earlier) Condition index: 0
V1pTopLevelRetriesConfig__enabled: 'name: "V1pTopLevelRetriesConfig__enabled"
type: BOOL
base_value: "TRUE"
id: 0
'
V1pTopLevelRetriesConfig__retries_config: 'name: "V1pTopLevelRetriesConfig__retries_config"
type: PROTO_BINARY_BASE64
sub_type: "cloud_ai_platform_dataplane_prediction_proto.CardolanRetriesConfig"
base_value: "config_id: \"retries_config_experiment_1\"\nmodel_ids: \"gemini-[2-5].*\"\nrequest_types: \"dedicated-critical_plus\"\nrequest_types: \"shared-critical\"\nrequest_types: \"shared-sheddable_plus\"\nerror_codes: RESOURCE_EXHAUSTED\nerror_codes: UNAVAILABLE\nerror_codes: INTERNAL\nretry_strategy {\n min_delay {\n seconds: 5\n }\n max_delay {\n seconds: 15\n }\n max_retries: 2\n request_deadline_fraction: 1\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE\n threshold: 0.2\n threshold_duration {\n seconds: 300\n }\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE_LONG_CONTEXT\n threshold: 0.05\n threshold_duration {\n seconds: 300\n }\n}\nretry_threshold_fallback_behavior: RETRY_THRESHOLD_FALLBACK_BEHAVIOR_CLOSE\n"
modifier {
value_operator: OVERRIDE
base_value: "config_id: \"retries_config_experiment_1\"\nmodel_ids: \"gemini-[2-5].*\"\nrequest_types: \"dedicated-critical_plus\"\nrequest_types: \"shared-critical\"\nrequest_types: \"shared-sheddable_plus\"\nerror_codes: RESOURCE_EXHAUSTED\nerror_codes: UNAVAILABLE\nerror_codes: INTERNAL\nretry_strategy {\n min_delay {\n seconds: 5\n }\n max_delay {\n seconds: 15\n }\n max_retries: 2\n request_deadline_fraction: 1\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE\n threshold: 0.2\n threshold_duration {\n seconds: 300\n }\n}\nretry_thresholds {\n threshold_type: PER_MODEL_RETRY_RATE_LONG_CONTEXT\n threshold: 0.05\n threshold_duration {\n seconds: 300\n }\n}\nretry_threshold_fallback_behavior: RETRY_THRESHOLD_FALLBACK_BEHAVIOR_CLOSE\nrequest_source: REQUEST_SOURCE_FLEX_API\n"
condition_group {
}
condition_index: 374
}
id: 0
'