/streamz help
Streamz Root:
Streamz ManuallySampledMetrics set:
Root name: <default> [(+) labels] [(+) collection] [(+) largest exported metrics]
Search:
/cloud/ai/platform/dataplane/cardolan/memory/in_flight_request_payload_bytes{string large_model_name, string action, string request_source} : long = ...
QueryExplorer (monarch.BorgTask): task cell global
Sum of payload sizes for all in-flight LLM requests
defined at cloud/ai/platform/dataplane/prediction/api_handler/shared/request_memory_metrics.cc:24 with annotations: GAUGE=true UNIT=bytes
Collection schedule: PERIOD(sec)=60, TRAFFIC=AF1, REPL=2, PATTERN=/cloud/ai/platform/dataplane/cardolan/
Map with 0 row(s)