Skip to content

Commit

Permalink
test: resolve warnings in envoy.yaml
Browse files Browse the repository at this point in the history
Addressed warnings observed during `make test-extproc`, except for the
`reuse_port` warning, which is platform-dependent and cannot be fixed on
non-Linux systems.

- Updated `json_format` to be nested under `log_format` to align with
  Envoy's expected configuration.
- Added `overload_manager` configuration to manage downstream
  connection limits.
- The warning related to `reuse_port` being force disabled on
  non-Linux platforms was **not** fixed, as it is platform-dependent.

Resolves: envoyproxy#274.
Signed-off-by: Sébastien Han <seb@redhat.com>
  • Loading branch information
leseb committed Feb 3, 2025
1 parent bd2362f commit 6a00f9d
Showing 1 changed file with 12 additions and 3 deletions.
15 changes: 12 additions & 3 deletions tests/extproc/envoy.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -16,9 +16,10 @@ static_resources:
typed_config:
"@type": type.googleapis.com/envoy.extensions.access_loggers.file.v3.FileAccessLog
path: ACCESS_LOG_PATH
json_format:
"used_token": "%DYNAMIC_METADATA(ai_gateway_llm_ns:used_token)%"
"some_cel": "%DYNAMIC_METADATA(ai_gateway_llm_ns:some_cel)%"
log_format:
json_format:
used_token: "%DYNAMIC_METADATA(ai_gateway_llm_ns:used_token)%"
some_cel: "%DYNAMIC_METADATA(ai_gateway_llm_ns:some_cel)%"
route_config:
virtual_hosts:
- name: local_route
Expand Down Expand Up @@ -142,3 +143,11 @@ static_resources:
typed_config:
"@type": type.googleapis.com/envoy.extensions.transport_sockets.tls.v3.UpstreamTlsContext
sni: api.openai.com

overload_manager:
refresh_interval: 0.25s
resource_monitors:
- name: "envoy.resource_monitors.global_downstream_max_connections"
typed_config:
"@type": type.googleapis.com/envoy.extensions.resource_monitors.downstream_connections.v3.DownstreamConnectionsConfig
max_active_downstream_connections: 1000

0 comments on commit 6a00f9d

Please sign in to comment.