Skip to content

Commit

Permalink
test: resolve warnings in envoy.yaml (#283)
Browse files Browse the repository at this point in the history
**Commit Message**

Addressed warnings observed during `make test-extproc`, except for the
`reuse_port` warning, which is platform-dependent and cannot be fixed on
non-Linux systems.

- Updated `json_format` to be nested under `log_format` to align with
Envoy's expected configuration.
- Added `overload_manager` configuration to manage downstream connection
limits.
- The warning related to `reuse_port` being force disabled on non-Linux
platforms was **not** fixed, as it is platform-dependent.

Signed-off-by: Sébastien Han <seb@redhat.com>

**Related Issues/PRs (if applicable)**

#274

**Special notes for reviewers (if applicable)**

The warning related to `reuse_port` being force disabled on non-Linux
platforms was **not** fixed, as it is platform-dependent. Any
suggestions for a fix are welcome.

Signed-off-by: Sébastien Han <seb@redhat.com>
  • Loading branch information
leseb authored Feb 3, 2025
1 parent a76d01c commit 3ef7a48
Showing 1 changed file with 12 additions and 3 deletions.
15 changes: 12 additions & 3 deletions tests/extproc/envoy.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -16,9 +16,10 @@ static_resources:
typed_config:
"@type": type.googleapis.com/envoy.extensions.access_loggers.file.v3.FileAccessLog
path: ACCESS_LOG_PATH
json_format:
"used_token": "%DYNAMIC_METADATA(ai_gateway_llm_ns:used_token)%"
"some_cel": "%DYNAMIC_METADATA(ai_gateway_llm_ns:some_cel)%"
log_format:
json_format:
used_token: "%DYNAMIC_METADATA(ai_gateway_llm_ns:used_token)%"
some_cel: "%DYNAMIC_METADATA(ai_gateway_llm_ns:some_cel)%"
route_config:
virtual_hosts:
- name: local_route
Expand Down Expand Up @@ -142,3 +143,11 @@ static_resources:
typed_config:
"@type": type.googleapis.com/envoy.extensions.transport_sockets.tls.v3.UpstreamTlsContext
sni: api.openai.com

overload_manager:
refresh_interval: 0.25s
resource_monitors:
- name: "envoy.resource_monitors.global_downstream_max_connections"
typed_config:
"@type": type.googleapis.com/envoy.extensions.resource_monitors.downstream_connections.v3.DownstreamConnectionsConfig
max_active_downstream_connections: 1000

0 comments on commit 3ef7a48

Please sign in to comment.