Concepts

Caching

Serve repeat requests without an upstream call, and always know what happened from the response headers.

Add a cache directive to the routing config to serve repeat requests without an upstream call. mode is required, simple (exact match) or semantic, with optional ttl_seconds, namespace, force_refresh, and max_response_bytes.

Cache-participating responses carry an x-routeplane-cache header so you always know what happened:

x-routeplane-cacheMeaning
hitServed from cache, no upstream call.
missNot cached; fetched upstream and stored.
refreshedStale entry re-fetched and replaced.
bypassCaching skipped (e.g. force_refresh).

Embeddings are never cached.