Skip to main content
Version: Latest

Fast Response

Overview​

fast_response is a route-local plugin that returns a deterministic fallback message immediately.

Key Advantages​

  • Short-circuits expensive routes when a lightweight fallback is enough.
  • Keeps overload behavior local to the route that needs it.
  • Makes the fallback message explicit in config.

What Problem Does It Solve?​

Some routes should degrade gracefully instead of waiting for the full model path. fast_response gives those routes an immediate response path without changing global behavior.

When to Use​

  • the route needs a cheap fallback under overload or maintenance conditions
  • a deterministic response is acceptable for this traffic class
  • fallback behavior should stay local to one route

Configuration​

Add the plugin under routing.decisions[].plugins:

plugins:
  - type: fast_response
    configuration:
      message: The primary model is unavailable. Try again shortly.

No model is called and no response content is generated. Keep the message free of request data and do not use this plugin as an authentication or rate-limit control. The plugin does not measure overload; the decision must match the traffic that should receive the fallback. See a complete example: config/fragments/plugin/fast-response/busy.yaml.