Streaming

Workflow

Consume OpenAI-compatible server-sent events while preserving cancellation and usage evidence.

• Set stream=true.
• Parse complete SSE events rather than transport chunks.
• Handle cancellation and partial output explicitly.
• Request and reconcile usage when the client supports it.

Production boundary