Editing Openai/694057b6-101c-8007-9a65-c40578c7252d (section)

===== The transport layer should distinguish: =====

A) Transport/protocol errors
* connection refused / connect timeout
* header timeout
* malformed SSE frames / unparseable JSON (beyond best-effort tolerance)
* premature disconnect before completion

These are candidates for worker-level restart decisions (nuke & repave), depending on policy and frequency.

B) Application errors from server
* returned as JSON error bodies in non-streaming responses, or
* emitted into the streaming channel as a JSON error (sometimes via the error: field described above). GitHub<ref>{{cite web|title=GitHub|url=https://github.com/ggml-org/llama.cpp/issues/16104|publisher=github.com|access-date=2025-12-16}}</ref>

These should fail the request (preserving partial output), and may or may not trigger a restart depending on how often they occur (policy-driven).