500 Overload Error
Document Engine handles API requests with pooling and queueing. Because every software system has limits in resources, such as memory, Document Engine has a back-pressure mechanism built in to provide a stable system. When the queue is full, the server will respond with an error to the API request: 500 overload
. This mechanism ensures that the server stays reliable, and these errors have to be handled by the clients calling the API by throttling the API requests and retrying failed requests.