Running SmolDocling Serverless Inference

Jun 07, 2025

Serve SmolDocling inference using serverless architecture with Modal. Trigger a job, process PDFs on demand, and save results to S3.

Streaming structured data from an HTTP endpoint

Mar 20, 2025

Streaming structured data can be tricky. Using server-sent events with the text/event-stream format makes it easier to send and parse JSON in real time.

Handling sessions with JWTs

Jan 15, 2025

JWTs are stateless by design. Adding timestamps helps control sessions and offers a simple way to manage auth without storing anything on the server.