Reliable log ingestion: queues, retries, and duplicates
Define delivery guarantees, bound your buffers, and make duplicate records and pipeline failures visible.
TOPIC COLLECTION
API design
Separate application interfaces, ingestion contracts, and query responsibilities. Explore decisions about schema evolution, acceptance, partial failure, and duplicate handling before choosing a transport.
Read it. Then test it.
Use this collection to choose a focused design question. Each guide includes a practical investigation or fixture exercise, a primary technical reference, and links to the next relevant pattern. Start with the event you need to understand, then validate the full path from producer to reader.
Structured JSON logging: design a schema that lasts
Define meaningful fields, preserve data types, and evolve your event schema without breaking downstream readers.
What is a log API? A practical developer’s guide
Understand logging libraries, ingestion endpoints, and query interfaces—and build an event contract that connects them.