ORIGINAL SYSTEM DESIGN QUESTION
Structured log ingestion
Collect application logs for tenant-scoped debugging and retention.
Original exercise · intermediate. Editorial role relevance does not imply a company has asked this question.
Requirements and constraints
- 100,000 events/second; average event 1 KB; retain searchable data seven days.
- Logs may contain sensitive fields; overload should not exhaust app memory.
- State assumptions and justify security, cost, operational ownership and data retention.
Pressure round
An indexing cluster is unavailable for two hours.
Build and explain the design
Requirements & scope
Who uses it? What must it do? What is explicitly out of scope? State latency, durability and privacy goals.
Self-review guidance
Define the actors, required operations and out-of-scope behavior. Explicit requirement: Logs may contain sensitive fields; overload should not exhaust app memory.
Capacity estimates
State assumptions, peak requests/second, data volume and retention. Show your arithmetic and units.
Self-review guidance
Use this workload: 100,000 events/second; average event 1 KB; retain searchable data seven days. Convert rates and payload sizes into peak compute/storage assumptions; show units, headroom and what remains unmeasured.
APIs & data model
Describe endpoints/events, entity keys, indexes, authorization, and idempotency.
Self-review guidance
Specify schemas, ingestion keys, redaction policy and tenant-scoped queries.
Architecture & data flow
Describe components and request/event paths. Use plain text arrows to sketch your design; explain each responsibility.
Self-review guidance
Use bounded agents, buffers, partitioned ingestion and index/storage tiers.
Failures & observability
What happens on overload, duplicate events, partial failures or lost dependencies? Discuss monitoring and recovery.
Self-review guidance
Pressure-test: An indexing cluster is unavailable for two hours. Describe bounded recovery, deduplication, observability and a user-visible failure state.
Tradeoffs & alternatives
Compare two plausible approaches. State the costs, consistency model and what would make you change the design.
Self-review guidance
Compare loss tolerance, backpressure, durable buffers and cost.
Design guidance describes assumptions and tradeoffs; no architecture has been simulated or benchmarked.
Practice this question
Save your work privately, explain decisions and return to your revision queue.
Open practice workspaceBrowse the question library →