High-Frequency Event Queue Simulator

Overview

This high-frequency event queue simulator demonstrates expertise in distributed systems and real-time data processing. The platform simulates real-world queue scenarios including bursts, retries, and backpressure under peak load conditions. The React-based monitoring dashboard provides real-time visibility into throughput, failure rates, and system health.

Key Highlights

• Designed a distributed event simulation platform processing 50K+ events per minute, using Kafka topics with partitioned producers and Redis backed coordination to simulate real world queue bursts, retries, and backpressure under peak load conditions
• Engineered real-time dashboards in React with WebSocket updates to monitor throughput, retries, and failure rates under heavy load
• Benchmarked and optimized end to end streaming pipelines by tuning Kafka batch sizes, consumer concurrency, and Redis access patterns, achieving sub 200ms end to end latency while maintaining delivery guarantees in high volume scenarios