QuestionsDesign a Rate Limiter

Components

Drag onto canvas

Frontend

Client

CDN

Mobile App

Networking

Load Balancer

API Gateway

DNS

Compute

App Server

Worker

Serverless Function

Storage

SQL DB

NoSQL DB

Object Store

Data Warehouse

Cache

Redis Cache

CDN Cache

In-Memory Cache

Messaging

Message Queue

Event Bus

Pub/Sub

Infrastructure

Firewall

Rate Limiter

Search Engine

Press enter or space to select a node. You can then use the arrow keys to move the node around. Press delete to remove it and escape to cancel.

Press enter or space to select an edge. You can then press delete to remove it or escape to cancel.

Google·medium

Design a Rate Limiter

Design a distributed rate limiter that limits the number of requests a client can make to an API within a time window, preventing abuse and ensuring fair usage.

Functional

▸Limit requests per user/IP per time window
▸Support multiple algorithms: token bucket, sliding window, fixed window
▸Return 429 Too Many Requests when limit exceeded
▸Different rate limits for different API endpoints
▸Real-time limit status in response headers

Non-Functional

▸Decision latency < 1ms (added overhead)
▸1M requests per second throughput
▸Accurate across distributed nodes
▸No single point of failure
▸99.999% availability

Add at least 2 components to run