EXERCISE
1Load balancers enable horizontal scaling and high availability - the two pillars of modern internet infrastructure.
The Old Way (No Load Balancer):
You have 1 server handling 1000 requests/minute. Traffic doubles to 2000 requests/minute.
Options:
The Load Balancer Way:
Add servers behind load balancer. Done.
Steps:
Zero downtime. Zero user impact. Instant capacity increase.
Startup Launch:
Day 1: 1 server behind load balancer (100 users)
Month 1: 3 servers (traffic growing)
Month 6: 10 servers (going viral)
Black Friday: Temporarily 50 servers
Week after: Scale back to 15 servers
Load balancer makes this trivial. Without it, this scaling would require complex coordination and would break user experience.
Cloud platforms (AWS, Google Cloud) combine load balancers with .
Traffic increases → Metrics trigger scale-up → New servers launch automatically → Load balancer adds them to pool
Traffic decreases → Servers terminate → Load balancer removes them
Zero human intervention. Infrastructure scales itself.
Example: Netflix scales from 5,000 servers during daytime to 15,000 servers during evening peak viewing, back to 5,000 overnight. Fully automated.
Server Failure Without Load Balancer:
Your single server crashes at 2 AM. Application goes down. Users see error pages. You get emergency calls. Rush to fix and restart server.
Downtime: 30 minutes to 2 hours. Lost revenue. Angry users.
Server Failure With Load Balancer:
You have 3 servers behind load balancer.
2 AM: Server 2 crashes.
What happens?
Load balancer health check detects Server 2 not responding. Instantly stops routing traffic to Server 2. All new requests go to Server 1 and Server 3.
Users experience zero downtime. They never know Server 2 crashed.
Next morning: You wake up, see alert, fix Server 2, add it back. Load balancer resumes sending traffic.
Total user-facing downtime: 0 minutes.
Load balancers continuously check server health.
Every 10 seconds: Send request to /health endpoint on each server.
Server responds: Healthy. Keep routing traffic.
Server fails to respond: Unhealthy. Stop routing traffic immediately.
Server recovers: Automatically added back to rotation.
This happens 24/7 automatically. No human needed.
Need to deploy new code? With load balancers, zero downtime.
Process:
At any moment, 2 servers handle traffic while 1 updates. Users never experience downtime.
Before load balancers: Maintenance required scheduling downtime windows. "Site down for maintenance 2-4 AM." Unacceptable for modern applications.
Advanced: Load balancers can route traffic across multiple data centers.
US users → US load balancer → US servers
Europe users → Europe load balancer → Europe servers
One data center fails? Load balancer redirects all traffic to healthy .
Example: AWS uses this for services like S3. Multiple data centers per region. Seamless failover.
Before load balancers: Scaling was painful. Downtime was inevitable.
After load balancers: Scaling is trivial. Downtime is nearly eliminated.
Load balancers turned scaling and from hard problems into solved problems. This is why every major application uses them.
