Load Balancing Algorithms

 Load Balancing Algorithms



  • In Round robin requests are sent in sequence eg req1 to server1, req2 to server2, req3 to server3 and etc
  • It can potentially overload servers if they are not properly monitored. 



  • In Sticky RR It tries to send subsequent requests from the same user to the same server
  • Uneven loads can easily occur for newly arriving users are very high are assigned randomly 




  • Weighted RR allows admins to assign different weights or priorities to different servers. 
  • Servers with higher weights will receive a proportionally high number of requests. 
  • Weights must be manually configured by admins






  • Hash function often uses clients IP address for determining where to route each request. 
  • Selecting optimal  hashing is challenging






Dynamic Algorithms adapt in real time by taking active performance metrics and server conditions into account when distributing the requests. 






It sends each new request to the server currently with least number of active connections or open requests. 







  • It sends incoming requests to the server with lowest current latency or fastest response time 
  • It requires constant monitoring which significantly overhead and introduces complexity 

Comments

Post a Comment

Popular posts from this blog

Distributed Tracing

Image
Distributed Tracing   Cloud computing, microservices, open source tools, and container-based delivery have made applications more distributed across an increasingly complex landscape. As a result, distributed tracing has become crucial to responding quickly to issues. Distributed tracing is a method of observing requests as they propagate through distributed cloud environments. It follows an interaction and tags it with a unique identifier. This identifier stays with the transaction as it interacts with microservices, containers, and infrastructure.   Distributed tracing helps teams understand more quickly how each microservice is performing. This understanding helps them resolve issues rapidly, increase customer satisfaction, ensure steady revenue, and preserve time for teams to innovate. This way, businesses can take full advantage of the benefits modern application environments offer while minimizing the challenges that their inherent complexity can also create. Different T...
Read more

Reverse Proxy Vs API gateway Vs Load Balancer

Image
Reverse Proxy Vs API gateway Vs Load Balancer Reverse Proxy:   A reverse proxy is a server that sits in between the client devices and backend servers. It forwards the client requests to the appropriate   service and returns the server’s response to the client.   It protects the websites from the direct attacks like DDOS distributed denial of service.   It improves the performance by caching content.   It ensures the traffic is evenly distributed   across multiple servers to handle high volumes of requests efficiently.   Reverse Proxy provide features such as   Increased Security   Identity of backend servers Load distrubution SSL Termination Compression Caching It’s also useful with one web server.   API gateway:   An API Gateway is a server that acts as an entry point for managing, routing, and securing API requests to multiple backend services. API gateway offers features   Routing requests Authentication Authorization Monit...
Read more

Scalability

Image
Scalability As a system grows, the performance starts to degrade unless we adapt it to deal with that growth. Scalability is the property of a system to handle a growing amount of load by adding resources to the system. How can a System Grow? A system can grow in several dimensions.   1. Growth in User Base More users started using the system, leading to increased number of requests. Example: A social media platform experiencing a surge in new users. 2. Growth in Features More features were introduced to expand the system's capabilities. Example: An e-commerce website adding support for a new payment method. 3. Growth in Data Volume Growth in the amount of data the system stores and manages due to user activity or logging. Example: A video streaming platform like youtube storing more video content over time. 4. Growth in Complexity The system's architecture evolves to accommodate new features, scale, or integrations, resulting in additional components and dependencies. Example...
Read more