How do tasks get distributed across master nodes in an environment?


#1

How actions are distributed across workers in a cluster makes sense: The tasks are placed in the appropriate queue, and workers pick up the threads as the workers have availability. These tasks can be prioritized in the queues to promote the completion of one job before another, etc., etc.

I am curious about how user interactions get directed to a certain master node in cases where there are multiple master nodes.


#2

There should be a load balancer in the architecture scheme (not handy at the moment).


#3

Thanks Alex, do you have any further details to share?


#4

There are slides with that, perhaps Rohit has them. I’ll try to find them…


#5

@ColumbusL There is a load balancer (aws ELB) that you hit when you make a query to the vanity url. This takes care of round robin based approach to send requests to the master nodes.