Design and Implementation of a TCP Long Connection Load Balancing Algorithm Based on Negative Feedback Mechanism

Abstract Dynamic load balancing is an important way to improve the resource utilization and parallel computing performance of multi-server system. For the mass of terminals under the Internet of Things scenario high frequency periodic escalation and receiving messages scene, the terminal equipment and message server need to establish a TCP long connection to communicate, the accumulation of messages different degree of weight will cause the load tilt. In this paper, an algorithm based on the socket buffer feedback mechanism is proposed, which takes the server load (CPU, memory, connection rate and socket buffer cache) as the load indicator, collects the load indicator through the load agent and calculates the discrete coefficient of the server socket buffer. The dispatch controller calculates the weight of each server, and the higher the weight, the lighter the server load. The experiments show that the CMTS more realistically feedbacks the server load status than the least connections. As the number of cluster server connections and message sending rate increase, the average cluster response time is shorter.