Common configuration for two or more load balancing policy extensions (proto)¶

extensions.load_balancing_policies.common.v3.LocalityLbConfig¶

[extensions.load_balancing_policies.common.v3.LocalityLbConfig proto]

{
  "zone_aware_lb_config": {...},
  "locality_weighted_lb_config": {...}
}

zone_aware_lb_config

(extensions.load_balancing_policies.common.v3.LocalityLbConfig.ZoneAwareLbConfig) Configuration for local zone aware load balancing.

Precisely one of zone_aware_lb_config, locality_weighted_lb_config must be set.

locality_weighted_lb_config

(extensions.load_balancing_policies.common.v3.LocalityLbConfig.LocalityWeightedLbConfig) Enable locality weighted load balancing.

Precisely one of zone_aware_lb_config, locality_weighted_lb_config must be set.

extensions.load_balancing_policies.common.v3.LocalityLbConfig.ZoneAwareLbConfig¶

[extensions.load_balancing_policies.common.v3.LocalityLbConfig.ZoneAwareLbConfig proto]

Configuration for zone aware routing.

{
  "routing_enabled": {...},
  "min_cluster_size": {...},
  "fail_traffic_on_panic": ...
}

routing_enabled: (type.v3.Percent) Configures percentage of requests that will be considered for zone aware routing if zone aware routing is configured. If not specified, the default is 100%. * runtime values. * Zone aware routing support.

min_cluster_size: (UInt64Value) Configures minimum upstream cluster size required for zone aware routing If upstream cluster size is less than specified, zone aware routing is not performed even if zone aware routing is configured. If not specified, the default is 6. * runtime values. * Zone aware routing support.

fail_traffic_on_panic: (bool) If set to true, Envoy will not consider any hosts when the cluster is in panic mode. Instead, the cluster will fail all requests as if all hosts are unhealthy. This can help avoid potentially overwhelming a failing service.

extensions.load_balancing_policies.common.v3.LocalityLbConfig.LocalityWeightedLbConfig¶

[extensions.load_balancing_policies.common.v3.LocalityLbConfig.LocalityWeightedLbConfig proto]

Configuration for locality weighted load balancing

extensions.load_balancing_policies.common.v3.SlowStartConfig¶

[extensions.load_balancing_policies.common.v3.SlowStartConfig proto]

Configuration for slow start mode.

{
  "slow_start_window": {...},
  "aggression": {...},
  "min_weight_percent": {...}
}

slow_start_window: (Duration) Represents the size of slow start window. If set, the newly created host remains in slow start mode starting from its creation time for the duration of slow start window.

aggression

(config.core.v3.RuntimeDouble) This parameter controls the speed of traffic increase over the slow start window. Defaults to 1.0, so that endpoint would get linearly increasing amount of traffic. When increasing the value for this parameter, the speed of traffic ramp-up increases non-linearly. The value of aggression parameter should be greater than 0.0. By tuning the parameter, is possible to achieve polynomial or exponential shape of ramp-up curve.

During slow start window, effective weight of an endpoint would be scaled with time factor and aggression: new_weight = weight * max(min_weight_percent, time_factor ^ (1 / aggression)), where time_factor=(time_since_start_seconds / slow_start_time_seconds).

As time progresses, more and more traffic would be sent to endpoint, which is in slow start window. Once host exits slow start, time_factor and aggression no longer affect its weight.

min_weight_percent: (type.v3.Percent) Configures the minimum percentage of origin weight that avoids too small new weight, which may cause endpoints in slow start mode receive no traffic in slow start window. If not specified, the default is 10%.

extensions.load_balancing_policies.common.v3.ConsistentHashingLbConfig¶

[extensions.load_balancing_policies.common.v3.ConsistentHashingLbConfig proto]

Common Configuration for all consistent hashing load balancers (MaglevLb, RingHashLb, etc.)

{
  "use_hostname_for_hashing": ...,
  "hash_balance_factor": {...}
}

use_hostname_for_hashing: (bool) If set to true, the cluster will use hostname instead of the resolved address as the key to consistently hash to an upstream host. Only valid for StrictDNS clusters with hostnames which resolve to a single IP address.

hash_balance_factor

(UInt32Value) Configures percentage of average cluster load to bound per upstream host. For example, with a value of 150 no upstream host will get a load more than 1.5 times the average load of all the hosts in the cluster. If not specified, the load is not bounded for any upstream host. Typical value for this parameter is between 120 and 200. Minimum is 100.

Applies to both Ring Hash and Maglev load balancers.

This is implemented based on the method described in the paper https://arxiv.org/abs/1608.01350. For the specified hash_balance_factor, requests to any upstream host are capped at hash_balance_factor/100 times the average number of requests across the cluster. When a request arrives for an upstream host that is currently serving at its max capacity, linear probing is used to identify an eligible host. Further, the linear probe is implemented using a random jump in hosts ring/table to identify the eligible host (this technique is as described in the paper https://arxiv.org/abs/1908.08762 - the random jump avoids the cascading overflow effect when choosing the next host in the ring/table).

If weights are specified on the hosts, they are respected.

This is an O(N) algorithm, unlike other load balancers. Using a lower hash_balance_factor results in more hosts being probed, so use a higher value if you require better performance.