Joint Monitorless Load-Balancing and Autoscaling for Zero-Wait-Time in Data Centers - Archive ouverte HAL Access content directly
Journal Articles IEEE Transactions on Network and Service Management Year : 2021

Joint Monitorless Load-Balancing and Autoscaling for Zero-Wait-Time in Data Centers

(1) , , (2)
1
2
Yoann Desmouceaux
Marcel Enguehard
  • Function : Author
Thomas Heide Clausen

Abstract

Cloud architectures achieve scaling through two main functions: (i) load-balancers, which dispatch queries among replicated virtualized application instances, and (ii) autoscalers, which automatically adjust the number of replicated instances to accommodate variations in load patterns. These functions are often provided through centralized load monitoring, incurring operational complexity. This paper introduces a unified and centralized-monitoring-free architecture achieving both autoscaling and load-balancing, reducing operational overhead while increasing response time performance. Application instances are virtually ordered in a chain, and new queries are forwarded along this chain until an instance, based on its local load, accepts the query. Autoscaling is triggered by the last application instance, which inspects its average load and infers if its chain is under-or over-provisioned. An analytical model of the system is derived, and proves that the proposed technique can achieve asymptotic zero-wait time with high (and controlable) probability. This result is confirmed by extensive simulations, which highlight close-toideal performance in terms of both response time and resource costs.
Fichier principal
Vignette du fichier
Joint-Monitorless-Load-Balancing-and-Autoscaling-for-Zero-Wait-Time-in-Data-Centers.pdf (1.65 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03171974 , version 1 (17-03-2021)

Identifiers

Cite

Yoann Desmouceaux, Marcel Enguehard, Thomas Heide Clausen. Joint Monitorless Load-Balancing and Autoscaling for Zero-Wait-Time in Data Centers. IEEE Transactions on Network and Service Management, 2021, 18 (1), pp.672-686. ⟨10.1109/TNSM.2020.3045059⟩. ⟨hal-03171974⟩

Collections

X IP_PARIS
28 View
74 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More