View in EDS

Optimal capacity planning for cloud service providers with periodic, time-varying demand.

Saved in:
Bibliographic Details
Title: Optimal capacity planning for cloud service providers with periodic, time-varying demand.
Authors: Furman, Eugene1 (AUTHOR) efurman@alba.acg.edu, Diamant, Adam2 (AUTHOR) adiamant@schulich.yorku.ca
Source: European Journal of Operational Research. Apr2025, Vol. 322 Issue 1, p133-146. 14p.
Subjects: Service level agreements, Queueing networks, Fluid dynamics, Stochastic systems, Cloud computing
Abstract: Allocating capacity to private cloud computing services is challenging because demand is time-varying, there are often no buffers, and customers can re-submit jobs a finite number of times. We model this setting using a multi-station queueing network where servers represent CPU cores and jobs not immediately processed retry several times. Assuming retrial rates are stationary and that there is a maximum number of retrial attempts, we determine an optimal service capacity and retrial interval under an admission control policy employed by our partner institution — the server informs customers when they should next attempt service without enforcement. We introduce a recursive representation of the offered load which approximates the fluid dynamics of the system. We then use this representation to develop a solution technique that minimizes the total variation in the constructed offered load. We prove this approach is linked to maximizing system throughput and that in certain settings, the optimal stationary and time-varying retrial intervals are equivalent. Utilizing a data set of cloud computing requests spanning a 24-hour period, our analysis indicates that the optimal policy prescribes a 10% reduction in capacity. We also investigate the fidelity of the fluid model and the sensitivity of our recommendations to the behavior of retrial jobs. We find that retrial-time announcements allow a provider to satisfy service level agreements while encouraging retrial jobs to be processed during off-peak periods. Further, the policy is suitably robust to a customer's willingness to comply with the suggested retrial times. • We study a private cloud computing service where the server recommends retrial times. • We formulate a stochastic model of system dynamics and analyze a fluid approximation. • We introduce a novel modified offered-load approximation for new and retrial fluid. • We minimize total variation in the modified offered load subject to constraints. • The optimization model gives the optimal server numbers and stationary retrial rates. [ABSTRACT FROM AUTHOR]
Copyright of European Journal of Operational Research is the property of Elsevier B.V. and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
Description
Abstract:Allocating capacity to private cloud computing services is challenging because demand is time-varying, there are often no buffers, and customers can re-submit jobs a finite number of times. We model this setting using a multi-station queueing network where servers represent CPU cores and jobs not immediately processed retry several times. Assuming retrial rates are stationary and that there is a maximum number of retrial attempts, we determine an optimal service capacity and retrial interval under an admission control policy employed by our partner institution — the server informs customers when they should next attempt service without enforcement. We introduce a recursive representation of the offered load which approximates the fluid dynamics of the system. We then use this representation to develop a solution technique that minimizes the total variation in the constructed offered load. We prove this approach is linked to maximizing system throughput and that in certain settings, the optimal stationary and time-varying retrial intervals are equivalent. Utilizing a data set of cloud computing requests spanning a 24-hour period, our analysis indicates that the optimal policy prescribes a 10% reduction in capacity. We also investigate the fidelity of the fluid model and the sensitivity of our recommendations to the behavior of retrial jobs. We find that retrial-time announcements allow a provider to satisfy service level agreements while encouraging retrial jobs to be processed during off-peak periods. Further, the policy is suitably robust to a customer's willingness to comply with the suggested retrial times. • We study a private cloud computing service where the server recommends retrial times. • We formulate a stochastic model of system dynamics and analyze a fluid approximation. • We introduce a novel modified offered-load approximation for new and retrial fluid. • We minimize total variation in the modified offered load subject to constraints. • The optimization model gives the optimal server numbers and stationary retrial rates. [ABSTRACT FROM AUTHOR]
ISSN:03772217
DOI:10.1016/j.ejor.2024.11.017