On Effective Scheduling in Computing Clusters
- 作者: Grushin D.1, Kuzyurin N.1,2
-
隶属关系:
- Ivannikov Institute for System Programming, Russian Academy of Sciences
- Moscow Institute of Physics and Technology
- 期: 卷 45, 编号 7 (2019)
- 页面: 398-404
- 栏目: Article
- URL: https://journals.rcsi.science/0361-7688/article/view/176948
- DOI: https://doi.org/10.1134/S0361768819070077
- ID: 176948
如何引用文章
详细
Presently, big companies such as Amazon, Google, Facebook, Microsoft, and Yahoo! own huge datacenters with thousands of nodes. These clusters are used simultaneously by many clients. The users submit jobs containing one or more tasks. The task flow is usually a mix of short, long, interactive, and batch tasks with different priorities. The cluster scheduler decides on which server the task should be run as a process, container, or virtual machine. Scheduler optimizations are important as they provide higher server utilization, lower latency, improved load balancing, and fault tolerance. Optimal task placement is a complex problem that has multiple dimensions and requires algorithmically complex optimizations. This increases placement latency and limits cluster scalability. In this paper, we consider different cluster scheduler architectures and optimization problems.
作者简介
D. Grushin
Ivannikov Institute for System Programming, Russian Academy of Sciences
编辑信件的主要联系方式.
Email: grushin@ispras.ru
俄罗斯联邦, ul. Solzhenitsyna 25, Moscow, 109004
N. Kuzyurin
Ivannikov Institute for System Programming, Russian Academy of Sciences; Moscow Institute of Physics and Technology
编辑信件的主要联系方式.
Email: nnkuz@ispras.ru
俄罗斯联邦, ul. Solzhenitsyna 25, Moscow, 109004; Institutskii per. 9, Dolgoprudnyi, Moscow oblast, 141700