On Effective Scheduling in Computing Clusters
- Авторы: Grushin D.1, Kuzyurin N.1,2
-
Учреждения:
- Ivannikov Institute for System Programming, Russian Academy of Sciences
- Moscow Institute of Physics and Technology
- Выпуск: Том 45, № 7 (2019)
- Страницы: 398-404
- Раздел: Article
- URL: https://journals.rcsi.science/0361-7688/article/view/176948
- DOI: https://doi.org/10.1134/S0361768819070077
- ID: 176948
Цитировать
Аннотация
Presently, big companies such as Amazon, Google, Facebook, Microsoft, and Yahoo! own huge datacenters with thousands of nodes. These clusters are used simultaneously by many clients. The users submit jobs containing one or more tasks. The task flow is usually a mix of short, long, interactive, and batch tasks with different priorities. The cluster scheduler decides on which server the task should be run as a process, container, or virtual machine. Scheduler optimizations are important as they provide higher server utilization, lower latency, improved load balancing, and fault tolerance. Optimal task placement is a complex problem that has multiple dimensions and requires algorithmically complex optimizations. This increases placement latency and limits cluster scalability. In this paper, we consider different cluster scheduler architectures and optimization problems.
Об авторах
D. Grushin
Ivannikov Institute for System Programming, Russian Academy of Sciences
Автор, ответственный за переписку.
Email: grushin@ispras.ru
Россия, ul. Solzhenitsyna 25, Moscow, 109004
N. Kuzyurin
Ivannikov Institute for System Programming, Russian Academy of Sciences; Moscow Institute of Physics and Technology
Автор, ответственный за переписку.
Email: nnkuz@ispras.ru
Россия, ul. Solzhenitsyna 25, Moscow, 109004; Institutskii per. 9, Dolgoprudnyi, Moscow oblast, 141700