TY - GEN
T1 - Technology requirements for supporting on-demand interactive grid computing
AU - Reuther, Albert I.
AU - Currie, Tim
AU - Kepner, Jeremy
AU - Kim, Hahn G.
AU - McCabe, Andrew
AU - Michaleas, Peter
AU - Travinin, Nadya
PY - 2005/12/1
Y1 - 2005/12/1
N2 - It is increasingly being recognized that a large pool of High Performance Computing (HPC) users requires interactive, on-demand access to HPC resources. How to provide these resources is a significant technical challenge that can be addressed from two directions. The first approach is to adapt existing batch queue based HPC systems to make them more interactive. The second approach is to start with existing interactive desktop environments (e.g., MATLAB®) and design a system from the ground up that allows interactive parallel computing. The Lincoln Laboratory Grid (LLGrid) project has taken the latter approach. The LLGrid system has been operational for over a year with a few hundred processors and roughly 70 users, having run over 13,000 interactive jobs and consumed approximately 10,000 processor days of computation. This paper compares the on-demand and interactive computing features of four prominent batch queuing systems: openPBS, Sun GridEngine, Condor, and LSF. It goes on to briefly describe the LLGrid system, and how interactive, on-demand computing was achieved on it by binding to a resource management system. Finally, usage characteristics of the LLGrid system are discussed.
AB - It is increasingly being recognized that a large pool of High Performance Computing (HPC) users requires interactive, on-demand access to HPC resources. How to provide these resources is a significant technical challenge that can be addressed from two directions. The first approach is to adapt existing batch queue based HPC systems to make them more interactive. The second approach is to start with existing interactive desktop environments (e.g., MATLAB®) and design a system from the ground up that allows interactive parallel computing. The Lincoln Laboratory Grid (LLGrid) project has taken the latter approach. The LLGrid system has been operational for over a year with a few hundred processors and roughly 70 users, having run over 13,000 interactive jobs and consumed approximately 10,000 processor days of computation. This paper compares the on-demand and interactive computing features of four prominent batch queuing systems: openPBS, Sun GridEngine, Condor, and LSF. It goes on to briefly describe the LLGrid system, and how interactive, on-demand computing was achieved on it by binding to a resource management system. Finally, usage characteristics of the LLGrid system are discussed.
KW - Cluster computing
KW - Grid computing
KW - Interactive high performance computing
KW - On-demand
KW - Parallel MATLAB
UR - http://www.scopus.com/inward/record.url?scp=33947698848&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=33947698848&partnerID=8YFLogxK
U2 - 10.1109/DODUGC.2005.65
DO - 10.1109/DODUGC.2005.65
M3 - Conference contribution
AN - SCOPUS:33947698848
SN - 0769524966
SN - 9780769524962
T3 - Department of Defense High Performance Computing Modernization Program: Proceedings of the HPCMP Users Group Conference 2005
SP - 320
EP - 327
BT - DoD High Performance Computing Modernization Program
T2 - Department of Defense High Performance Computing Modernization Program: HPCMP Users Group Conference 2005
Y2 - 27 June 2005 through 30 June 2005
ER -