Two-tier multi-tenancy scaling and load balancing

Wei Tek Tsai, Xin Sun, Qihong Shao, Guanqiu Qi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

30 Scopus citations


Cloud computing often uses the multi-tenancy architecture where tenants share system software. To support dynamically increasing demands from multi-tenants, the cloud service providers have to duplicate computing resources to cope with the fluctuation of requests from tenants. This is currently handled by virtualization and duplication at the application level in the existing cloud environment, such as Google App Engine. However, duplicating at the application level only may result in significant resource waste as the entire application is duplicated. This paper proposes a two-tier SaaS scaling and scheduling architecture that works at both service and application levels to save resources, and the key idea is to increase the resources to those bottleneck components only. Several duplication strategies are proposed, including lazy duplication and pro-active duplication to achieve better system performance. Additionally, a resource allocation algorithm is proposed in a clustered cloud environment. The experiment results showed that the proposed algorithms can achieve a better resource utilization rate.

Original languageEnglish (US)
Title of host publicationProceedings - IEEE International Conference on E-Business Engineering, ICEBE 2010
Number of pages6
StatePublished - 2010
EventIEEE International Conference on E-Business Engineering, ICEBE 2010 - Shanghai, China
Duration: Nov 10 2010Nov 12 2010

Publication series

NameProceedings - IEEE International Conference on E-Business Engineering, ICEBE 2010


OtherIEEE International Conference on E-Business Engineering, ICEBE 2010

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Computer Networks and Communications


Dive into the research topics of 'Two-tier multi-tenancy scaling and load balancing'. Together they form a unique fingerprint.

Cite this