Title page for 975202026


[Back to Results | New Search]

Student Number 975202026
Author Wei-xiang Kang(康惟翔)
Author's Email Address 975202026@cc.ncu.edu.tw
Statistics This thesis had been viewed 924 times. Download 297 times.
Department Computer Science and Information Engineering
Year 2009
Semester 2
Degree Master
Type of Document Master's Thesis
Language zh-TW.Big5 Chinese
Title Adaptive Computing for Large-Scale Dynamic Distributed Systems
Date of Defense 2010-07-09
Page Count 48
Keyword
  • automatic computing
  • cloud computing
  • cyber organism
  • grid computing
  • self-adaptation
  • self-provision
  • Abstract The demand for computing power continues growing year by year. Meanwhile, sequential processing techniques are becoming insufficient for many complex problems. As a result, large-scale computing frameworks, such as cloud computing and grid computing, become necessary to fulfill the computing needs. A large-scale computing framework is usually comprised of distributed and heterogeneous computing resources.
    The distributed and heterogeneous properties intricate system management, and may impose additional rules and restrictions on the environment while using it. The rules and restrictions are very likely to puzzle application developers and make application optimization difficult to achieve. Most systems in literature aim to optimize the throughput of the entire system, such as Condor, Globus Toolkit, and IOS. Those systems ignore individual application performance in most cases, and thus may not be fare to all users. Furthermore, they cannot handle the environment change seamlessly.
    This research proposes an alternative computing model relating to cyber organisms, aiming to make applications smarter and more adaptive to environment changes. In this model, the computing environment is not responsible for application optimization and reconfiguration. Instead, it provides necessary information for each individual application through a standard interface. Each application consists of several processes to cooperate some given tasks. The sub-components are able to communicate with each other, sense the change of the environment, and react accordingly. Based on the proposed model, we implement a prototype using Message Passing Interface (MPI).
    The major contribution of the proposed system is that the applications are self-manageable and self-provisioning. In other words, it can automatically add new processes to a right computing host, delete old processes from a wrong computing host, and move data to balance workload between hosts when the environment changes. Therefore, different applications can be optimized for different purposes. The experimental results confirm that our system can effectively adapt to the change of the environment and automatically improve application performance.
    Table of Content 摘 要i
    Abstractii
    目 錄iv
    圖目錄vi
    表目錄vii
    1.緒論- 1 -
    1-1.無縫網際空間概念- 2 -
    1-2.環境與生物特性- 3 -
    1-3.網路生物體- 5 -
    1-4.研究目標- 7 -
    1-5.研究貢獻- 9 -
    1-6.論文架構- 10 -
    2.相關研究- 11 -
    2-1.中央式管理方法的工具- 11 -
    2-2.SALSA(Simple Actor Language System and Architecture)- 13 -
    2-3.資料搬移的工具與方法- 14 -
    2-4.行程搬移與IOS- 16 -
    2-5.MPI (Message Passing Interface)- 19 -
    3.系統架構- 21 -
    3-1.程式核心架構- 21 -
    3-2.程式提供之介面- 24 -
    3-3.程式執行流程與實作說明- 27 -
    4.實驗結果- 31 -
    4-1.實驗環境與實驗工具- 31 -
    4-2.實驗結果與分析- 33 -
    4-2-1.階層式主從式架構與動態資料配置- 33 -
    4-2-2.行程新增- 39 -
    4-2-3.行程終止- 43 -
    5.結論- 45 -
    6.未來展望- 46 -
    參考文獻- 47 -
    Reference [1]M. Weiser, “Some computer science issues in ubiquitous computing,” Communications of the ACM, vol. 36, 1993, pp. 75–84.
    [2]u-Taiwan - http://www.utaiwan.nat.gov.tw/index.php.
    [3]I. Foster, “The anatomy of the grid: Enabling scalable virtual organizations,” Euro-Par 2001 Parallel Processing, pp. 1–4.
    [4]M. Armbrust, A. Fox, R. Griffith, A.D. Joseph, R.H. Katz, A. Konwinski, G. Lee, D.A. Patterson, A. Rabkin, I. Stoica, and others, “Above the clouds: A berkeley view of cloud computing,” EECS Department, University of California, Berkeley, Tech. Rep. UCB/EECS-2009-28, 2009.
    [5]G. Agha, “Computing in pervasive cyberspace,” Communications of the ACM, vol. 51, 2008, pp. 68–70.
    [6]G.A. Agha, “Actors: a model of concurrent computation in distributed systems,” AITR-844, 1985.
    [7]K. Schmidt-Nielsen,“Animal physiology adaptation and environment, ” Cambridge [u.a.]: Cambridge Univ. Press, 1997.
    [8]A.S. Tanenbaum and M.V. Steen, “Distributed systems”, Citeseer, 2002.
    [9]W.J. Wang, K. El Maghraoui, J. Cummings, J. Napolitano, B.K. Szymanski, and C.A. Varela, “A middleware framework for maximum likelihood evaluation over dynamic grids,” Second IEEE International Conference on e-Science and Grid Computing, 2006. e-Science'06, 2006, pp. 105–105.
    [10]T. Desell, N. Cole, M. Magdon-Ismail, H. Newberg, B. Szymanski, and C. Varela, “Distributed and generic maximum likelihood evaluation,” 3rd IEEE International Conference on e-Science and Grid Computing (eScience2007), page 8pp, Bangalore, India, 2007.
    [11]C. Wu, “A Dynamic Load-Balancing Maximum Likelihood Evaluation Framework,” 2009.
    [12]Condor Project Homepage - http://www.cs.wisc.edu/condor/.
    [13]D. Thain, T. Tannenbaum, and M. Livny, “Distributed computing in practice: The Condor experience,” Concurrency and Computation Practice and Experience, vol. 17, 2005, pp. 323–356.
    [14]The Globus Alliance - http://www.globus.org/.
    [15]C. Varela and G. Agha, “Programming dynamically reconfigurable open systems with SALSA,” ACM SIGPLAN Notices, vol. 36, 2001, pp. 34.
    [16]SALSA Programming Language - http://wcl.cs.rpi.edu/salsa/.
    [17]Welcome to Apache Hadoop! - http://hadoop.apache.org/.
    [18]J. Dean and S. Ghemawat, “Map Reduce: Simplified data processing on large clusters,” Communications of the ACM-Association for Computing Machinery-CACM, vol. 51, 2008, pp. 107–114.
    [19]D. Borthakur, “The hadoop distributed file system: Architecture and design,” Hadoop Project Website, 2007.
    [20]S. Ghemawat, H. Gobioff, and S.T. Leung, “The Google file system,” ACM SIGOPS Operating Systems Review, vol. 37, 2003, pp. 43.
    [21]A. Mahanti and D.L. Eager, “Adaptive data parallel computing on workstation clusters,” Journal of Parallel and Distributed Computing, vol. 64, 2004, pp. 1241-1255.
    [22]M. Kaddoura, S. Ranka, and A. Wang, “Array decompositions for nonuniform computational environments,” Journal of Parallel and Distributed Computing, vol. 36, 1996, pp. 91–105.
    [23]K.E. Maghraoui, T.J. Desell, B.K. Szymanski, and C.A. Varela, “The internet operating system: Middleware for adaptive distributed computing,” International Journal of High Performance Computing Applications, vol. 20, 2006, pp. 467.
    [24]S. Shen, “Runtime Reconfiguration Using I/O and CPU Profiler over Dynamic P2P Systems,” 2009.
    [25]“MPI: A Message-Passing Interface Standard Version 2.1,” Message Passing Interface Forum, 9月. 2008.
    [26]MPICH2 : High-performance and Widely Portable MPI - http://www.mcs.anl.gov/research/projects/mpich2/.
    [27]Open MPI: Open Source High Performance Computing - http://www.open-mpi.org/.
    [28]LAM/MPI Parallel Computing - http://www.lam-mpi.org/.
    [29]R. Bündgen, M. Göbel, and W. Küchlin, “A master-slave approach to parallel term rewriting on a hierarchical multiprocessor,” Design and Implementation of Symbolic Computation Systems, 1996, pp. 183-194.
    Advisor
  • Wei-Jen Wang(王尉任)
  • Files
  • 975202026.pdf
  • approve in 2 years
    Date of Submission 2010-07-23

    [Back to Results | New Search]


    Browse | Search All Available ETDs

    If you have dissertation-related questions, please contact with the NCU library extension service section.
    Our service phone is (03)422-7151 Ext. 57407,E-mail is also welcomed.