A Generic Tree-Like Index Framework in the Cloud

作者：Yin, Yue^*; Yao, Bin; Shen, Yao; Guo, Minyi; Xu, Changliang

来源：14th International Conference on Web Information Systems Engineering (WISE), China,Fujian,Zhangzhou,Nanjing, 2013-10-13 to 2013-10-15.

DOI：10.1007/978-3-642-41230-1_28

• distributed index
• cloud computing
• data warehousing

In this study, we present a novel tree based index scheme for efficient indexing and serving large datasets in the cloud. It incorporates and extends the functionality of Hadoop to create a fully parallel index system. Our new scheme can be summarized as follows. First, we leverage the MapReduce framework to create an index, then publish the index meta information and write it into a meta table. Second, we use the meta information to help the system adopting an efficient method to handle a given query. Finally, we optimize the system by using cache mechanism. We conduct extensive experiments on the Hadoop cluster to demonstrate the scalability, availability and efficiency of the proposed index framework.

• 出版日期2013
• 单位上海交通大学