Data resource discovery model based on hybrid architecture in data grid environment

作者:Ma, Tinghuai*; Lu, Yinhua; Shi, Sunyuan; Tian, Wei; Wang, Xin; Guan, Donghai
来源:Concurrency and Computation: Practice and Experience (CCPE) , 2015, 27(3): 507-525.
DOI:10.1002/cpe.3222

摘要

Today, the management of massive data collections draws much attention as data grids have been developed to deal with large computational problems and provide the opportunity for sharing geographically distributed resources for largescale dataintensive applications. Therefore, finding an effective approach to discover data resources in order to promote better interactions between application communities or virtual organizations becomes a critical challenge. Traditional grid resource discovery models are mostly based on central and hierarchical architecture that can lead to bottlenecking with the expansion of the grid scale. Although the PeertoPeer (P2P) technique is integrated into the grid in order to improve the performance in recent years, each P2P structure still has drawbacks that require several compensatory strategies. In this paper, based on the unstructured supernodebased architecture from the P2P system, we design a structured logic resource tree in each domain in order to effectively alleviate the load on the supernode, and we propose a query recording learning algorithm based on this hybrid architecture to reduce traffic in the network and greatly shorten the response time. The model and algorithm are validated by simulations and compared with the traditional superpeer model and the floodingbased approach.