A cloud-based taxi trace mining framework for smart city

作者：Liu, Jin; Yu, Xiao; Xu, Zheng^*; Choo, Kim-Kwang Raymond; Hong, Liang; Cui, Xiaohui

来源：Software: Practice and Experience , 2017, 47(8): 1081-1094.

DOI：10.1002/spe.2435

• big data application
• smart city
• distributed trajectory pattern mining
• distributed trajectory clustering
• Spark

As a well-known field of big data applications, smart city takes advantage of massive data analysis to achieve efficient management and sustainable development in the current worldwide urbanization process. An important problem in smart city is how to discover frequent trajectory sequence pattern and cluster trajectory. To solve this problem, this paper proposes a cloud-based taxi trajectory pattern mining and trajectory clustering framework for smart city. Our work mainly includes (1) preprocessing raw Global Positioning System trace by calling the Baidu API Geocoding; (2) proposing a distributed trajectory pattern mining (DTPM) algorithm based on Spark; and (3) proposing a distributed trajectory clustering (DTC) algorithm based on Spark. The proposed DTPM algorithm and DTC algorithm can overcome the high input/output overhead and communication overhead by adopting in-memory computation. In addition, the proposed DTPM algorithm can avoid generating redundant local trajectory patterns to significantly improve the overall performance. The proposed DTC algorithm can enhance the performance of trajectory similarity computation by transforming the trajectory similarity calculation into AND and OR operators. Experimental results indicate that DTPM algorithm and DTC algorithm can significantly improve the overall performance and scalability of trajectory pattern mining and trajectory clustering on massive taxi trace data.

• 出版日期2017-8
• 单位武汉大学