An Analysis Workflow-Aware Storage System for Multi-Core Active Flash Arrays

作者：Sim, Hyogi; Vallee, Geoffroy; Kim, Youngjae^*; Vazhkudai, Sudharshan S; Tiwari, Devesh; Butt, Ali R

来源：IEEE Transactions on Parallel and Distributed Systems, 2019, 30(2): 271-285.

DOI：10.1109/TPDS.2018.2865471

• Distributed systems
• storage management
• scientific data management

The need for novel data analysis is urgent in the face of a data deluge from modern applications. Traditional approaches to data analysis incur significant data movement costs, moving data back and forth between the storage system and the processor. Emerging Active Flash devices enable processing on the flash, where the data already resides. An array of such Active Flash devices allows us to revisit how analysis workflows interact with storage systems. By seamlessly blending together the flash storage and data analysis, we create an analysis workflow-aware storage system, Analyze This. Our guiding principle is that analysis-awareness be deeply ingrained in each and every layer of the storage, elevating data analyses as first-class citizens, and transforming Analyze This into a potent analytics-aware appliance. To evaluate the Analyze This system, we have adopted both emulation and simulation approaches. In particular, we have evaluated AnalyzeThis by implementing the AnalyzeThis storage system on top of the Active Flash Array's emulation platform. We have also implemented an event-driven AnalyzeThis simulator, called Analyze This Sim, which allows us to address the limitations of the emulation platform, e.g., performance impact of using multi-core SSDs. The results from our emulation and simulation platforms indicate that AnalyzeThis is a viable approach for expediting workflow execution and minimizing data movement.

• 出版日期2019-2
• 单位东北大学; 美国弗吉尼亚理工大学(Virginia Tech)