Journal of Information Processing
Online ISSN : 1882-6652
ISSN-L : 1882-6652
Towards a Dataflow Platform in a Hierarchical Network: A Proposal for a Dataflow Component Management Method
Shintaro IshiharaToyokazu Akiyama
Author information

2020 Volume 28 Pages 599-610


Massive dataflows are generated from IoT applications for controlling real-world environments. For maintaining the long-running IoT application costs, it becomes important to reduce network traffic and delay considering hierarchical network characteristics, e.g., leveraging edge resources. Research and development of such a dataflow platform are ongoing, and the platform enables application developers to build a new dataflow application by just combining reusable software components. However, the existing dataflow platform does not support component management, which includes application deployment and placement selection, assuming the hierarchical network environments. In this paper, to realize the dataflow platform in a hierarchical network, we proposed an approach to deploy components into heterogeneous environments using a major open-source product and to enable the large-scale deployment by considering the structure of network clusters. Then, a component deployment layer selection method is also proposed considering network and resource conditions in the proposed platform. During the definition of the component placement problem, we also extracted parameters, which are dataflow platform parameters, dataflow application parameters and dataflow application component parameters, required to estimate component deployment budgets. Furthermore, we implemented a simple dataflow application based on two use cases and confirmed the validity of the proposed method.

Related papers from these authors
© 2020 by the Information Processing Society of Japan
Previous article Next article