Open Systems Laboratory at Illinois

DROPLET: distributed operator placement for iot applications spanning edge and cloud resources

By Tarek Elgamal, Atul Sandur, Phuong Nguyen, Klara Nahrstedt, and Gul Agha. In 11th IEEE International Conference on Cloud Computing, CLOUD 2018, San Francisco, CA, USA, July 2-7, 2018, 1–8. IEEE Computer Society, 2018.

DOI:
10.1109/CLOUD.2018.00008
Publisher Link:
https://doi.org/10.1109/CLOUD.2018.00008

Abstract

Internet of Things (IoT) applications generate massive amounts of real-time streaming data. IoT data owners strive to make predictions/inferences from these large streams of data often through applying machine learning, and image processing operations. A typical deployment of such applications includes edge devices to provide processing/storage operations closer to the location where the streaming data is captured. An important challenge for IoT applications is deciding which operations to execute on an edge device and which operations should be carried out in the cloud. In this paper, we propose a scalable dynamic programming algorithm called DROPLET, to partition operations in IoT applications across shared edge and cloud resources, while minimizing completion time of the end-to-end operations. We evaluate DROPLET using three real-world applications. Our results show that DROPLET finds a partitioning of operations having overall completion time within 4% of the optimum for these applications. It also scales to thousands of operations and outperforms closest heuristics in the literature, by being 10 times faster in running time while finding partitioning of operations with total completion time that is 20% better for the large applications that we simulated. We analyze DROPLET to show that it scales with total number of operations in log-linear time.

BibTeX

@inproceedings{conf/IEEEcloud/ElgamalSNNA18,
    author = "Elgamal*, Tarek and Sandur*, Atul and Nguyen, Phuong
              and Nahrstedt, Klara and Agha, Gul",
    title = "{DROPLET:} Distributed Operator Placement for IoT
             Applications Spanning Edge and Cloud Resources",
    biburl = "https://dblp.org/rec/bib/conf/IEEEcloud/ElgamalSNNA18",
    booktitle = "11th {IEEE} International Conference on Cloud
                 Computing, {CLOUD} 2018, San Francisco, CA, USA, July 2-7,
                 2018",
    crossref = "conf/IEEEcloud/2018",
    doi = "10.1109/CLOUD.2018.00008",
    pages = "1--8",
    timestamp = "Tue, 25 Sep 2018 01:00:00 +0200",
    url = "https://doi.org/10.1109/CLOUD.2018.00008",
    year = "2018",
}

@proceedings{conf/IEEEcloud/2018,
    title = "11th {IEEE} International Conference on Cloud Computing,
             {CLOUD} 2018, San Francisco, CA, USA, July 2-7, 2018",
    biburl = "https://dblp.org/rec/bib/conf/IEEEcloud/2018",
    isbn = "978-1-5386-7235-8",
    publisher = "{IEEE} Computer Society",
    timestamp = "Fri, 14 Sep 2018 11:58:42 +0200",
    url = "http://ieeexplore.ieee.org/xpl/mostRecentIssue.jsp?punumber=8
           457546",
    year = "2018",
}