IoT-Hub: New IoT Data-Platform for Virtual Research Environments

Rosa Filgueira Vicente; Rafael  Ferreira da Silva; Ewa Deelman; Vyron  Christodoulou; Amrey Krause

IoT-Hub: New IoT Data-Platform for Virtual Research Environments

Rosa Filgueira Vicente, Rafael Ferreira da Silva, Ewa Deelman, Vyron Christodoulou, Amrey Krause

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract / Description of output

This paper presents IoT-Hub a new scalable, elastic, efficient, and portable Internet of Things (IoT) data-platform based on microservices for monitoring and analysing large- scale sensor data in real-time. IoT-Hub allows us to collect, process, and store large amounts of data from multiple sensors in distributed locations—which could be deployed as a backend for Virtual Research Environments (VRE) or Science Gateways. In the proposed data-platform, all required software, which involves a variety of state-of-the-art open-source middleware, is packed into containers and deployed in a cloud environment. As a result, the engineering and computational time and costs for deployment and execution is significantly reduced.

Keywords—IoT, Science Gateway, Virtual Research Environ- ment, Data-Frameworks, Containers, Data Science, Microservices

Original language	English
Title of host publication	10th International Workshop on Science Gateways (IWSG 2018)
Editors	Malcolm Atkinson, Sandra Gesing
Publisher	CEUR Workshop Proceedings (CEUR-WS.org)
Number of pages	6
Publication status	Published - 15 Jun 2018
Event	IWSG 2018 - 10th International Workshop on Science Gateways - Informatics Forum, The University of Edinburgh, Edinburgh, United Kingdom Duration: 13 Jun 2018 → 15 Jun 2018 https://sites.google.com/a/nd.edu/iwsg2018/

Publication series

Name	CEUR Workshop Proceedings
Volume	2357
ISSN (Electronic)	1613-0073

Conference

Conference	IWSG 2018 - 10th International Workshop on Science Gateways
Abbreviated title	IWSG 2018
Country/Territory	United Kingdom
City	Edinburgh
Period	13/06/18 → 15/06/18
Internet address	https://sites.google.com/a/nd.edu/iwsg2018/

Keywords / Materials (for Non-textual outputs)

IoT
Science Gateway
Virtual Research Environment
Data-Frameworks
Microservices
Data Science,
Containers

Access to Document

iot-data-platform-CRAccepted author manuscript, 1.36 MB

http://ceur-ws.org/Vol-2357/paper13.pdfLicence: All Rights Reserved
http://ceur-ws.org/Vol-2357/Licence: All Rights Reserved

DARE: Delivering Agile Research Excellence on European e-Infrastructures
Atkinson, M.
EU government bodies
1/01/18 → 31/12/20
Project: Research

Cite this

Filgueira Vicente, R., Ferreira da Silva, R., Deelman, E., Christodoulou, V., & Krause, A. (2018). IoT-Hub: New IoT Data-Platform for Virtual Research Environments. In M. Atkinson, & S. Gesing (Eds.), 10th International Workshop on Science Gateways (IWSG 2018) (CEUR Workshop Proceedings; Vol. 2357). CEUR Workshop Proceedings (CEUR-WS.org). http://ceur-ws.org/Vol-2357/paper13.pdf

@inproceedings{81d8e383960d46deb82874a45c1ac2f4,

title = "IoT-Hub: New IoT Data-Platform for Virtual Research Environments",

abstract = "This paper presents IoT-Hub a new scalable, elastic, efficient, and portable Internet of Things (IoT) data-platform based on microservices for monitoring and analysing large- scale sensor data in real-time. IoT-Hub allows us to collect, process, and store large amounts of data from multiple sensors in distributed locations—which could be deployed as a backend for Virtual Research Environments (VRE) or Science Gateways. In the proposed data-platform, all required software, which involves a variety of state-of-the-art open-source middleware, is packed into containers and deployed in a cloud environment. As a result, the engineering and computational time and costs for deployment and execution is significantly reduced.Keywords—IoT, Science Gateway, Virtual Research Environ- ment, Data-Frameworks, Containers, Data Science, Microservices",

keywords = "IoT, Science Gateway, Virtual Research Environment, Data-Frameworks, Microservices, Data Science, , Containers",

author = "{Filgueira Vicente}, Rosa and {Ferreira da Silva}, Rafael and Ewa Deelman and Vyron Christodoulou and Amrey Krause",

year = "2018",

month = jun,

day = "15",

language = "English",

series = "CEUR Workshop Proceedings",

publisher = "CEUR Workshop Proceedings (CEUR-WS.org)",

editor = "Malcolm Atkinson and Sandra Gesing",

booktitle = "10th International Workshop on Science Gateways (IWSG 2018)",

note = "IWSG 2018 - 10th International Workshop on Science Gateways, IWSG 2018 ; Conference date: 13-06-2018 Through 15-06-2018",

url = "https://sites.google.com/a/nd.edu/iwsg2018/",

}

Filgueira Vicente, R, Ferreira da Silva, R, Deelman, E, Christodoulou, V & Krause, A 2018, IoT-Hub: New IoT Data-Platform for Virtual Research Environments. in M Atkinson & S Gesing (eds), 10th International Workshop on Science Gateways (IWSG 2018). CEUR Workshop Proceedings, vol. 2357, CEUR Workshop Proceedings (CEUR-WS.org), IWSG 2018 - 10th International Workshop on Science Gateways, Edinburgh, United Kingdom, 13/06/18. <http://ceur-ws.org/Vol-2357/paper13.pdf>

IoT-Hub: New IoT Data-Platform for Virtual Research Environments. / Filgueira Vicente, Rosa; Ferreira da Silva, Rafael ; Deelman, Ewa et al.
10th International Workshop on Science Gateways (IWSG 2018). ed. / Malcolm Atkinson; Sandra Gesing. CEUR Workshop Proceedings (CEUR-WS.org), 2018. (CEUR Workshop Proceedings; Vol. 2357).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - IoT-Hub: New IoT Data-Platform for Virtual Research Environments

AU - Filgueira Vicente, Rosa

AU - Ferreira da Silva, Rafael

AU - Deelman, Ewa

AU - Christodoulou, Vyron

AU - Krause, Amrey

PY - 2018/6/15

Y1 - 2018/6/15

N2 - This paper presents IoT-Hub a new scalable, elastic, efficient, and portable Internet of Things (IoT) data-platform based on microservices for monitoring and analysing large- scale sensor data in real-time. IoT-Hub allows us to collect, process, and store large amounts of data from multiple sensors in distributed locations—which could be deployed as a backend for Virtual Research Environments (VRE) or Science Gateways. In the proposed data-platform, all required software, which involves a variety of state-of-the-art open-source middleware, is packed into containers and deployed in a cloud environment. As a result, the engineering and computational time and costs for deployment and execution is significantly reduced.Keywords—IoT, Science Gateway, Virtual Research Environ- ment, Data-Frameworks, Containers, Data Science, Microservices

AB - This paper presents IoT-Hub a new scalable, elastic, efficient, and portable Internet of Things (IoT) data-platform based on microservices for monitoring and analysing large- scale sensor data in real-time. IoT-Hub allows us to collect, process, and store large amounts of data from multiple sensors in distributed locations—which could be deployed as a backend for Virtual Research Environments (VRE) or Science Gateways. In the proposed data-platform, all required software, which involves a variety of state-of-the-art open-source middleware, is packed into containers and deployed in a cloud environment. As a result, the engineering and computational time and costs for deployment and execution is significantly reduced.Keywords—IoT, Science Gateway, Virtual Research Environ- ment, Data-Frameworks, Containers, Data Science, Microservices

KW - IoT

KW - Science Gateway

KW - Virtual Research Environment

KW - Data-Frameworks

KW - Microservices

KW - Data Science,

KW - Containers

M3 - Conference contribution

T3 - CEUR Workshop Proceedings

BT - 10th International Workshop on Science Gateways (IWSG 2018)

A2 - Atkinson, Malcolm

A2 - Gesing, Sandra

PB - CEUR Workshop Proceedings (CEUR-WS.org)

T2 - IWSG 2018 - 10th International Workshop on Science Gateways

Y2 - 13 June 2018 through 15 June 2018

ER -

IoT-Hub: New IoT Data-Platform for Virtual Research Environments

Abstract / Description of output

Publication series

Conference

Keywords / Materials (for Non-textual outputs)

Access to Document

Fingerprint

Projects

DARE: Delivering Agile Research Excellence on European e-Infrastructures

Cite this