Cookery: A Framework for Creating Data Processing Pipeline Using Online Services

Authors

  • Mikołaj Baranowski Multiscale Networked Systems (MNS), Institute of Informatics, University of Amsterdam, Amsterdam, Netherlands
  • Adam Belloum Multiscale Networked Systems (MNS), Institute of Informatics, University of Amsterdam, Amsterdam, Netherlands
  • Reginald Cushing Multiscale Networked Systems (MNS), Institute of Informatics, University of Amsterdam, Amsterdam, Netherlands
  • Onno Valkering Multiscale Networked Systems (MNS), Institute of Informatics, University of Amsterdam, Amsterdam, Netherlands

DOI:

https://doi.org/10.31577/cai_2020_4_678

Keywords:

Function-as-a-service (FaaS), serverless computing, AWS Lambda, domain specific languages (DSL)

Abstract

With the increasing amount of data the importance of data analysis in various scientific domains has grown. A large amount of the scientific data has shifted to cloud based storage. The cloud offers storage and computation power. The Cookery framework is a tool developed to build scientific applications using cloud services. In this paper we present the Cookery systems and how they can be used to authenticate and use standard online third party services to easily create data analytic pipelines. Cookery framework is not limited to work with standard web services; it can also integrate and work with the emerging AWS Lambda which is part of a new computing paradigm, collectively, known as serverless computing. The combination of AWS Lambda and Cookery, which makes it possible for users in many scientific domains, who do not have any program experience, to create data processing pipelines using cloud services in a short time.

Downloads

Download data is not yet available.

Downloads

Published

2021-01-12

How to Cite

Baranowski, M., Belloum, A., Cushing, R., & Valkering, O. (2021). Cookery: A Framework for Creating Data Processing Pipeline Using Online Services. COMPUTING AND INFORMATICS, 39(4), 678–694. https://doi.org/10.31577/cai_2020_4_678

Issue

Section

Special Section Articles

Most read articles by the same author(s)