Processing Radio Astronomical Data Using the PROCESS Software Ecosystem

Authors

  • Souley Madougou Netherlands eScience Center, 1098XG Amsterdam
  • Hanno Spreeuw Netherlands eScience Center, 1098XG Amsterdam
  • Jason Maassen Netherlands eScience Center, 1098XG Amsterdam

Keywords:

Radio astronomy, imaging, extreme large scale data processing, PC clusters, distributed computing, grid, cloud computing

Abstract

In this paper we discuss our efforts in "unlocking" the Long Term Archive (LTA) of the LOFAR radio telescope using the software ecosystem developed in the PROCESS project. The LTA is a large (>50 PB) archive that expands with about 7 PB per year by the ingestion of new observations. It consists of coarsely calibrated "visibilities", i.e. correlations between signals from LOFAR stations. Converting these observations into sky maps (images), which are needed for astronomy research, can be challenging due to the data sizes of the observations and the complexity and compute requirements of the software involved. Using the PROCESS software environment and testbed, we enable a simple point-and-click-reduction of LOFAR observations into sky maps for users of this archive. This work was performed as part of the PROCESS project which aims to provide generalizable open source solutions for user friendly exascale data processing.

Downloads

Download data is not yet available.

Downloads

Published

2021-01-12

How to Cite

Madougou, S., Spreeuw, H., & Maassen, J. (2021). Processing Radio Astronomical Data Using the PROCESS Software Ecosystem. COMPUTING AND INFORMATICS, 39(4), 838–859. Retrieved from http://www.cai.sk/ojs/index.php/cai/article/view/2020_4_838

Issue

Section

Special Section Articles

Most read articles by the same author(s)