Dynamic Workflows in the Exascale Era
Today, developers lack tools that enable the development of complex workflows involving HPC simulation and modelling with data analytics (DA) and machine learning (ML). The COMPSs programming framework from BSC aims to deliver a workflow software stack to enable the integration of HPC simulation and modelling with big data analytics and machine learning in scientific and industrial applications. The software stack allows to develop innovative adaptive workflows that efficiently use the computing resources also considering innovative storage solutions. In this presentation we also describe the latest developments to adapt the framework to very dynamic computing environments that include resources spanning across the Edge-Cloud continuum.