Welcome to Session II: Wrestling with Data
The amount of data generated by experiments, simulations, and sensors continues to explode. Processing has expanded beyond analysis and visualization to in situ feature detection, control and steering, compression/reduction, and more – and the rapid rise of machine learning has increased complexity further.
The question of how to wrestle the data beast into submission becomes more complicated when cloud technologies are integrated with on-premises HPC resources, with answers that can be highly dependent on particular science and engineering domains, facility attributes (hardware, software, and even policies), and use cases.
Speakers in this session will provide insights into several aspects of these challenges from their specific perspectives, and a panel discussion will invite further discussion from participants.
The question of how to wrestle the data beast into submission becomes more complicated when cloud technologies are integrated with on-premises HPC resources, with answers that can be highly dependent on particular science and engineering domains, facility attributes (hardware, software, and even policies), and use cases.
Speakers in this session will provide insights into several aspects of these challenges from their specific perspectives, and a panel discussion will invite further discussion from participants.
Recording of the full session held on March 11, 2021:
Please log in to access to the recording.