beamerthemeEsiwace
Figures (tar.xz file)
Figures (tar.xz file)
Figures (zip file)
Figures (zip file)
Final pdf file
Final pdf file
Lab files
Latex file
Latex file
Programs
Input/Output and Middleware
Overview
This material is an introduction to storage formats and I/O in a climate and weather context.
It was presented by Luciana Rocha Pedro in the 2020 Summer School on Effective HPC for Climate and Weather and it is part of the ESiWACE project.
ESiWACE is funded by the European Union's Horizon 2020 research and innovation programme under grant agreement No. 823988.
Introduction
The Centre of Excellence in Simulation of Weather and Climate in Europe (ESiWACE) addresses world challenges pushing the limits of science. It benefits the broader community by providing services and training opportunities. As part of the ESiWACE2 project, the 2020 Summer School on Effective HPC for Climate and Weather was organised to bridge the gap between scientists and computational science and increase the effectiveness of young scientists.
The main goal of this event is the training of representative scientists from different institutions with state-of-the-art concepts tailored to the domain, but that also stretches beyond climate and weather, allowing them to act as a multiplier and increase productivity overall.
This material is an introduction to storage formats and I/O in a climate and weather context. Here we present the session:
Input/Output and Middleware - Talk and Lab Sessions
Presenter: Luciana Rocha Pedro
www.reading.ac.uk/computer-science/staff/dr-luciana-pedro
ESiWACE is funded by the European Union's Horizon 2020 research and innovation programme under grant agreement No. 823988.
Input/Output and Middleware - Talk Session
2020 Summer School on Effective HPC for Climate and Weather
Session: Input/Output and Middleware - Talk Session - Presentation
Outline
- Introduction
- Input/Output
- I/O Solutions
- I/O Performance
- NetCDF
- Parallel I/O
- Research Activities
Learning Objectives
- Discuss challenges for data-driven research
- Describe the role of middleware and file formats
- Identify typical I/O performance issues and their causes
- Apply performance models to assess and optimise the application I/O performance
- Design a data model for NetCDF/CF
- Implement an application that utilises parallel I/O to store and analyse data
- Describe ongoing research activities in high-performance storage
Input/Output and Middleware - Lab Session
2020 Summer School on Effective HPC for Climate and Weather
Session: Input/Output and Middleware - Lab Session - Presentation
Outline
- NetCDF Files and C
- NetCDF Utilities
- Practising
Learning Objectives
- Execute programs in C that read and write NetCDF files in a metadata-aware manner
- Analyse, manipulate and visualise NetCDF data