Several international projects currently running or recently ended address part of those issues and CONVERGENCE partners contributed to them. Also, due to his multidisciplinary nature, CONVERGENCE is one of the very few initiative to date in such a position to fill gaps in our ability to effectively use the models we develop, to analyse their outputs and associated observations, and ultimately to answer guiding scientific questions.
Earth System Grid Federation (ESGF) is a group of archive service providers and software developers, developing and deploying a robust, distributed data and computation platform using open source software.
ESGF is a unfunded federated international effort coordinated by multiple agencies and partners including Institut Pierre Simon Laplace (IPSL). METAFOR (2009-2011) was a European Union FP7 project and provided detailed metadata for climate models developing the CIM ontology (Common Information Model) to describe climate data and the models that produce it in a standard way. ES-DOC is also a unfunded federated international effort towards climate models and simulations documentation. IS-ENES1 (2009 – 2013) and IS-ENES2 (2014 – 2018) are European Union FP7 projects providing integrative research and service activities for the European Earth System Modelling community, including support for distribution of the CMIP5 archive through ESGF. The G8 initiative’s support of ExArch has provided a critical opportunity to develop a long-range internationally coordinated strategy to address the goals and requirements of exascale climate analysis.
IPSL being the coordinator of METAFOR, IS-ENES 1 and 2, and an ExArch and ES-DOC principal investigator play a prominent role in those projects. International coordination with respect to the scientific climate data management issues is done through those projects. They are the link with projects or initiative like CURATOR (NSF, NASA. NOAA): capable infrastructure for Earth system research and operations and GO-ESSP (Global Organization for Earth System Science Portals): a federation of frameworks that can work together using agreedupon standards.
This international collaboration culminates every five to seven years during the highly visible CMIP phase. It is mandatory for the French climate community to remain at the forefront on those topics in the future. CONVERGENCE will give us the opportunity to reduce the delay between simulations, distribution and analysis of high quality and well documented and referenced data to a wide variety of users. Research collaborators and partners will benefit from a better access to climate data. This has the potential to give a strong competitive advantage to the national research teams. Private companies making use of our data like insurance companies, energy suppliers or companies working on climate change impacts will as well benefit from a better access to highly traceable climate data and will thus be keen to further exploit partners data. These companies currently restrict their study to a very limited sample of simulations and datasets (the sample they have an easy access to).
CONVERGENCE principally address axis number 3 of the project call by engaging with class of problems where data volume and complexity is a major brake at every stage of climate simulations, pre-processing, runtime, data management and data analysis. CONVERGENCE will also address axis number 1 of the project call by engaging with class of problems that needs innovative algorithms and approach to evaluate model and parameters uncertainties in a multi-physic and multi-scale context. CONVERGENCE platform will favour the climate modelling ecosystem development through multidisciplinary consortium, wide adoption and training.
IDRIS experts will bring there knowledge in HPC use and environment and has been involved in DEISA and PRACE. IDRIS has been work package leader and member of the executive committee of the DEISA project. They are now a PRACE work package leader. They will be involved in scientific data management. MDLS seeks to accompany, support and stimulate scientific communities to make the best use of supercomputers, especially deployed as part of the European project PRACE and the French national centres under GENCI. MDLS organizes training sessions in the following fields: distributed parallel programming, hybrid programming (OpenMP/MPI), GPU computing, debugging and parallel sparse linear algebra. MDLS hosts and gives support to several HPC oriented Masters programs and will extend it through CONVERGENCE platform trainings.