Simulations are generating an unprecedented amount of data, facilitated by the rapidly increasing computational capabilities of leading compute resources. This presents significant challenges. One challenge lies in hardware trends: the enormous increases in compute power are not being matched by corresponding increases in bandwidth to storage. Cost and power constrain the feasibility of dramatically larger storage deployments. A second challenge lies in extracting knowledge from these volumes of data. Research in data management infrastructure has created capabilities that can assist in this process, but the available tools are not widely used and deployed. These are not just future challenges, but rather, they are already causing bottlenecks that substantially impact the quality and productivity of scientific research performed with HPC machines.

Leaders:

This e-mail address is being protected from spambots. You need JavaScript enabled to view it (ORNL), This e-mail address is being protected from spambots. You need JavaScript enabled to view it (ANL)

Team Members:

This e-mail address is being protected from spambots. You need JavaScript enabled to view it , ANL

This e-mail address is being protected from spambots. You need JavaScript enabled to view it , Rutgers

This e-mail address is being protected from spambots. You need JavaScript enabled to view it , ORNL

This e-mail address is being protected from spambots. You need JavaScript enabled to view it , NCSU

This e-mail address is being protected from spambots. You need JavaScript enabled to view it , GA Tech

This e-mail address is being protected from spambots. You need JavaScript enabled to view it , LBNL

This e-mail address is being protected from spambots. You need JavaScript enabled to view it , GA Tech

This e-mail address is being protected from spambots. You need JavaScript enabled to view it , LBNL

Projects:

I/O frameworks

In Situ Processing and Code Coupling

Indexing

In Situ Data Compression

Parallel I/O and File Formats