Scientific Data Management

This work describes cutting-edge technologies and solutions for managing and analyzing vast amounts of scientific data. It begins with coverage of efficient storage systems, discussing how to write and read large volumes of data without slowing the simulation, analysis, or visualization processes. The book then focuses on the efficient data movement and management of storage spaces and explores emerging database systems for scientific data. It also addresses how to best organize data for analysis purposes, how to effectively conduct searches over large datasets, how to successfully automate multistep scientific process workflows, and how to automatically collect metadata and lineage information.

Arie Shoshani is a senior staff scientist at Lawrence Berkeley National Laboratory, where he heads the Scientific Data Management Research Group. Dr. Shoshani is also the director of the Scientific Data Management Center, one of several large computer science centers supported by the SciDAC program of the U.S. Department of Energy. Doron Rotem is a senior staff scientist at Lawrence Berkeley National Laboratory, where he heads the research program on scientific data management.

Storage Technology and Efficient Storage Access. Data Transfer and Scheduling. Specialized Retrieval Techniques and Database Systems. Data Analysis, Integration, and Visualization Methods. Scientific Process Management. Conclusions and Future Outlook. Index.