Data computing and storage

Data computing and storage

The data that is collected on the microscopes is very precious, as valuable time and efforts were dedicated to the preparation of the samples for imaging. The unprocessed imaged data is the basis for the subsequent image processing steps, leading to final structural models and scientific outcome. It is therefore crucial to store the data safely. We are using dedicated data storage facilities that are accessible remotely for copying and or processing data.

We have been developping and testing a commercial solution with SURFSara company.

It is now a stable product called Research Drive. https://www.surf.nl/en/services-and-products/research-drive/index.html

When you data is being collected, it is automatically uploaded to Research Drive and we will give you an account to download the data to your own data center.

To make sure we collect the best data possible we also developped a custom made -on-the-fly processing plotting quality statistics about the data being collected. We also provide access to 4-GPUs workstations for the duration of your stay for initial processing.

At the end of the data collection we generate a quality report that we give you as a pdf (see Alewijnse, …, Carragher, Potter, Best practices for managing large cryoEM facilities, JSB, 2017)