posted on 2018-10-09, 07:47authored byRobert A. McLeod, Ricardo Diogo Righetto, Andrew A. Stewart, Henning Stahlberg
The introduction of fast CMOS detectors is moving the field of transmission electron microscopy into the
computer science field of big data. Automated data pipelines control the instrument and initial processing steps
which imposes more onerous data transfer and archiving requirements. Here we conduct a technical demonstration
whereby storage and read/write times are improved 10× at a dose rate of 1 e−/pix/frame for data from
a Gatan K2 direct-detection device by combination of integer decimation and lossless compression. The example
project is hosted at github.com/em-MRCZ and released under the BSD license.