Globus Reaches One Exabyte Milestone in Research Data Management

Data is the lifeblood of research, and in order to keep science progressing, it must flow. Since 1997, Globus — a project founded by UChicago CS Professor Ian Foster, Steve Tuecke, and Carl Kesselman — has helped scientists manage their research data by moving, sharing, and publishing increasingly large datasets through user-friendly software. This week, the project passed a milestone that emphasizes just how large its contribution to science has been, reaching 1 exabyte of data transferred.

An exabyte (EB) is a billion billion bytes, an almost unfathomable amount of data. According to Globus, it would take a person on a continuous video call 237,823 years to transfer 1EB, or a Netflix subscriber 3.5 billion years of watching movies at their current rate to surpass the 1EB mark. 

Yet, exabytes will soon be a routine unit of measurement for science, between the dawn of exascale computing and the proliferation of artificial intelligence, Internet of Things devices, and scientific instruments such as genomic sequencers. Analysts estimate that 59 zettabytes — which equals 59,000 exabytes of data — will be created, captured, copied and consumed in 2020

“It is such an exciting time for the research community,” said Foster, the Arthur Holly Compton Distinguished Service Professor of Computer Science at UChicago and Distinguished Fellow and Senior Scientist at Argonne National Laboratory. “The massive data volumes being collected, analyzed, and shared today will enable us to address and solve some of the world’s most challenging problems, from discovering new vaccines to tackling climate change and uncovering some of the mysteries of the Universe.”

Globus Reaches One Exabyte Milestone in Research Data Management

The accelerating rate of scientific data is aptly demonstrated by the journey of Globus from 2010 to its first exabyte. While it took over 2,000 days for the service to transfer the first 200 petabytes (PB) of data, the last 200PB were moved in just 247 days. All told, 150,000 registered users have now transferred over 120 billion files using Globus.

Those billions of bytes include data from cosmological simulations, experiments on the Advanced Photon Source at Argonne, 3D brain reconstructions, and end-to-end genetic sequence analysis. The big number was also facilitated by services such as Globus Auth and the Globus Platform that enable a wide range of research data management tasks, and integration with national-scale computational infrastructures such as Compute Canada and The National Energy Research Scientific Computing Center (NERSC).

“Our mission at Globus is to make the management of research data as frictionless as possible so researchers can get on with their important work”, said Rachana Ananthakrishnan, Globus executive director. “We are gratified to see the service becoming a critical part of cyberinfrastructure at thousands of leading research institutions around the world.”

For more on Globus, visit globus.org.

Related News

More UChicago CS stories from this research area.
Video

“Machine Learning Foundations Accelerate Innovation and Promote Trustworthiness” by Rebecca Willett

Jan 26, 2024
Video

Nightshade: Data Poisoning to Fight Generative AI with Ben Zhao

Jan 23, 2024
No Name

Five UChicago CS students named to Siebel Scholars Class of 2024

Oct 02, 2023
No Name

In The News: U.N. Officials Urge Regulation of Artificial Intelligence

"Security Council members said they feared that a new technology might prove a major threat to world peace."
Jul 27, 2023
No Name

UChicago Scientists Make New Discovery Proving Entanglement Is Responsible for Computational Hardness In Quantum Systems

Jul 25, 2023
No Name

UChicago Computer Scientists Bring in Generative Neural Networks to Stop Real-Time Video From Lagging

Jun 29, 2023
No Name

Computer Science Displays Catch Attention at MSI’s Annual Robot Block Party

Apr 07, 2023
No Name

UChicago, Stanford Researchers Explore How Robots and Computers Can Help Strangers Have Meaningful In-Person Conversations

Mar 29, 2023
No Name

Postdoc Alum John Paparrizos Named ICDE Rising Star

Mar 15, 2023
No Name

New EAGER Grant to Asst. Prof. Eric Jonas Will Explore ML for Quantum Spectrometry

Mar 03, 2023
No Name

Assistant Professor Chenhao Tan Receives Sloan Research Fellowship

Feb 15, 2023
No Name

UChicago Scientists Develop New Tool to Protect Artists from AI Mimicry

Feb 13, 2023
arrow-down-largearrow-left-largearrow-right-large-greyarrow-right-large-yellowarrow-right-largearrow-right-smallbutton-arrowclosedocumentfacebookfacet-arrow-down-whitefacet-arrow-downPage 1CheckedCheckedicon-apple-t5backgroundLayer 1icon-google-t5icon-office365-t5icon-outlook-t5backgroundLayer 1icon-outlookcom-t5backgroundLayer 1icon-yahoo-t5backgroundLayer 1internal-yellowinternalintranetlinkedinlinkoutpauseplaypresentationsearch-bluesearchshareslider-arrow-nextslider-arrow-prevtwittervideoyoutube