As the scale of scientific research grows larger, so too do the barriers. Data-intensive and computation-heavy work across all fields can benefit from parallel computing and high-performance resources, but not everyone knows how to scale up from a laptop to a supercomputer.

Since its debut in 2017, Parsl has sought to remove these obstacles, integrating with the popular Python programming language to make it simple to parallelize code and utilize large-scale computer systems around the world. Researchers have used the software to search the universe for dark energy, study traumatic brain injuries in MRI data, and comb through billions of molecules for potential COVID-19 therapeutics.

Now, with two new grants, the project led by University of Chicago, Argonne National Laboratory, and University of Illinois scientists enters a new phase of sustainability, community, and outreach. Funding from the National Science Foundation and the Chan Zuckerberg Initiative (CZI) will support the growing open-source community around Parsl, integrate the software with popular tools used by disciplines such as biology, astrophysics, and materials science, and expand education and engagement for new users from a variety of backgrounds.

“We want to build up a community-governed project that’s owned and managed by the community,” said Kyle Chard, Research Associate Professor at UChicago CS and lead of Parsl. “We want to see it having an impact pervasively across research, and we want to democratize the ability for researchers to be able to run their analyses, their simulations, their machine learning models at much larger scales than they can do today, enabling them to very easily go from their laptop to a cloud or institutional cluster all the way up to a supercomputer.”

Parsl was among the first recipients of a new class of NSF Cyberinfrastructure for Sustained Scientific Innovation (CSSI) grants, Transition to Sustainability, aimed at helping established projects develop a sustainability plan for continuing to support science and engineering research. The award will help Parsl build upon an already robust community of GitHub contributors to the project, creating an on-ramp for new code and charter positions for representatives from different scientific domains. These project champions will function as a decentralized advisory and outreach committee for Parsl, help adapt the software for specialized use in new fields, and create online and in-person tutorials to increase the user base.

“We’ve been working on building this software to meet community needs for many years, and we’re excited to have this opportunity to be supported in transitioning the project and its governance to a more community-oriented approach,” said Daniel S. Katz, National Center for Supercomputing Applications (NCSA) Chief Scientist and Parsl co-founder in an NCSA article on the NSF grant.

The Chan Zuckerberg Initiative grant will also focus on new uses of Parsl in biomedical research, an area where the software has already shown great potential. In 2020, researchers from the Department of Energy and US Veteran Affairs used Parsl to conduct a massive genotyping study of data from nearly 500,000 subjects in the Million Veterans Program. Other groups have used the software to create workflows for analyzing medical images on supercomputers and studying whole-genome and transcriptome sequences to discover new risk factors and treatments for breast cancer.

In the next phase of the project, the Parsl team hopes to make it even easier for biomedical researchers to utilize the tool and scale up their research. The CZI award will enable the team to extend the software to work seamlessly with popular workflow languages such as WDL and CWL, so that researchers can create new programs from pre-published building blocks, simplifying the process of scaling research tasks from one computer to many.

“One of the things we’ve proposed is to integrate with tools that are widely used by the biomedical community,” Chard said. “Our hope is to augment that ecosystem with Parsl capabilities to basically enable biomedical workflows to run at much larger scales on increasingly heterogeneous computers. One of the driving philosophies behind Parsl is to meet researchers in their environment. That has underpinned our choice of Python and is influencing the direction here to integrate with common tools used in biomedicine.”

The expansion of the Parsl community was on display in September at Parsl and funcX Fest 2022, a two-day hybrid gathering of researchers, developers, and cyberinfrastructure experts from as far away as New Zealand and the United Kingdom. The event featured many lightning talks (viewable on YouTube) from users of Parsl and FuncX, its sister project that provides a platform for delegating computational tasks and data to remote resources.

Related News

More UChicago CS stories from this research area.
In the News

UChicago CS Researchers Share in Special Prize on COVID-19 Research

Dec 01, 2022
man browsing Netflix
UChicago CS News

Trending Now: How Netflix Chills Our Free Will

Nov 14, 2022
In the News

Alumnus Pranav Gokhale Named to Crain’s 40 Under 40

Nov 07, 2022
UChicago CS News

Prof. Diana Franklin Discusses Quantum Computing Education on Entangled Things Podcast

Nov 03, 2022
UChicago CS News

New UpDown Project Uses “Intelligent Data Movement” to Accelerate Graph Analytics

Oct 21, 2022
UChicago CS News

Civic Tech Pioneer James Turk Joins UChicago CS to Teach in MPCS, CAPP

Oct 06, 2022
UChicago CS News

Five UChicago CS Students Named to Siebel Scholars 2023 Class

Sep 22, 2022
UChicago CS News

UChicago Leads New Research Coordination Network for Promoting CS Reproducibility

Sep 16, 2022
UChicago CS News

UChicago CS Students Emily Wenger and Xu Zhang Receive Harper Fellowships

Sep 14, 2022
In the News

Internet Disconnect

Sep 13, 2022
UChicago CS News

UChicago/Argonne Computer Scientist Ian Foster Receives ACM/IEEE Ken Kennedy Award

Sep 07, 2022
UChicago CS News

UChicago/Argonne Researchers Will Cultivate AI Model “Gardens” With $3.5M NSF Grant

Aug 30, 2022
arrow-down-largearrow-left-largearrow-right-large-greyarrow-right-large-yellowarrow-right-largearrow-right-smallbutton-arrowclosedocumentfacebookfacet-arrow-down-whitefacet-arrow-downPage 1CheckedCheckedicon-apple-t5backgroundLayer 1icon-google-t5icon-office365-t5icon-outlook-t5backgroundLayer 1icon-outlookcom-t5backgroundLayer 1icon-yahoo-t5backgroundLayer 1internal-yellowinternalintranetlinkedinlinkoutpauseplaypresentationsearch-bluesearchshareslider-arrow-nextslider-arrow-prevtwittervideoyoutube