We are a home for Earth science data and computing professionals. Our sessions bring together the community for hands-on, interdisciplinary deep dives as we explore "Innovation to Impact" this year. Learn more about ESIP: esipfed.org
Session Description As cloud technologies evolve, the Earth science community must balance capacity building for foundational tooling with investing in what’s new. New technologies are often considered risky as they may be unstable and untested, but their potential is too great to ignore.
This two-part session will include presentations in part 1 and a working session in part 2. Part 1 presentations will introduce attendees to both established tools and practices (e.g., Xarray, Dask, Jupyter) and newer methods which have transformative potential (e.g., Jupyter-GIS, Icechunk). The popularization of virtualization via index caching for optimized querying and subsetting will be a primary focus of the emerging technologies section. As archives of cloud data continue to grow, virtualization and smart indexing of this data will become critical to optimizing access in the IO-bound nature of data on the cloud.
Part 2 will include parallel working sessions on foundational technologies and virtualization/indexing methods for participants to gain deeper understanding.
Looking forward, the cloud computing cluster would like to tackle the still current challenge of migrating data to the cloud and making it accessible. During the ESIP summer meeting, we'll collect input from both data providers and users through targeted surveys documenting migration contexts, goals, challenges, solutions and usage pain points. This feedback will inform roundtable discussions and potentially a white paper examining large-scale cloud data accessibility from multiple stakeholder perspectives.
Value to Session Participants Participants will learn about existing and emerging cloud computing technologies and connect with other practitioners and developers.
Recommended Ways to Prepare for the Session None provided
Brianna is first and foremost an environmentalist with a passion for making science accessible and understandable to the masses. She brings over a decade of experience working from local to international environmental efforts, in a broad-range of groups including start-ups, research... Read More →
Talk to me about enabling horizontally scaling cloud solutions to work with climate or other large earth data effectively using the open source Pangeo community tools (e.g. xarray, Dask, holoviz, kerchunk).
