This event has ended. Create your own event on Sched.
Data to Action: Increasing the Use and Value of Earth Science Data and InformationFor 20 years, ESIP meetings have brought together the most innovative thinkers and leaders around Earth observation data, thus forming a community dedicated to making Earth observations more discoverable, accessible and useful to researchers, practitioners, policymakers, and the public.

The ESIP Summer Meeting has already taken place, but check out the ESIP Summer Meeting Highlights Webinar: https://youtu.be/vbA8CuQz9Rk.
Back To Schedule
Tuesday, July 16 • 10:15am - 11:45am
Big Gridded Data: The transition from legacy to next generation

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Feedback form is now closed.
This session aims to explore several dimensions of technology and operational systems that support archiving, cataloging, distributing, subsetting, and processing of large structured data. For this session, large structured data is defined as any data with well structured spatial, temporal, band, scenario, ensemble, dimensions and associated variables that exceed practical size constraints of commodity internet and personal computing resources. Typical examples are very high-resolution geospatial grids, outputs from ocean, landscape, weather and climate models, and multi-spectral remote sensing archives. Use cases for such data range from meta and reanalyses that require run-time access to entire datasets at once to ad-hoc investigations requiring small subsets of one or more dimension. For example, a local science project may need a small spatial subset of an ensemble climate projection or a remote sensing research project may need to sample 100 point locations from a all scenes of a multispectral remote sensing product. Data formats and computing Infrastructure to support this range of use cases, from terabyte and greater data access to custom small-subset extraction presents a great challenge especially as technology changes and what was a sound implementation and investment becomes dated and unable to meet modern expectations.

This session will feature speakers who manage operations and maintenance of archives of large structured data, build software and standards designed to meet the needs of a wide range of large structured data use cases, and researchers working to evaluate and demonstrate the potential of next generation technical solutions.

View Slides: https://doi.org/10.6084/m9.figshare.8939780

View Session Recording on YouTube.

avatar for Jay Su

Jay Su

IT Specialist, NOAA/NESDIS
Working at NOAA/NESDIS bridging science and engineering.
avatar for Rich Signell

Rich Signell

Research Oceanographer, USGS
avatar for Ed Armstrong

Ed Armstrong

Science Systems Engineer, NASA JPL/PO.DAAC

Tuesday July 16, 2019 10:15am - 11:45am PDT
Ballrm BC
  Ballrm BC, Panel
  • Area Big Data, Subsetting, Archiving
  • REMOTE PARTICIPATION LINK: https://global.gotomeeting.com/join/670434781
  • REMOTE PARTICIPATION PHONE #: United States: +1 (646) 749-3129 Australia: +61 2 8355 1050 France: +33 170 950 594 Norway: +47 21 93 37 51 Austria: +43 7 2081 5427 Germany: +49 692 5736 7317 Spain: +34 932 75 2004 Belgium: +32 28 93 7018 Ireland: +353 15 360 728 Sweden: +46 853 527 827 Canada: +1 (647) 497-9391 Italy: +39 0 230 57 81 42 Switzerland: +41 225 4599 78 Denmark: +45 32 72 03 82 Netherlands: +31 207 941 377 United Kingdom: +44 330 221 Finland: +358 923 17 0568 New Zealand: +64 9 280 6302 0088