Big data cloud computing for the Surface Water and Ocean Topography project CL24_5640.pdf

Big data cloud computing for the
Surface Water and Ocean
Topography project

1. © 2024 California Institute of Technology. Government sponsorship acknowledged.
IAC 2024 -
Milan
IAC 2024 - Milan
Presented by: Parag Vaze
On behalf of SWOT project &
science teams at NASA and CNES
Big data cloud computing for the
Surface Water and Ocean
Topography project
Please see
SWOT.JPL.NASA.G
OV
for more
information
© 2024 California Institute of Technology. Government sponsorship acknowledged.

2. SWOT detects ocean features with 10
times better resolution than current
technologies.
Wide swath
technology
enables
SWOT to cover
Earth’s ocean,
large lakes,
rivers, and
reservoirs at
least twice
every 21 days
Launched - December
2022
SWOT is making the first global survey of Earth's surface water,
observing the fine details of the ocean's surface topography, and
measuring how continental water bodies change over time.
© 2024 California Institute of Technology. Government sponsorship acknowledged.

3. © 2024 California Institute of Technology. Government sponsorship acknowledged.
IAC 2024 -
Milan
Mission Architecture
•Ka-band SAR interferometric (KaRIn)
system with 2 swaths, 50 km each
•Produces heights and co-registered all-
weather imagery and elevations
•50m resolution for surface
water
•1 km resolution over the
oceans
•Use conventional Jason-class altimeter
for nadir coverage, radiometer for wet-
tropospheric delay, and GPS/DORIS/LRA
for POD.
•On-Board interferometric SAR
processing over the ocean (500m
2

resolution) for data vol. reduction.
•Partnered mission: NASA, CNES, UKSA
& CSA
•Science mission duration of 3 years
•Cal orbit: 857 km, 77.6º Incl., 1 day
repeat
•Science orbit: 891 km, 77.6º Incl., 21
day repeat
•Flight System: ~2400kg, ~2100W
•Launch Vehicle: SpaceX Falcon-9
(Block 5)
•Target Launch Readiness: November
2022
Mission Overview

4. © 2024 California Institute of Technology. Government sponsorship acknowledged.
IAC 2024 -
Milan
•SWOT ground
system leverages:
•CNES downlink
stations.
•NASA and CNES
mission operations
for platform and
payload-specific
commanding and
expertise.
•NASA and CNES
expertise for
development of
science data
algorithms.
•NASA and CNES
ground processing
of science data
products.
•NASA and CNES
science data
distribution centers
to reach global
community.
NASA/CNES Partnership Leveraged for End-To-
End SWOT Ground System
.
4

5. © 2024 California Institute of Technology. Government sponsorship acknowledged.
IAC 2024 -
Milan
SWOT Engineering Firsts @ NASA/JPL
•First 2,000 W Ka-band Interferometric SAR (KaRIn)
•Deployable Antenna Assembly with a 0.004 Deg co-
alignment stability, over a 10 m baseline
•Precision alignment mechanisms capable of adjusting
antenna pointing to 0.0001 Deg
•First on board real-time interferometric processing
•Thermal stability of less than 0.05
o
C/minute while
rejecting more than 1000W of waste heat
•Largest deployable dual reflectarray antenna in
space each 5m x 0.25 m
•First Xband antenna transmitting high data rate (620
Mbps) without the use of a gimbal mechanism
5

6. © 2024 California Institute of Technology. Government sponsorship acknowledged.
IAC 2024 -
Milan
Comparison of SSH from AVISO altimetry data product
(left) with SSH from SWOT KaRIN and nadir altimeter
(right)
KaRIn data are available on 2 km grids as well
as 250 m grids

7. © 2024 California Institute of Technology. Government sponsorship acknowledged.
IAC 2024 -
Milan
7
High Level Mission Operations Timeline

8. © 2024 California Institute of Technology. Government sponsorship acknowledged.
IAC 2024 -
Milan
•KaRIn downlinks low-rate data globally.
•Aimed towards oceanography.
•KaRIn downlinks high-rate data over
configurable mask.
•Aimed towards hydrology.
•Covers most, but not all, inland bodies.
•High-rate data downlink limited by capacity
of available downlink stations and on-board
storage.
•Two “natural hazards” events prevented
data recovery from two downlink
stations, forcing significant reduction in
collection & downlink of high-rate data.
High Data Volume from Ka-band Radar
Interferometer (KaRIn) Stretches Robustness of
Downlink Station Architecture
.
8
Nominal KaRIn High-Rate (HR) Downlink Mask
Aug 11- Sep 15,
2023
•HR Mask reduced to
50% of nominal.
•Wildfires at Inuvik
Ground Station
(Canada).
March 15 – April 30,
2024
•HR Mask reduced to
75% of nominal.
•Damaged
submarine internet
cables to
Hartebeesthoek
Ground Station (S.
Africa).

9. © 2024 California Institute of Technology. Government sponsorship acknowledged.
IAC 2024 -
Milan
•Significant post-launch evolution of KaRIn algorithms expected for first-
of-its-kind instrument.
•Quality of KaRIn science data products will benefit from regular reprocessing of
products with ongoing evolution of processing algorithms.
•Pre-launch development using limited simulated data and assumptions about
phenomenology.
•Joint NASA/CNES KaRIn algorithm development team.
•High heritage instruments benefit from extensive NASA/CNES experience and
collaboration.
•NAlt, AMR, DORIS, GPSP, LRA have strong heritage from Jason-series and Sentinel-6 Michael
Freilich missions.
Complex SWOT Measurement System Leverages
Experience of Joint NASA/CNES Science Data
Algorithm Team
.
9
Tracking Systems
•GPS Payload
(GPSP)
•Laser
Retroreflector
Array (LRA)
•DORIS
Ka-Band Radar
Interferometer
(KaRIn)
Nadir Altimeter
(NAlt)
Advanced
Microwave
Radiometer
(AMR)

10. © 2024 California Institute of Technology. Government sponsorship acknowledged.
IAC 2024 -
Milan
•Joint JPL/CNES Algorithm Development Team (ADT)
responsibilities :
•18 SWOT science data products.
•4 Oceans products.
•9 Hydrology products.
•5 tracking data, attitude and orbit determination public products.
•Science Algorithm Software (SAS).
•Generates science data products by processing downlinked
instrument telemetry data.
•User Documentation.
•User Handbook.
•Product Description Documents.
•Algorithm Theoretical Basis Documents.
SWOT Science Data Product
Overview
10

11. © 2024 California Institute of Technology. Government sponsorship acknowledged.
IAC 2024 -
Milan
SWOT Ocean Products from KaRIn, Nadir
Altimeter, and Microwave Radiometer
11
Global KaRIn Sea
Surface Height
Product
Complementary KaRIn and
Nadir Altimeter Ocean
Products
Nadir Altimeter Sea
Surface Height
Product
Microwave Radiometer Wet
Troposphere Content Product

12. © 2024 California Institute of Technology. Government sponsorship acknowledged.
IAC 2024 -
Milan
Hydrology Products from KaRIn Provide High Resolution
Measurements of Inland Water Surface Classification,
Elevation and Extent
12
L1B Single Look
Complex
•Synthetic Aperture
Radar (SAR) image
from each of two
receiving antennas.
•Aimed towards radar
experts.
•5 m along-track.
•10 (outer) to 70 m
(inner) cross-track.
Level 2 Pixel
Cloud
•Geolocated height
and water
classification.
•22 m along-track
•10 (outer) – 70 m
(inner) cross-track.
Level 2 River
•Geolocated water surface elevation, width,
water surface area, reach slope, river
discharge.
•Aggregates Pixel Cloud measurements into river
reaches 5 – 20 km long, and river nodes at ~200 m
spacing.
•Provided only for rivers in Prior River Database
(PRD).
•Two products: Single Pass and cycle average
Level 2 Lake
•Geolocated water surface elevation, water
surface area, and storage change, polygon
defining shape of water body with ~22m
posting.
•Aggregates Pixel Cloud measurements into water
bodies.
•Provided for lakes in Prior Lake Database (PLD) and
water features not in PRD or PLD.
•Two products: Single Pass and cycle average
Pixel Cloud Aggregation to Lakes
Pixel Cloud Aggregation to Rivers
Level 2 Raster
•Uniform grids of 100 m and 250 m
resolution.
•Provides water surface elevation, area,
backscatter.
•Useful for internal spatial variability not in
river/lake products, e.g., flood events..

13. © 2024 California Institute of Technology. Government sponsorship acknowledged.
IAC 2024 -
Milan
Willamette River, Oregon: Detailed View
13
•SWOT
observing
more than
open water.
•Adds complexity
to ground
processing.
Single Look
Complex
Power
Product
Pixel Cloud
Product:
Water
Classification
Pixel Cloud
Product:
Open Water
Heights
Wet fields are
bright

14. © 2024 California Institute of Technology. Government sponsorship acknowledged.
IAC 2024 -
Milan
14
Description:
Reports daily averages of the same metrics from the previous sheet "Daily
Volume by Processing Level"
SWOT Daily Average Data Volume (by
processing level)

15. © 2024 California Institute of Technology. Government sponsorship acknowledged.
IAC 2024 -
Milan
15
SWOT Daily Volume (by processing level)

16. © 2024 California Institute of Technology. Government sponsorship acknowledged.
IAC 2024 -
Milan
16
SWOT Cumulative Data Volume (by processing
level)

17. © 2024 California Institute of Technology. Government sponsorship acknowledged.
IAC 2024 -
Milan
The richness of scales resolved by
SWOT
Courtesy Matt
Archer
Wavelengths
~ 1 km
250 m posted
data
© 2024 California Institute of Technology. Government sponsorship acknowledged.

18. © 2024 California Institute of Technology. Government sponsorship acknowledged.
IAC 2024 -
Milan
SWOT-measured mean water surface elevation on global lakes SWOT-measured mean water surface elevation on global lakes
during January to May 2024 during January to May 2024
Lake WSE mean
(1-std., m)
No or invalid
obs.
•Lake extents in the map
are based on the SWOT
Prior Lake Database (PLD).
•Lake WSEs are processed
from LakeSP_Prior (v2.0)
during the science orbit
cycles 10 to 15
(01/25/2024 to
05/20/2024).
During the past 4 months (6 orbit cycles),
2,872,216 out of the 5,898,331 prior lakes,
accounting for 89% of the global lake
area with a minimum size of 1 ha, were
observed with at least one valid
measurement by SWOT.
Valid observations exclude
1)statistical outliers, and
2)off-nominal measurements.
Jida Wang (U of Illinois),
et al.

19. © 2024 California Institute of Technology. Government sponsorship acknowledged.
IAC 2024 -
Milan
SWOT measures ocean topography with high resolutions
in the presence of sea ice for the study of polar ocean
circulation and its effects on sea ice dynamics.

20. © 2024 California Institute of Technology. Government sponsorship acknowledged.
IAC 2024 -
Milan
Summary
•Successfully completed 1.8yrs of mission ops,
with no significant issues
•All systems are healthy and meeting/exceeding
requirements and science expectations
•All science data products are being produced and
distributed freely and continually released
•Algorithm and calibration updates are continually
improving particularly with the first of a kind
hydrology measurements
•Mission results have sparked tremendous science
and applications interest beyond the core mission
(ocean, hydrology) science community such as:
coastal, cryosphere, marine geodesy,….