Skip to content
View greensh16's full-sized avatar
🌤️
🌤️
8 followers · 4 following

Achievements

Achievement: YOLOAchievement: QuickdrawAchievement: Pull Sharkx2Achievement: Arctic Code Vault Contributor

Achievements

Achievement: YOLOAchievement: QuickdrawAchievement: Pull Sharkx2Achievement: Arctic Code Vault Contributor

Highlights

  • Pro

Block or report greensh16

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
greensh16/README.md

Sam Green

Research Software Engineer / Computational Specialist ARC Centre of Excellence for the Weather of the 21st Century — UNSW Sydney 🇦🇺

ORCID Zenodo 21st Century Weather

I build the computational machinery that climate and atmospheric science runs on: HPC pipelines, ML surrogates for physical models, and data engineering at the TB-to-PB scale. PhD in computational astrophysics; these days the fluid dynamics happen closer to the ground.

What I work on

  • ML for the atmosphere — CFD surrogates, neural compression, and physics-informed architectures on H200 GPUs
  • HPC scientific computing — PBS Pro on NCI Gadi, Slurm on Pawsey Setonix; Apptainer/Singularity, Lustre & GPFS I/O tuning
  • Scientific data engineering — xarray · Dask · Zarr · Pipelines for ERA5, MERRA-2, BARRA2, OISST, 20CRv3
  • Research tooling — Rust CLIs and web dashboards that make shared systems less painful for the people using them I care a lot about operational elegance: tools that deploy cleanly on shared systems, respect inode budgets, and don't fall over at 3am.

Selected projects

Project What it is
HPC Dashboard DOI Web dashboard tracking job efficiency, queue behaviour and resource utilisation across the Centre's allocations.
logger-rs DOI High-performance telemetry collection for HPC jobs, written in Rust.
Feilian-3D DOI 3D U-Net CFD surrogate predicting volumetric urban wind fields, with FiLM conditioning on inflow direction. Trained across 355 urban domains.
TRACE / AtmosCodec Transformer Reanalysis Atmospheric Compression Engine — a Swin-Transformer VAE neural codec for MERRA-2 and ERA5 reanalysis, built on CompressAI.
rudu DOI Parallel disk-usage tool in Rust. Rayon-based, reports allocated-block usage — built for HPC filesystems where du gives up.
zarr-dump DOI A CLI tool for inspecting Zarr v2/v3 stores and printing their metadata in a familiar NetCDF-style header format (similar to ncdump -h)

Recent publications & software

Full record: ORCID 0000-0003-1129-4676

Toolbox

Languages Python · Rust · Bash Scientific stack xarray · Dask · NumPy · Numba · Zarr · Kerchunk · cuDF ML PyTorch · DDP/torchrun · CompressAI · NVIDIA PhysicsNeMo Infrastructure PBS Pro · Slurm · Apptainer/Singularity · GitHub Actions · Docker

Currently

  • Scaling Feilian-3D
  • Extending TRACE from MERRA-2 to ERA5, with an eye on CMIP6/7
  • Making the Centre's dataset pipelines fail loudly instead of silently
  • Preparing the release of the HPC Dashboard and logger-rs

📍 Sydney, NSW · sam.green@unsw.edu.au · 21centuryweather.org.au

Pinned Loading

  1. hpc_dashboard_public hpc_dashboard_public Public

    The public version of the hpc dashboard repo to share the binaries.

    1

  2. logger-rs logger-rs Public

    High-performance telemetry collection for HPC jobs, written in Rust.

    Rust 1

  3. 21centuryweather/dask_setup 21centuryweather/dask_setup Public

    HPC-tuned Dask helpers for **NCI Gadi** and other PBS/SLURM systems. Wraps `dask.distributed.LocalCluster` + `Client` with sensible defaults for single-node jobs, and extends to multi-node PBS/SLUR…

    Python 1

  4. rudu rudu Public

    rudu is a high-performance, Rust-powered replacement for the traditional Unix du (disk usage) command. It was built to provide a safer, faster, and more extensible alternative for scanning and anal…

    Rust 2

  5. zarr-dump zarr-dump Public

    A command-line tool for inspecting and summarizing Zarr store metadata, displaying information in a familiar NetCDF-style format.

    Rust 4

  6. coecms/NetworkScore coecms/NetworkScore Public

    This is a python program that builds a network (graph) of nodes on a plane and uses an xarray dataset of events at the grid locations.

    Python