ProjectsAtlas Engine

Atlas Engine

Data infrastructure platform for petabyte-scale analytics pipelines.

RUSTDOCKERGOKUBERNETESTERRAFORMPOSTGRESQL
Source Code

A distributed compute engine built on Kubernetes that orchestrates batch and streaming workloads across global regions.

Highlights

  • Custom scheduling atop K8s for cost-efficient batch jobs
  • Exactly-once semantics via idempotent state stores
  • Terabyte-scale ingestion at 40GB/s sustained throughput
Case Study

Role

Distributed Systems Engineer

Timeline

2022-11 — 2024-02

Tech Stack

  • Rust
  • Docker
  • Go
  • Kubernetes
  • Terraform
  • PostgreSQL

Project Status

In Production