CV

Curriculum Vitae & technical background. Download the PDF version using the icon on the right.

Summary

ML Systems Engineer and Researcher specializing in LLM serving architecture, hardware-software co-design, and distributed accelerator infrastructure (TPUs/GPUs). Ph.D. in ECE from Carnegie Mellon University with 15+ publications at top systems and security venues (SIGCOMM, NSDI, USENIX Security) and 2 US patents. Track record of architecting and scaling high-impact AI systems across Google Cloud, AWS, and Microsoft Research.

Professional Experience

  • 2025 – Present

    Mountain View, CA

    ML Systems Engineer · Google Cloud
    Technical lead for Gemini inference optimization, Sovereign Cloud disaggregated serving, and TPU v7 (Ironwood) multi-cube scaling.
    • Gemini Serving & Runtime Optimization: Driving cross-stack inference performance for Gemini models across GPU and TPU fleets, targeting XLA/runtime bottleneck elimination, KV-cache memory efficiency, and end-to-end TTFT/TPOT latency.
    • Sovereign Cloud Disaggregated Serving (GDC): Spearheaded the intra-node (4:4 prefill/decode split) disaggregated serving architecture for Gemini on bare-metal nodes in Google Distributed Cloud, overcoming strict air-gapped memory isolation and control-plane constraints.
    • TPU v7 (Ironwood) Architecture & Interconnect Scaling: Architected the NPI microbenchmarking suite bridging internal Borg clusters with Cloud XLA/JAX runtimes; executed multi-cube scaling analyses and collective communication (AllReduce/AllGather/AllToAll) modeling that anchored multi-billion-dollar hardware evaluations with tier-1 frontier AI customers.
    • Day-1 Frontier Model Enablement (Google Cloud Tech Impact Award, 2026): Built automated continuous regression pipelines enforcing Borg-Cloud runtime parity and led XLA/kernel optimizations for open-weight LLMs (Llama 3, DeepSeek) to land Day-1 hardware Sim-Ship.
  • 2023 – 2025

    Palo Alto, CA

    Applied Scientist · AWS, Amazon
    Architected LLM-powered distributed diagnostics for hyperscale data processing and active verification for cloud network security.
    • Hyperscale Spark Auto-Debugging (Amazon Q): Architected and launched a Generative AI root-cause analysis system for Apache Spark across AWS Glue, Amazon EMR, and internal compute fleets, slashing customer Mean Time to Resolution (MTTR) from days to minutes.
    • Active Cloud Network Verification: Engineered a high-throughput active testing service for AWS network security, injecting synthetic live traffic to validate Network ACLs at scale and eliminating false-positive blindspots inherent to static reachability models.
    • Production Control-Plane Integration: Designed and shipped real-time diagnostic and remediation pipelines directly into AWS Glue and EMR consoles, serving thousands of enterprise analytics workloads.
  • 2016 – 2021

    Redmond, WA & Bangalore, India

    Research Intern (Redmond) & Research Fellow (India) · Microsoft Research
    Distributed systems, edge-cloud DNN inference scheduling, and IoT analytics (Fellow 2016–2018; Ph.D. Intern 2020–2021).
    • Edge-Cloud DNN Scheduling (DeepEdge & Networking Group): Pioneered distributed scheduling and low-latency offloading protocols for deep learning inference under severe compute and WAN bandwidth constraints (published at USENIX NSDI '19; granted US Patent 10,942,767).
    • FarmBeats IoT Platform (Microsoft Outstanding Technical Achievement Award): Co-designed and built an end-to-end RF/sensor and cloud analytics platform for data-driven agriculture; productized into Microsoft Azure, featured on GatesNotes, and granted US Patent 11,327,476.
    • Research Mentorship: Mentored 4+ research interns and junior engineers across systems and theoretical ML learnability initiatives, resulting in multiple top-tier publications.

Education

Technical Expertise

LLM Serving & Distributed ML Disaggregated Serving (Prefill/Decode) · KV-Cache Optimization · Model Parallelism (TP/PP/EP) · Collective Communication (ICI/DCN) · vLLM · FSDP / Megatron-LM · Speculative Decoding · Quantization (FP8/INT4)
Compilers, Frameworks & Kernels JAX · XLA / HLO · PyTorch · Triton · TensorRT-LLM · CUDA · C++ · Python
Accelerator & Cloud Infrastructure Google Cloud TPU (v4/v5p/v7 Ironwood) · NVIDIA GPU Clusters · Google Borg · Google Distributed Cloud (GDC / Air-Gapped) · AWS (Glue, EMR, VPC/Network Security) · Kubernetes · Ray · Apache Spark

Honors & Awards

  • 2026
    Google Cloud Tech Impact Award
    Google Cloud
    Recognized for TPU v7 (Ironwood) collective scaling baselines, Borg-Cloud runtime parity, and Day-1 frontier LLM enablement (Sim-Ship).
  • 2018
    Microsoft Outstanding Technical Achievement Award
    Microsoft
    Recognized for co-designing and building FarmBeats, productized into Microsoft Azure and featured by Bill Gates.
  • 2018
    CIT Dean's Fellowship
    Carnegie Mellon University
    Presidential/Dean's doctoral fellowship awarded by the College of Engineering at Carnegie Mellon University.

Selected Publications

Granted US Patents

  • 2021
    Deep neural network workload scheduling
    US Patent 10,942,767
    Scheduling architecture for optimizing deep learning inference workloads across heterogeneous edge and cloud compute under resource constraints.
  • 2022
    Sensor fall-curve identification
    US Patent 11,327,476 (US20200150640A1)
    Time-of-flight and RF signal fall-curve analytics for agricultural sensing and IoT infrastructure (Microsoft FarmBeats).

Invited Talks

  • 2022
    Lumos: Identifying and Localizing Diverse Hidden IoT Devices in an Unfamiliar Environment
    USENIX Security • Boston, MA
  • 2022
    Lumen: ML-Based IoT Network Anomaly Detection
    CyLab & CONIX Annual Review • CMU, Pittsburgh, PA
  • 2020
    All that GLITTERs: Light Anchors for Augmented Reality
    ACM IPSN / CPS-IoT Week • Sydney, Australia
  • 2018
    FarmBeats: AI, Edge & IoT for Agriculture
    Microsoft Techfest • Redmond, WA