CV

Curriculum Vitae & technical background. Download the PDF version using the icon on the right.

Basics

Name Rahul Anand Sharma
Label ML Systems Engineer & Researcher
Email rahulanandsharma@gmail.com
Phone 412-708-9085
Url https://rahul-anand.github.io
Summary ML Systems Engineer and Researcher specializing in hardware-software co-design, LLM inference acceleration, and distributed accelerator infrastructure (TPUs/GPUs). Ph.D. from CMU with 15+ publications at top systems venues (SIGCOMM, NSDI, USENIX Security) and 2 US patents. Track record of driving high-impact technical initiatives across Google Cloud, AWS, and Microsoft Research.

Work

  • 2025.08 - Present
    ML Systems Engineer
    Google Cloud
    Inference optimization and high-performance serving of Gemini models across GPUs and TPUs.
    • Driving inference optimization and serving performance for Gemini models across GPU and TPU platforms.
    • Previously led the TPU v7 (Ironwood) NPI microbenchmarking suite; bridged internal cluster infrastructure (Borg) with Cloud XLA runtimes, ported benchmarks from HLO to JAX, and executed multi-cube scaling analyses to model accelerator interconnect limits.
    • Delivered collective communication microbenchmarks and public recipes for the TPU v7 public preview, establishing interconnect scaling baselines that advanced multi-billion-dollar hardware evaluations with tier-1 frontier AI customers.
    • Spearheaded intra-node disaggregated serving for Gemini models on bare-metal nodes in Google Distributed Cloud (GDC) / Sovereign Cloud.
    • Architected automated continuous regression pipelines ensuring Borg-Cloud runtime parity; optimized open-source LLMs (Llama 3, DeepSeek) to land Day-1 3P hardware enablement (Sim-Ship), earning the Google Cloud Tech Impact Award (2026).
  • 2023.01 - 2025.07
    Applied Scientist
    AWS, Amazon
    Architected Generative AI-powered observability and diagnostics for big data systems and network security at hyperscale.
    • Architected and launched a Generative AI-powered auto-debugging system (Amazon Q) for Apache Spark across AWS Glue, Amazon EMR, and MaxDome, utilizing LLMs for automated root-cause analysis to slash Mean Time to Resolution (MTTR) from days to minutes.
    • Engineered a high-throughput active testing service for AWS network security, injecting synthetic live traffic to validate Network ACLs at scale, guaranteeing strict compliance and eliminating false-positive blindspots inherent to static simulation models.
    • Designed and integrated automated diagnostic tooling directly into AWS Glue and EMR management consoles, delivering real-time failure insights and actionable remediations to thousands of enterprise customers.
  • 2020.05 - 2021.07
    Research Intern
    Microsoft Research, Redmond
    Networking Research Group.
    • Architected low-latency distributed protocols for edge-cloud deep learning inference offloading within the Networking Research Group, minimizing communication overhead and end-to-end latency under bandwidth-constrained networks.
  • 2016.07 - 2018.07
    Research Fellow
    Microsoft Research, India
    Systems and networking research for edge computing, IoT, and AI.
    • Co-designed and built FarmBeats, an end-to-end IoT and cloud analytics platform for data-driven agriculture; awarded Microsoft Outstanding Technical Achievement Award and productized into Microsoft Azure (US Patent US20200150640A).
    • Pioneered DeepEdge, a novel edge-AI scheduling architecture optimizing deep learning workloads under severe compute and bandwidth constraints, enabling graceful performance degradation (US Patent US10942767B2; published at NSDI).
    • Researched neural network learnability with theoretical researchers, analyzing empirical bounds on how data complexity, model depth, and minibatch dynamics govern generalization.
    • Mentored 4+ research interns and junior engineers, driving collaborative systems research initiatives that resulted in multiple conference publications.

Education

  • 2018.08 - 2023.01

    Pittsburgh, PA

    Ph.D.
    Carnegie Mellon University
    Electrical & Computer Engineering
    • Thesis: Practical Network Layer Machine Learning for IoT Security
    • Advisors: Prof. Vyas Sekar & Prof. Anthony Rowe
  • 2011.07 - 2016.07

    Hyderabad, India

    B.Tech and M.S. by Research
    International Institute of Information Technology (IIIT)
    Computer Science
    • Computer Vision
    • Broadcast Video Analytics

Awards

Skills

Languages
Python
C++
CUDA
SQL
Bash
ML Frameworks & Compilers
JAX
PyTorch
XLA
Triton
TensorRT / TensorRT-LLM
TensorFlow
LLM Systems & Serving
Disaggregated Serving
vLLM
Model Parallelism (TP/PP/EP)
Distributed Training (FSDP, Megatron-LM)
KV-Cache Optimization
Speculative Decoding
Quantization (FP8/INT4)
Systems, Cloud & Hardware
Google Cloud TPU v7 (Ironwood)
NVIDIA GPU Clusters
Google Distributed Cloud (GDC)
AWS (Glue, EMR, EC2)
Apache Spark
Kubernetes
Docker
Ray

Publications

Patents

  • 2021
    Deep neural network workload scheduling
    US Patent 10,942,767
    Scheduling framework for optimizing deep learning inference workloads across heterogeneous edge and cloud compute under tight resource constraints.
  • 2022
    Sensor fall-curve identification
    US Patent 11,327,476 (US20200150640A1)
    Time-of-flight and RF signal fall-curve analytics for agricultural sensing and IoT infrastructure (Microsoft FarmBeats).

Talks

  • 2022
    Lumos: Identifying and Localizing Diverse Hidden IoT Devices in an Unfamiliar Environment
    USENIX Security • Boston, MA
  • 2022
    Lumen: ML-Based IoT Network Anomaly Detection
    CyLab & CONIX Annual Review • CMU, Pittsburgh, PA
  • 2020
    All that GLITTERs: Light Anchors for Augmented Reality
    ACM IPSN / CPS-IoT Week • Sydney, Australia (Virtual)
  • 2018
    FarmBeats: AI, Edge & IoT for Agriculture
    Microsoft Techfest • Redmond, WA
  • 2018
    Automated Top-View Registration of Broadcast Sports Video
    IEEE WACV • Lake Tahoe, NV