CV

Experience, education, research and skills.

Contact Information

Name Shubham Gupta
Professional Title Researcher and Engineer

Professional Summary

Researcher and engineer working on Edge AI and on-device LLMs, with experience spanning LLM inference optimization, automotive voice assistants, and applied machine learning research.

Experience

  • 2021 - present

    Sunnyvale, CA

    Software Development Engineer 2
    Amazon Lab126
    LLM inference on edge hardware and voice assistant features for Amazon smart vehicles.
    • Optimized, quantized and deployed LLMs on edge hardware, maintaining 93% accuracy on internal benchmarks. Applied mixed-precision quantization and speculative decoding to accelerate token generation under tight on-device memory and latency budgets. Shipped as part of CES 2026.
    • Profiled device-converted LLMs on NPU and CPU targets across multiple automotive chip vendors. Benchmarked latency, memory footprint and accuracy trade-offs to drive model selection decisions for production deployment.
    • Created a facial recognition system for in-vehicle profile selection and contributed to in-vehicle LLM trip planning and playlist curation with Claude Sonnet, showcased at CES 2025.
    • Developed C++ APIs enabling voice assistant integration with third-party apps for automotive navigation and search, including start and stop navigation, waypoints, and context retrieval.
  • 2020 - 2020

    Boston, MA

    Software Engineering Intern
    VMware Inc.
    • Created a C++ data transport plugin for lightweight delta snapshots enabling efficient and scalable VM data protection by backup to cloud providers such as AWS S3. Created design UMLs and test drivers on ESX using Python.
  • 2018 - 2019

    Delhi, India

    Research Associate
    Precog Research Lab, IIIT Delhi
    • Developed a full-stack social media analytics tool using Python, JavaScript and MongoDB, containerized with Docker on Linux for 250% faster deployments.
    • Built an Ethereum blockchain based decentralized crowdsourcing platform using Solidity and React, with a decentralized reputation scoring system for high quality participation.
    • Administered Ubuntu and Linux server machines for lab projects.
  • 2016 - 2016

    Geneva, Switzerland

    Openlab Summer Student (Software Intern)
    CERN Openlab
    • Developed a consistency verification tool using PL/SQL for metadata databases, reducing redundancies and increasing efficiency for the Compact Muon Solenoid experiment.

Education

  • 2019 - 2021

    Pittsburgh, PA

    Master of Science
    Carnegie Mellon University, Information Networking Institute
    Information Security
  • 2013 - 2017

    Delhi, India

    Bachelor of Technology
    Maharaja Agrasen Institute of Technology
    Computer Science

Publications

  • 2025
    Running Large Models on Small (Edge) Devices
    Poster, Stanford Graph Learning Workshop

    Inference optimization for edge model deployment, covering custom KV caching, speculative decoding, mixed-precision quantization, and quantization-aware training, and how they increase accuracy and token generation throughput for edge LLMs.

  • 2026
    Speciesism in the Assistant Axis: Probing Compassion Vectors in Post-Trained LLMs
    Poster, MLSys Young Professionals Symposium

    With Jasmine Brazilek. Extracted assistant, human-compassion and animal-compassion persona vectors from Qwen3-32B served with vLLM on 4xL40S GPUs. Projected activations onto these axes and quantified speciesism between human and animal compassion.

  • 2020
    Investigation of Biases in Identity Linkage Datasets
    ACM Symposium on Applied Computing (SAC '20)

    With Rishabh Kaushal and Ponnurangam Kumaraguru. Machine learning models used to find similarity in large self-collected social media username datasets.

  • 2020
    WorkerRep: Immutable Reputation System for Crowdsourcing Platform Based on Blockchain
    arXiv

    With Gurpriya Kaur Bhatia, Alpana Dubey and Ponnurangam Kumaraguru. A decentralized reputation system for crowdsourcing platforms built on the Ethereum blockchain.

  • 2020
    A Survey of Typo-Squatting Attacks in Development Ecosystems
    Course project, Network Security, Carnegie Mellon University

    A survey of typo-squatting attacks across software development ecosystems. Awarded best paper in the class.

  • 2016
    Database Consistency Verification for CMS Metadata
    CERN Openlab report, Zenodo

    With Valentin Kuznetsov, Katarzyna Maria Dziedziniewicz-Wojcik and Nicolò Magini. A cross-consistency tool providing periodic updates about discrepancies between two CMS metadata databases, DBS and PhEDEx.

Projects

  • Optimized Multithreaded Web Server

    Web server on Linux in C, optimized with prethreading, dynamic linking and code caching. Used pthreads mutexes for multithreading and gdb for debugging. Improved server throughput by 500%.

  • REST API Based Distributed File System

    Distributed file system using naming and storage servers, with Python Flask REST API endpoints to parse and respond to JSON requests.

Skills

Programming Languages: Python, C++, C
Tools and Technologies: PyTorch, vLLM, TensorRT, Transformers (HuggingFace), Docker, Linux, Git
Courses: BlueDot Technical AI Safety and AGI Strategy