Full Stack Roboticist

Rajdeep Singh

I am a second year M.S. Robotics student at the GRASP Lab, University of Pennsylvania advised by Prof. M. Ani Hsieh. Before Penn, I spent 5+ years as a Software Engineer, where I led data engineering and machine learning infrastructure serving millions of daily active users. I now bring that experience to robotics research.

My research focuses on learning-based control for manipulators, currently exploring physics-informed neural ODEs for learning unmodeled dynamics and improving predictive control of manipulators. More broadly, I'm interested in the field of robotic manipulation and love to use MPC, RL and Imitation based controls in my toolbox.

Portrait of Rajdeep Singh

Research

RL and VLA Policies
Online RL training for Flow-Based VLA Policies

Ongoing Research, University of Pennsylvania

Exploring flow-based VLA policy improvements with RL, and whether privileged critics can help those policies generalize on real hardware without a supervised fine-tuning stage between simulation and deployment.

KNODE-MPC for an Underwater Manipulator
KNODE-MPC for an Underwater Manipulator

Advisor: Prof. M. Ani Hsieh

Ongoing Research, ScalAR Lab, University of Pennsylvania

This is a research project that I am leading, with two distinct but tightly coupled parts:
(1) Building complete software stack for a custom 4 DoF manipulator with waterproof motors, and an underwater mocap setup for data collection.
(2) Research around extending KNODE-MPC to support manipulators, using neural ODEs to learn buoyancy, hydrodynamic drag, and other unmodeled fluid forces to improve the MPC.

RAVEN: Long-Horizon Reasoning and Navigation with a Visuo-Spatio-Temporal Memory
RAVEN: Long-Horizon Reasoning and Navigation with a Visuo-Spatio-Temporal Memory

Y. Hu, Z. Zheng, L. Zha, C. Xing, Rajdeep Singh, O. Hossain, A. Loquercio, D. Shah

arXiv preprint, under review, 2026

This work emerged as a byproduct of our efforts on DARPA’s Abstract Planning and Semantic Understanding challenge. For this work, I built the simulation and evaluation infrastructure for testing semantic navigation in Habitat Sim and supporting the HSSD dataset in the pipeline, enabling systematic evaluation of our approaches.

AeroDaaS: An Application Programming Platform for Drones-as-a-Service
AeroDaaS: An Application Programming Platform for Drones-as-a-Service

Suman Raj, Rajdeep Singh, Kautuk Astu, Yogesh Simmhan

IEEE International Conference on Web Services (ICWS), 2025

A hardware-agnostic, declarative programming model for UAVs, with native support for ML workloads across the edge-cloud continuum. We evaluated it in ROS 2, Gazebo, and PX4, and on Jetson Orin Nano and DJI Tello hardware, including real-time vision pipelines built with OpenCV, MediaPipe, and YOLO.

Projects

Panda Pick and Place Competition
Panda Pick and Place Competition

Rajdeep Singh, Morgan Bauer, Dayoon Suh, Ishita Munshi

MEAM 5200: Introduction to Robotics - Final Competition

Course competition on a Franka Emika Panda arm involving vision based pick-and-place. Developed and validated the complete manipulation pipeline, from grasp planning to motion execution in Gazebo, and on real hardware, including implementing forward and inverse kinematics from scratch.

Autonomous Drone Racing with Reinforcement Learning
Autonomous Drone Racing with Reinforcement Learning

Rajdeep Singh, Dmitri Dobrynin

Ranked top 7 out of 40 teams in both the simulation and real competitions

ESE 6510: Physical Intelligence - Final Competition

For the final competition of the course, we competed in a drone racing challenge using a Crazyflie, where the goal was to maximize real-world racing performance. Implemented PPO from scratch, experimented with reward shaping and techniques from recent RL literature, and developed a curriculum-based training strategy in Isaac Lab. Used domain randomization to transfer the learned policy from simulation to the real Crazyflie.

Timeline

Coursework (during Masters)

Fall 2026

  • MEAM 5170: Control and Optimization with Applications in Robotics
  • ESE 6150: RoboRacer Autonomous Racing Cars
  • CIS 6270: Discrete Generative Models (audit)

Spring 2026

  • ESE 6510: Physical Intelligence (Deep Reinforcement Learning in Robotics)
  • ESE 6500: Learning in Robotics (State Estimation and SLAM)
  • MEAM 6230: Controls for Adaptive and Reactive Robots

Fall 2025

  • ENM 5500: Mathematics for Robotics
  • CIS 5200: Machine Learning
  • MEAM 5200: Introduction to Robotics
  • ESE 5460: Principles of Deep Learning (audit)