NVIDIA - Learning and Perception Research group (May 2026)
I worked in a variety of projects broadly under the robot perception umbrella. We first developed MG-VQA, an interactive manipulation grounded spatial reasoning benchmark for tool-calling VLMs, lifting static perception to dynamic environments. This project involved developing a simulation environment in PyBullet with Blender as the high quality renderer for VLM-facing tools. We leveraged grasp pose estimation with GraspGen, and designed a pushing primitive that allows VLMs to point to objects and push them in directions to declutter the workspace. This benchmark is now publicly released, and is also used for internal evaluations at NVIDIA.
