Awarded Amazon Research Awards 2018

A proposal I contributed to (with Ryan Julian) for the Amazon Research Awards was recently awarded to our lab (PI: Dr. Gaurav Sukhatme)!

See full list of awardees here.

Inverse Reward Design

Gave a presentation to Machine Learning folks on Inverse Reward Design, starting with a (very) brief survey of Deep RL

Inverse Reinforcement Learning in Java (using BURLAP)

Inverse Reinforcement Learning for automated grading

This spring semester, I did research on using Inverse Reinforcement Learning to learn a skill and test users, thereby creating automated graders for testing these skills. This is applied to sensorimotor (physical) skills, and a proof of concept is shown for a toy problem of navigating a car in a parking lot. See the presentation and links below for more details.

Other useful links:
PDF of slides
Code: https://github.com/gautams3/IRL_IntelligentGrading

Path planning in Atlanta

This was for a graduate course in Artificial Intelligence

Traditional A* search on real data: Directions from Dept of Mech Engg, Georgia Tech, to 798 Drewry St NE, Atlanta GA. The orange nodes are the final path, the black nodes are the ones that were also explored in A* (zoom in to see individual nodes)


Bidirectional A* for getting the directions from GT College of Computing to Home Depot (650 Ponce De Leon Pl NE, Atlanta, GA 30308).

List of Publications

1. Model-based controller design and simulation of a marine chiller
   Master's Thesis, The University of Texas at Austin
   PDF
2. Salhotra, G., Bajpai, V., Singh, R. K., Finite Element Modeling of Orthogonal Cutting of Pyrolytic Carbon, ASME 2011 International Manufacturing Science and Engineering Conf., Corvallis, OR
   PDF
3. Bajpai, V., Salhotra, G., and Singh, R., Micromachining Characterization of Anisotropic Pyrolytic Carbon, Inst. Of Mech Engr Journal of Engineering Manufacture, 225:9 (2011)
   PDF
4. Bajpai, V., Salhotra, G., and Singh, R., Orthogonal Micro-grooving of Anisotropic Pyrolytic Carbon, 2010 International Conf. On MicroManufacturing (ICOMM), Madison, WI
   PDF
5. Simulation of Machining of Pyrolytic Graphite
   Master's Thesis, Indian Institute of Technology Bombay

Image Processing and Computer Vision

In Summer 2016, I used basic image processing and computer vision techniques in a course on Computational Photography. This was similar to my course on Computer Vision, but had a lot more focus on imaging techniques such as image blending, video textures from images, etc. I have created a portfolio of select assignments and projects which were interesting.