Hi! I’m Rohan. I recently graduated with a BS in Computer Science from UCLA, and work as a software engineer. I’m originally from San Jose, California.
I currently work at Facebook AI on enabling large-scale distributed training within the PyTorch framework. I’ve recently been working on helping build out model parallelism support within PyTorch, as well as investigating the scalability of data parallel training.
This blog is mostly a place for me to collect random notes and tips that I’ve found interesting and useful over the years. Below is a reverse-chronological set of links to some essays that I’ve written over the years!
This section is still in progress!
rvarm1 @ gmail dot com