Hi! I'm Srinjoy

I'm a Software Engineer at Microsoft building HoloLens

Blog

Installing MicroPython on the ESP32 (macOS)

I've been tinkering around with a lot of Bluetooth Low Energy (BLE) projects on my Adafruit Huzzah32 (a board with the ESP32 chip) during quarantine. This is a quick guide on installing the MicroPython firmware on macOS.

May 31, 2020

Setting up Mixed Reality Toolkit (MRTK) on iOS

In this tutorial I walk through how I setup the open-source Mixed Reality Toolkit (MRTK) the framework on iOS. MRTK enables users to create interactive cross-platform mixed-reality experiences.

Jan 19, 2020

Building Lego Instructions in Augmented Reality

A write-up of my final project in my university Computer Vision course. I built Lego World, an iOS app that guides users in Augmented Reality as they build lego models.

Jan 15, 2019

Research

AR Tag Position Tracker

Accurately track 6 D.O.F. pose using data from multiple QR codes. This allows the system to maintain tracking even when the object is occluded

Real-time Human Gaze Following

Novel deep learning approach to track a human’s gaze from a robot’s perspective in real time. Builds on prior work which predicts the referential gaze of a person from a single 2D image.

Viewpoint Selection for Visual Failure Detection

Presents three approaches to selecting viewpoints for verifying successful execution of tasks. Methods are validated on a furniture assembly task.

Recent Photos

This website is open-source on GitHub