Continuum unifies the functionality of high-resolution displays and computer enhanced group collaboration with arrays of ambient sensors providing users the opportunity to collaborate with local and remote colleagues and their data more effectively by giving the room the ability to anticipate their needs. I worked on integrating sensor inputs like continuous speech recognition, created/managed server and database to host data, implemented authentication and authorization for multiple clients, and expanding interactivity with gestures (via Kinect and Optitrak). Image by Jonas Talandis, EVL.

Articulate is a semi-automated visual analytic system that is guided by a conversational user interface to allow users to verbally describe and then manipulate what they want to see. Joined project in Summer 2017 and expanded speech recognition to integrate Alexa and created/managed noSQL database with MongoDB into SAGE2. Image by Lance Long, EVL.

Design and develop a product for Caterpillar in an interdisciplinary team made of industrial/graphic designers, marketing, and computer engineering students over the course of one year. Using an iterative process of rapid prototyping based on careful market/engineering research to integrate powerful human centric innovation into new areas. We wanted to develop a technology not for next year but for the next decade where natural interfaces using small wireless connected devices are used to augment human capabilities and enhance the way we live.

From the screenshot you can see the newly created VR room by the New Media Art Lab which uses room scale VR with the HTC Vive, gesture/depth/rgb imagery with Microsoft’s Kinect, and hand gesture recognition with Leap Motion (now mounted on the Vive)! I began development of this room in March of 2018.

Solution created in collaboration with Bartosz Kupiec, Andrew Burks, Timothy Luciani, and Dr. Elisabeta Marai (faculty advisor) for VAST mini-challenge 3. We dealt with multispectral satellite data to produce the small multiples and linked semantic zooming. Bartosz and I did most of the work creating the interface and collaborated with rest of the team to develop the science and our idea. I went to Phoenix, Arizona to present our work.

Captain for Robobrawl 2018 competition (see top image). Which means developing the mechanical, electrical, and software aspects of the robot. Competition was on March 9-10 in UIUC!

Software developer for team GlaDOS in 2017 Midwestern Robotics Design Competition (see bottom image). Team members (aside from myself): Hassan Ali (Captain), Tomoki Kamitani (Co-Captain), Klaidi Cako (Mechanical Engineer), and Jude Ade Nwokenkwo (Mechanical Engineer). I created a vision system that used an ADHOC network to provide live video feed to connected clients

Project awarded grant by UIC Honors College with Dr. Mitchell Theys as project advisor. Developed VR application with Oculus Rift DK2 that recreated UIC's East Campus with 3D SketchUp mass models provided by the Office of Facility and Space planning. Optimized models with 3DS Max then piped into Unreal Engine 4 and later Unity to visualize East Campus (provides scale and direction).

Developed a MIPS assembler that supports instructions (written in C) and Data Path (designed in Verilog) to take MIPS assembly and feed it into my custom designed CPU model. In class presentation was done explaining the creation process. Project was done under the guidance of Professor Paolo Vinella.