Brolin Fernandes

Brolin Osee Fernandes M.SC. INTERACTiON TECHNOLOGY GRADUATE Laaresstraat 15, 7514 ZA, Enschede, Netherlands  (- | - |  brollsroyce Summary I have always relished making other people have experiences that are intuitive, understandable, useful and fun. This passion of mine grew stronger through the various projects and internship experiences that I have had during my Master study in ‘Interaction Technology’. My goal is to prove to myself that my best is worthy of something great, putting all I have learned to good effect, while constantly learning more, by doing more. Education M.Sc. in Interaction Technology Sep 2018 ‑ Jan 2021 UNiVERSiTY OF TWENTE Enschede, The Netherlands • Grade: 7.5/10 B.E. in Electronics and Telecommunications July 2012 ‑ June 2016 DON BOSCO INSTiTUTE OF TECHNOLOGY Mumbai, India • Grade: 6.8/10 Research Experience Exploring possibilities in interactive technology to create Cross‑Domain Interactive Breathing Exercise Games UNiVERSiTY OF TWENTE Jan 2020 ‑ Jan 2021 Enschede, The Netherlands • Formulated a framework of various elements that can be incorporated in breathing exercise games for several purposes (eg: for singers, mind‑ fulness, therapy, etc.) This includes the game visuals, audio (music) and game controller (breath sensor). • Built initial game and interface prototypes (on Unity and inVision), illustrating game requirements specific to a singing‑related breathing exercise game as an example, with a framework of how different breathing exercises for singing as well as other purposes can be incorporated via breath‑ controlled games. • Introduced theory on configurability of breathing exercise games within and across multiple domains based on literature, interviews of experts, co‑design sessions with potential users and qualitative evaluation of created prototypes Electro‑Myographic (EMG) Prosthetic Arm Aug 2015 ‑ Jun 2016 DON BOSCO INSTiTUTE OF TECHNOLOGY Mumbai, India • Using EMG signals, control of finger movement in a prototype prosthetic arm was achieved. • By adjusting the amount of force exerted on a user’s forearm or bicep, an Arduino‑controlled servo motor‑string arrangement was used to move the fingers of a plastic prototype arm, performing functions such as pointing, thumbs up, making a fist, high‑five, etc. Work Experience VR and Teleoperation Intern Jul 2020 ‑ Nov 2020 HEEMSKERK INNOVATiVE TECHNOLOGY Delft, The Netherlands • Implemented a coupling strategy for the haptic teleoperation system to VR, for ITER maintenance tasks. • Developed and demonstrated virtual assistive features (with VR and haptic feedback) for maintenance engineers to practice and better visualize their actual task to be done at the ITER plant. • Performed initial user study of the implementations which indicate good usability and user satisfaction. SAP ABAP Consultant Dec 2016 ‑ July 2018 TATA CONSULTANCY SERViCES Mumbai, India • Technical (SAP ABAP) support for Client – Panalpina (provider of Forwarding and Logistics Services, specializing in intercontinental air and ocean freight and associated Supply Chain Management Solutions • Involved handling user queries, debugging ABAP codes and creating extensive weekly project performance reports Relevant Projects Storytelling through Sound ‑ The While True Feb 2020 ‑ Apr 2020 UNiVERSiTY OF TWENTE Enschede, The Netherlands • Created an audio story, with the contributing factors being ‑ music, sound effects, ambience and dialogue for the purpose of audience immersion using a DAW (Reaper). [Audio Story link] MARCH 1, 2021 BROLiN OSEE FERNANDES · RÉSUMÉ 1 Designing Interactive Experiences ‑ Tomb Raider UNiVERSiTY OF TWENTE Apr 2019 ‑ Jun 2019 Enschede, The Netherlands • Built and showcased an interactive museum‑like experience at the Boerenkerkhof (cemetery/public park), Enschede • Involved shedding light (literally and metaphorically) on the history of Enschede. The experience was such that, in a dark room built over an empty tomb, a visitor could enter with a directional UV lamp and know about the important people in the city’s history. • When the light is aimed at certain walls/floor, the respective surface come to life (with the help of light sensors), creatively telling stories of the respective persons resting at the Boerenkerkhof, Enschede, controlled with the help of Arduino, programmable LED lights, glow paints, storytelling through sound and related artefacts. VR project ‑ Smart Architectural Designing: Energy View UNiVERSiTY OF TWENTE Apr 2019 ‑ Jun 2019 Enschede, The Netherlands • Using Virtual Reality to create a solution concept for the construction industry in Unity. • This project creates a virtual setting for a modular and circular building, along with visualizations of the energy consumption/production in the building. Design Project ‑ Blossom Oct 2018 ‑ Jan 2019 UNiVERSiTY OF TWENTE Enschede, The Netherlands • Designed an application prototype using inVision app, with a human‑centered approach to encourage real interaction between people. • The user‑centered design approaches used were: dilemma‑driven design and scenario‑based design. Human Action Recognition Apr 2019 ‑ Jun 2019 UNiVERSiTY OF TWENTE Enschede, The Netherlands • Implemented a low‑resource consuming, deep learning based, three stage human action recognition algorithm for static images. • The proposed methodology incorporates pose estimation, pose classification and scene classification to develop a complete understanding of humans in images with respect to their environments for the purpose of crowd management. [paper] 3D Face Reconstruction Feb 2019 ‑ Apr 2019 UNiVERSiTY OF TWENTE Enschede, The Netherlands • Programmed a software pipeline for 3D reconstruction of a human face using a stereo RGB image‑pairs. • The methodology involved camera calibration, face masking, stereo rectification, creating a depth map for regenerating the scene using a 3D‑ point cloud that is fine tuned to create a mesh. Semi‑Autonomous Alignment of Singing Vocals with Lyrics UNiVERSiTY OF TWENTE Feb 2019 ‑ Apr 2019 Enschede, The Netherlands • The proposed algorithm involves audio segmentation, speech recognition, voice activity detection and comparing the best matches between the recognized and published lyrics, to get an optimal lyrics transcription. Skills Conceptual Software Hardware Languages Communication Interactive Storytelling, Game Design, Human Centered Design, Designing Interactive Experiences Unity (Game Design), Reaper (Sound Design), inVision (Interface prototyping), Mural (Online Collaboration) Arduino, HTC VIVE, Geomagic Touch, Myoware (EMG sensor), Breathline (breath sensor) Python, C#, MATLAB, LaTeX Highly competent ‑ English, Hindi; Basic ‑ Dutch (Level A2) Publications 1. Fernandes, Brolin, Gunish Alag, and Saumya Kumaar. “HARM‑The Human Action Recognition Module.” In ECCOMAS Thematic Conference on Computational Vision and Medical Image Processing, pp. 419‑433. Springer, Cham, 2019. Part‑time/Voluntary Work Experience Football Coach (part‑time) Aug 2020 ‑ present V.V. DRiENERLO • Football (soccer) trainer for one of the teams at the football club ‑ vv Drienerlo. Student for a day mentor Enschede, The Netherlands Feb 2019 ‑ Dec 2020 UNiVERSiTY OF TWENTE Enschede, The Netherlands • Provided interactive experiences for prospective M.Sc Interaction Technology students, to get a feel of how life at the University of Twente and the degree programme is. Mumbai Rooftop Solar Mission by IIT‑B and IEEE, India (Phase‑I & II) INDiAN INSTiTUTE OF TECHNOLOGY, MUMBAi AND IEEE Aug 2015 ‑ Jan 2016 Mumbai, India • Conducted field survey of rooftops and GIS Mapping of the same, for the purpose of solar panel setups across the city of Mumbai, India. Summer internship/training Jun 2015 ‑ Jul 2015 SiEMENS LTD. Kalva, India • Internship and Training in Basic PLC, SCADA and PI MARCH 1, 2021 BROLiN OSEE FERNANDES · RÉSUMÉ 2 Certifications Unity Technologies Feb 2021 UNiTY CERTiFiED USER: PROGRAMMER • C# programming within Unity software to create interactivity in games, apps, AR/VR, and other experiences. • Debugging, problem‑solving, interpreting the API, creating & evaluating code and navigating the Unity interface. Suven Consultants & Technology Pvt. Ltd London, England Oct 2014 INDUSTRY INTEGRATED ANDROiD PROGRAMMiNG USiNG ANDROiD KiTKAT (API 19) • Developed Off‑Line Voting App using File Storage on SD‑Card project as part of the course work. Mumbai, India Hobbies & Extra Curricular Activities Music Football Dance MARCH 1, 2021 Western Classical Singer (grade‑6 from Trinity College London), basic‑intermediate skills with guitar, ukulele, piano, harmonica Coach, ex‑player at v.v. Drienerlo, Enschede; Player/captain at V.V.F.C (first division team of Mumbai District Football Association (MDFA), Mumbai) Lindy Hop, Salsa, Bachata BROLiN OSEE FERNANDES · RÉSUMÉ 3