PhD student in Human-Computer Interaction: AI-driven Gesture Detection on Wearable Devices (for AR/VR/XR)

100%, Zurich, fixed-term

The Sensing, Interaction & Perception Lab is looking for a PhD student in Human-Computer Interaction at ETH Zurich. Our research will be focused on gesture detection, wearable devices, embedded sensors, and signal processing, especially from IMUs (motion sensors), microphones, and EMG (myography). We will build novel interaction techniques, and recognizers using machine learning, and study users while interacting using the developed interfaces. We will also build interactive applications that leverage novel techniques, including AR/VR and mobile computing. The objective is to improve natural interaction through gesture that is passively detected using wearable sensors in real time.

Suitable backgrounds

• human-computer interaction
• electrical engineering
• robotics
• software engineering, embedded systems

Project background

In the domain of human-computer interaction, gesture detection is gaining traction as a practical and efficient method of communication and input control. As wearable technology becomes more prevalent, there’s a clear need to improve interaction mechanisms. Wearable devices, with their integrated sensors, offer a platform to detect and interpret human gestures.

The research conducted as part of the PhD will focus on the development of interaction techniques as well as techniques for detecting these interactions to enable gesture recognition. Candidates will work on creating reliable and efficient solutions, contributing to the evolution of user-device interactions.

Applications of the developed interactions and detection techniques will be in Augmented Reality, Virtual Reality, and mobile computing in general.

Job description

• Research & Development: Investigate current trends and advancements in gesture detection within the human-computer interaction domain
• Prototyping: Develop prototypes to demonstrate and test new gesture interaction concepts
• Data Collection & Analysis: Collaborate within the lab to gather relevant gesture data, ensuring its quality and relevance and to analyze this data to identify patterns and areas of improvement
• Machine Learning Model Development: Design, train, and test machine learning models tailored for gesture recognition using data from wearable device sensors
• Integration with Wearable Devices: Ensure seamless integration of gesture detection algorithms with wearable device sensors
• Performance Evaluation: Regularly test the efficiency and accuracy of developed models in real-world scenarios. Make necessary adjustments based on feedback and findings. Collaborate with EE PhD students in the lab to optimize techniques for embedded use
• Documentation: Maintain documentation of developments with the goal of dissemination through publication at top venues
• Continuous Learning: Stay updated with the latest advancements in HCI, gesture interaction, gesture detection, and machine learning to ensure research at the forefront of the field

Your profile

ETH requirements:

• written and spoken fluency in English
• an excellent master’s degree (MSc., M.Eng. or equivalent) in Computer Science, Electrical Engineering, Bioengineering, Robotics, or related

requirements for the position:

• experience in Human-Computer Interaction
• experience in engineering interactive systems (ideally experience with input detection)
• experience with Machine Learning toolkits
• basic experience with embedded systems (e.g., Arduinos)
• basic experience with signal processing
• optional but useful: experience with VR or AR, Unity/C#
• strong interpersonal and communication skills

Prior experience in conducting user evaluations is useful but not a must.

Your workplace

We offer

We offer an exciting environment and team to study in and work with. Beyond the lab, ETH Zürich has several internationally recognized research groups dedicated to interactive systems, Human-Computer Interaction, AR/VR, and machine learning. In our research, we often collaborate with other groups and departments as well as with several other institutions and companies in Switzerland and abroad.

Working, teaching and research at ETH Zurich

We value diversity

In line with our values, ETH Zurich encourages an inclusive culture. We promote equality of opportunity, value diversity and nurture a working and learning environment in which the rights and dignity of all our staff and students are respected. Visit our Equal Opportunities and Diversity website to find out how we ensure a fair and open environment that allows everyone to grow and flourish.

Curious? So are we.

Please submit your complete application through the online application portal:

• a short motivation letter (≤ 1 page)
• curriculum vitae (PDF)
• university transcript of records (bachelor’s and master’s)
• short overview of your experiences in Human-Computer Interaction
• short overview of your experiences with gesture detection/signal processing/machine learning
• contact details of 1–2 academic referees
• a link to your GitHub profile and/or your portfolio/website

Please note that we exclusively accept applications submitted through our online application portal. Applications via email or postal services will not be considered.

Applications will be evaluated on a rolling basis. The position is available for as long as this job ad is up and the job ad will be deactivated when the position has been filled. We are looking to fill the position as soon as possible with a start date in 2023.

If your questions are not answered in this post, please direct them to siplab-recruiting@inf.ethz.ch.

Apply online now

About ETH Zürich

ETH Zurich is one of the world’s leading universities specialising in science and technology. We are renowned for our excellent education, cutting-edge fundamental research and direct transfer of new knowledge into society. Over 30,000 people from more than 120 countries find our university to be a place that promotes independent thinking and an environment that inspires excellence. Located in the heart of Europe, yet forging connections all over the world, we work together to develop solutions for the global challenges of today and tomorrow.

Please click here to apply.