CV

Education

• Doctor of Electrical and Computer Engineering, 2022, Yokohama National University, Japan
• Master of Electrical and Computer Engineering, 2019, Yokohama National University, Japan
• Bachelor of Informatics Engineering and Education, 2015, Universitas Negeri Jakarta, Indonesia

Work experience

• May 2022 - present: Postdoctoral fellowship
  • University of Konstanz
  • Lead a project of reverse engineering of human coordination
  • Duties includes: setting up multimodal physiological signal lab, designing experiment and writing ethics proposal, disseminating research results.
  • Collaborator: Fumihiro Kano, Harald T. Schupp, and Britta Renner
• April 2019 - March 2022: Doctoral researcher
  • Yokohama National University
  • Lead a project of diagnostic support sytem to identify Autism Spectrum Disorder Symptom in children
  • Manage and coordination collaboration project with Yamaha Motor Company to develop wearable system to estimate affect state
  • Duties includes: conducting experiment, disseminating research results, organizing logistic for experiments.
• Februari 2021: Research internship
  • Sony Japan
  • Develop a deep learning model to estimate affect state using facial landmark and images.

Skills

• Machine learning & AI:
  • Supervised/unsupervised learning
  • Deep learning (CNNs, Siamese networks)
  • Model evaluation (MCC, Jaccard, SHAP, feature importance)
  • Bayesian modeling (PyMC, Bambi, Bayesian Adaptive Trees)
  • Mixture-of-experts, ensemble methods
• Multimodal data acquisition: Motion capture, wearable eye-tracking (Tobii, Pupil Labs), ECG, GSR, EMG, synchronized multi-camera systems
• Signal processing: Physiological signal preprocessing (ECG, GSR, EMG), time-series analysis, event detection
• Statistical analysis: Hierarchical regression, mixed models, Bayesian inference, generative modeling
• Experimental design: Behavioral experiments, psychophysiology studies, child–adult interaction studies
• Data management: High-volume data pipelines, HPC cluster usage, data synchronization & cleaning
• Programming language: Python, C++, C#

Publications

YOLO-Behaviour: A simple, flexible framework to automatically quantify animal behaviours from videos

Chan, A.H.H., Putra, P., Schupp, H., Köchling, J., Straßheim, J., Renner, B., et al. (2025). YOLO-Behaviour. *Methods in Ecology and Evolution*, 16(4), 760–774.

Alignment in Action Anticipation Predicts Successful Coordination in Dynamic Interactive Tasks

Putra, P.U., & Kano, F. (2025). Alignment in Action Anticipation. *OSF Preprint*.

Quantifying the Effect of Anticipatory Eye Movement on Successful Ball Hitting Using Fine-Scale Tracking and SHAP-Analysis

Putra, P.U., & Kano, F. (2024). Anticipatory eye movement and SHAP analysis. *ETRA 2024*.

Children’s Attention Function Evaluation System by Go/NoGo Game CatChicken

Yusei, D., Sakata, M., Mikami, H., Putra Utama Prasetia, Shima, K., & Shimatani, K. (2022). Children’s Attention Function Evaluation System by Go/NoGo Game CatChicken (Go/NoGoゲームCatChickenによる児の注意機能評価システム). *23rd SICE System Integration Division Conference (SICE SI 2022)*, ROMBUNNO.2A2-E11.

A deep neural network model for multi-view human activity recognition

Putra, P.U., Shima, K., & Shimatani, K. (2022). A deep neural network model for multi-view human activity recognition. *PLoS ONE*, 17(1), e0262181.

空間メモリを用いたマーカレス乳幼児行動評価システム

原和江, 坂田茉実, 島圭介, 島谷康司, Putra, P. (2022). 空間メモリを用いた乳幼児行動評価. *IEICE*.

Markerless Behavior Monitoring System for Diagnosis Support of Developmental Disorder Symptoms in Children

Putra, P.U., Shima, K., Hotchi, S., & Shimatani, K. (2021). Markerless behavior monitoring system. *ICCAS 2021*.

Identifying autism spectrum disorder symptoms using response and gaze behavior during the Go/NoGo game CatChicken

Putra, P.U., Shima, K., Alvarez, S.A., & Shimatani, K. (2021). Identifying ASD symptoms using the CatChicken Go/NoGo game. *Scientific Reports*, 11, 22012.

Drivers’ Affect Recognition System Utilizing Multimodal Biosignals (in Japanese: マルチモーダルな生体信号に基づくドライバの感情推定システム)

西原翼, 島圭介, 神谷昭勝, 南重信, 井上真一, 小池美和, Putra, P. (2021). ドライバ感情推定システム. *RoMeC 2021*.

Catchicken: A serious game based on the Go/NoGo task to estimate inattentiveness and impulsivity symptoms

Putra, P., Shima, K., & Shimatani, K. (2020). Catchicken. *IEEE CBMS 2020*.

外部刺激に対する幼児の不注意と衝動性の評価－運動課題とVisual Continuous Performance Taskの関係－

島谷康司, 発智さやか, 坂田茉実, 三谷良真, 島圭介, Putra, P. (2019). 幼児の不注意と衝動性の評価. *生体医工学*.

Markerless human activity recognition method based on deep neural network model using multiple cameras

Putra, P.U., Shima, K., & Shimatani, K. (2018). Markerless human activity recognition using multiple cameras. *CoDIT 2018*.

A framework of human emotion recognition using extreme learning machine

Utama, P., & Ajie, H. (2014). Emotion recognition using extreme learning machine. *ICAICTA 2014*.

Talks

Decoding joint action success through eye movements: A data-driven approach

August 25, 2025

Talk at 47th European Conference on Visual Perception, Mainz, Germany

Should I trust facial expression recognition models?

June 04, 2025

Talk at Emotion Recognition Community in Developmental Psychology, Online

The dynamics of human action and perception during the coordination of a ball interception task

August 02, 2024

Talk at Dynamics Days Europe, Bremen, Germany

Quantifying the Effect of Anticipatory Eye Movement on Successful Ball Hitting Using Fine-Scale Tracking and SHAP-Analysis

June 06, 2024

Talk at ETRA '24: Symposium on Eye Tracking Research and Applications, Glasgow, Scotland

Social signal processing in the Normativity Lab

November 23, 2023

Talk at Normativity Lab, University of Konstanz, Konstanz, Germany

Markerless Behavior Monitoring System for Diagnosis Support of Developmental Disorder Symptoms in Children

October 14, 2021

Talk at 21st International Conference on Control, Automation and Systems (ICCAS), Jeju, South Korea

Catchicken: A Serious Game Based on the Go/NoGo Task to Estimate Inattentiveness and Impulsivity Symptoms

June 30, 2020

Talk at IEEE 33rd International Symposium on Computer-Based Medical Systems (CBMS), Mayo Clinic, Rochester, USA

Markerless Human Activity Recognition Method Based on Deep Neural Network Model Using Multiple Cameras

April 13, 2018

Talk at 5th International Conference on Control, Decision and Information Technologies (CoDIT), Thessaloniki, Greece

A framework of human emotion recognition using extreme learning machines

August 21, 2014

Talk at International Conference of Advanced Informatics: Concept, Theory and Application, Bandung, Indonesia

Teaching

Teaching experience 2

Teaching experience 1

Service and leadership

Reviewing Experiences

• COSMOS Summer School
• COGAIN
• Scientific Reports
• MDPI Animals
• ACM Transactions on Human–Robot Interaction
• Data in Brief

Professional Memberships and Community Service

• Program co-Chair COGAIN (2026)
• Member of the Gaze Interaction (COGAIN) Symposium (2024–present)
• Organized a two-day Deep Reinforcement Learning workshop at the University of Konstanz (September 27–28, 2023)
• Volunteer moderator during the CASCB Research Workshop with the University of Essex (2022)