Jesse van der Merwe
BBD Software – Frontend Engineer & MSc Researcher
The hidden signals: What you can learn when people play
14:00 SAST
17:30 IST
13:00 BST
JHB
45 Min
We often judge ability based on what people have done – their CVs, years of experience, outputs, and so on. But these metrics are often shaped by opportunity, not potential, and don't tell us the full story. What if we looked at something deeper than ability: How people think? In this talk, I explore how interaction can reveal patterns of thinking that are otherwise invisible. From using machine learning to analyse the data from a puzzle-based digital game, to building interactive game experiences that let people influence real-world outcomes, we begin to see signals of problem-solving, exploration, hesitation and decision-making emerge. Often, these signals are more meaningful than traditional measures of ability – whether you're evaluating people or designing systems for them to use. Under the hood, this comes down to how we design systems: What we capture, what we ignore, and how we interpret user behaviour. I'll share practical ways to think about interaction data; not just as events to log, but as signals to understand. This talk bridges game design, frontend engineering, interaction design, and behavioural data – showing how we can move beyond tracking what users do, to understanding how they think.