Posts by Collection

Portfolio item number 1

Short description of portfolio item number 1

Portfolio item number 2

Short description of portfolio item number 2

Interactive Sketchpad: An Interactive Multimodal System for Collaborative, Visual Problem-Solving

Published in , 2025

Humans have long relied on visual aids like sketches and diagrams to support reasoning and problem-solving. Visual tools, like auxiliary lines in geometry or graphs in calculus, are essential for understanding complex ideas. However, many tutoring systems remain text-based, providing feedback only through natural language. Leveraging recent advances in Large Multimodal Models (LMMs), this paper introduces Interactive Sketchpad, a tutoring system that combines language-based explanations with interactive visualizations to enhance learning. Built on a pre-trained LMM, Interactive Sketchpad is fine-tuned to provide step-by-step guidance in both text and visuals, enabling natural multimodal interaction with the student. Accurate and robust diagrams are generated by incorporating code execution into the reasoning process. User studies conducted on math problems such as geometry, calculus, and trigonometry demonstrate that Interactive Sketchpad leads to improved task comprehension, problem-solving accuracy, and engagement levels, highlighting its potential for transforming educational technologies.

Download Paper

Talk 1 on Relevant Topic in Your Field

Published: March 01, 2012

This is a description of your talk, which is a markdown files that can be all markdown-ified like any other post. Yay markdown!

Tutorial 1 on Relevant Topic in Your Field

Published: March 01, 2013

More information here

Talk 2 on Relevant Topic in Your Field

Published: February 01, 2014

More information here

Conference Proceeding talk 3 on Relevant Topic in Your Field

Published: March 01, 2014

This is a description of your conference proceedings talk, note the different field in type. You can put anything in this field.

Year 1 Teaching Assistant

Undergraduate Teaching Assistant, Imperial College London, 2022

Teaching assistant for 1st year Haskell, Kotlin and Java labs.

Year 2 Teaching Assistant

Undergraduate Teaching Assistant, Imperial College London, 2023

Teaching assistant for 2nd year labs at Imperial College London, helping students with the Pintos Operating System project and WACC Compiler project

Personal Maths Tutor

1st Year Tutorials, Imperial College London, 2023

Taught small group discrete maths, logic, reasoning, graphs and algorithms tutorial sessions for first-year university students