Explore the Full Program of SIGGRAPH Asia 2025!
Close

Presentation

PhysGest: Transforming Static Textbook Diagrams into Physically Realistic Videos for Enhanced Physics Education
DescriptionKey physics concepts and principles, such as momentum conservation, are fundamental to the mechanics section of physics education. They play a crucial role in understanding the interactions between objects and the motion laws governing systems. However, since these processes occur instantaneously and are difficult to observe, traditional teaching methods, such as chalkboard explanations, static textbook diagrams, or apparatus demonstrations, often fail to effectively convey the dynamic changes involved. Additionally, these traditional methods cannot effectively demonstrate how these processes comply with physical laws, such as the conservation of momentum. As a result, students struggle to grasp the underlying principles. To address these issues, this paper proposes PhysGest, a framework that transforms static textbook diagrams into physically accurate and interactive videos for physics education. PhysGest captures the instructor's gestures and extracts temporal motion trajectories, from which physical parameters such as velocity and direction are derived. These extracted parameters are then used to animate the static diagrams, generating dynamic videos that align with the instructor's gestures and adhere to physical laws. Therefore, PhysGest overcomes the lack of interaction by converting static diagrams into videos that enhance students' ability to understand physical concepts. Our evaluation results demonstrate that PhysGest significantly enhances students’ self-efficacy, perceived enjoyment, and knowledge retention with improved performance in understanding underlying concepts and principles.