Adding Temporal Semantic to Textual Media Objects with Eye Tracking Technology

• Ellen P. Silva CEFET/RJ
• Glauco F. Amorim CEFET/RJ
• Joel A. F. dos Santos CEFET/RJ

Abstract

In general, continuous media objects can use their inner temporal information to create relationship with another media objects. However, the same is not possible for discrete media objects, such as texts. This work proposes an architecture to insert time into text semantics. The approach used in this work is based on the use of an eye tracker device to capture the user’s reading position during the presentation of a text media object in a reader device. Thus we are synchronize media objects in a multimedia application according to the user reading pace. This paper presents an general architecture for the proposed approach and an implementation of that architecture focused on children books reading.

Keywords: Eye Tracker, Temporal Synchronization, Discrete Media, NCL