Attention: This site looks better in the latest Mozilla or Internet Explorer.

The Book Conference 2003 Home Newsletter Call for Papers Register Now

Presentation Details


Interactive Physical Controller: A Feature for Electronic Storybook

Che Zulkhairi Abdullah, Forest Lim, Juhanita Jiman, Abdul Majid Ahmad Zuhairi, Mazlan Mahadzir.

The physical controller is a medium within which user (children) use them for query over symbol/icon/graphical representation/words (contextual). And for the user (children) to create instance of the object/event/task presented in the physical book (or system layout) and the attribute of this clone/instance can be transferred to another object/event for specified purposes. The activity concerning this transfer of attribute need to be seamlessly embedded into the system to encourage learning of concept and concept building.

The system layout (or conventionally known as book) can be understood as system story flowchart. This flowchart can be multi-page or one big layout folded to become book-size origami forms. The material for this system layout need to be easy to maintain and abide to the normal condition within which books are being physically abused or manipulated harshly by children. Therefore, the material should be able to sustain its original form and able to maintain its circuitry over the guaranteed period of time. The system layout to be arranged in a multi grid with touch switch positioned accordingly. The system sensor is two piece of thin plastic printed with circuitry to send the current node state(s). The design of this circuitry should consider the point towards which there exist fold or compacted surfaces. And, the design of this system layout should consider the possibilities for user to explore beyond the programmable condition.

The content structure exist as node. This node has its own attribute. Some of the attribute-expected control feature, permittable activities acted upon, inference to certain concept/object/abstract notions, preset goals, preset conditioning factor to indicate state/layer/ability and user constraints.

The story can have onebegin nod, and have many option for the system to process for choices and can have more than oneend nod. This multi path attitude can have no end, or can have a totally different output (orend nod) as the result of experimentation and new input value.

However, according to the Knowledge Representation (KR) concept, representation is a relationship (of certain value, providing reason, explaining things and describing or implying possibilities) of the construct and the real concept (this is appreciated as the posed problem, this problem statement is the key to encourage thinking, or learning to happen independently). The representation has constraint, because it is not an object by itself. It imply the condition or occurrence of something, but it does not have direct control over the constructs.

The process to which the system understand the solution to a design/process problem (or better explained as the end to a story-if storybook is involved) require this tools-deduction, reasoning (human behaviour/characteristic), reasoning (stimulus/response behaviour), probability, value and preferences (utility theory).

Movable object, beacon can be placed accordingly to predefined (designed) slots with proper emboss or sunken space (shape). Therefore accepting only the permittable instance-o, control feature-of part-of andnod. The system need to track this devices position, state, orientation, altitude from the calibrated conditions (height) and angle (tilt). This data need to be processed and compared to the calibrated state (mapped condition). Upon which the system can now decide what else can happen after that, or compile permittable path for user to pursue to complete the story.

The physical controller device idea originate from LEGO Mindstorm (copyrighted) ( The development of this small robotic for edutainment market has evolved into new experiences and experiment with learning process. The new development includes-spybotics and the famous LEGO Spielberg moviemaking package. This market success provide some insight into the possibilities for such technology to be developed for other purposes such as this.


Che Zulkhairi Abdullah  (Malaysia)
Tutor in Interface Design
Faculty of Creative Multimedia
Multimedia University

Special research interest=e-device for e-learning, interactive storyline structure, interactive content management, e-learning, embedded mobile vehicle/robot design, LEGO 'beams' robotic, GIS for e-Learning, alternative e-Learning framework. Knowledge Representation, Knowledge Mapping, Interface Design.

Forest Lim  (Malaysia)
Faculty of Creative Multimedia
Multimedia University

Juhanita Jiman  (Malaysia)
Faculty of Creative Multimedia

Abdul Majid Ahmad Zuhairi  (Malaysia)
Faculty of Creative Multimedia

Mazlan Mahadzir  (Malaysia)
Faculty of Creative Multimedia

  • Interactive physical controller Interactive story
  • Knowledge Representation
  • Electronic Storybook

(Virtual Presentation, English)