Evaluation

User testing was used to evaluate the Story Telling component. 24 UCT students evaluated the system by means of a questionnaire. Users were asked to perform a series of tasks that would allow them to view and test each part of the system.

Results

User Satisfaction

Users were very satisfied with the Storytelling component. Users in particular enjoyed the animation effects of the flipbook. There were also positive reviews for the ability to edit a story, with most people enjoying being able to insert images. When asked whether the system was pleasant to use, 18 out of the 24 participants answered positively (15 Agreed and 3 Strongly Agreed). Similarly, when asked whether the system was fun to use, 19 participants answered positively (11 Agreed and 8 Strongly Agreed).

Errors

Improvements could be made to the system. More feedback, for instance, could be given to users after performing certain actions, such as saving a story in Design mode. Features such as the navigation could also be improved on. Errors in the system were generally minor, though, and thus did not have a major affect on the usability of the system. Most users felt that they could recover from mistakes quickly and easily. Users also felt, on average, that they did not notice any inconsistencies when using the system and agreed that the various functions of the system were well-integrated.

Learnability

In terms of learnability, users did not seem to have too much trouble learning how to use the system. Participants were asked whether they felt that they needed to learn a lot of things before they could start using the system. 17 users disagreed with this statement (12 Disagreed and 5 strongly Disagreed). 14 users also said that they would not need the help of a technical person to use the system. In fact, most users said that they thought the system was easy to use and that they felt very confident using it. A help feature could also be added, in future, to further improve learnability, in particular for Design mode to explain the different editor options.

Encouraging Learning about Rock Art

Furthermore, the results show an interest by participants in rock art and Bushman stories after viewing the system. More evaluations would need to be conducted to determine the level of interest, as well as the factors affecting users interest in these subjects. The result is, however, positive in terms of the system's aim to encourage users to learn more about rock art. As the system exhibits learnability, the system could easily be used by teachers to create enjoyable Bushman stories to teach to learners. Learners could also be given an opportunity to create their own stories or customize existing stories.

Conclusion

The results showed that the system is easy to use and enjoyable. It exhibits the desired attributes of User Satisfaction, Errors at a low enough rate that it does not significantly affect usability, and Learnability. Improvements could be made to further reduce errors in the system and to add additional features to the system.

The aim of the Storytelling component was to allow users to view stories in an enjoyable manner and to additionally allow users to edit and design storybooks so that they would be even more enjoyable to read. From the results, it can be said that the system has come very close to fulfilling these aims.