Exploring the Impact of Video on Inferred Difficulty Awareness
Resumo
An important issue in many forms of collaboration technology is how video can help the technology better meet its goals. This paper explores this question for difficulty awareness, which is motivated by academic and industrial collaboration scenarios in which unsolicited help is offered to programmers in difficulty. We performed experiments to determine how well difficulty can be automatically inferred by mining the interaction log and/or videos of programmers. Our observations show that: (a) it is more effective to mine the videos to detect programmer postures rather than facial features; (b) posture-mining benefits from an individual model (training data for a developer is used only for that developer), while in contrast, log-mining benefits from a group model (data of all users are used for each user); (b) posture-mining alone (using an individual model) does not detect difficulties of ?calm? programmers, who do not change postures when they are in difficulty; (c) log-mining alone (using a group model) does not detect difficulties of programmers who pause interaction when they are either in difficulty or taking a break; (d) overall, log-mining alone is more effective than posture-mining, alone; (e) both forms of mining have high false negative rates; and (g) multimedia/multimodal detection that mines postures and logs using a group model gives both low false positive and negatives. These results imply that (a) when collaborators can be seen, either directly or through a video, posture changes, though idiosyncratic, are important cues for inferring difficulty; (b) automatically inferred difficulty, using both interaction-logs and postures, when possible and available, is an even more reliable indication of difficulty; (c) video can play an important role in providing unsolicited help in both face-to-face and distributed collaboration; and (d) controlled public environments such as labs and war-rooms should be equipped with cameras that support posture mining.
Referências
Herbsleb, J. D., Mockus, A., Finholt, T. A. and Grinter, R. E. (2000) “Distance, dependencies, and delay in a global collaboration”, In: Proceeding of the 2000 ACM conference on Computer supported cooperative work, Philadelphia, Pennsylvania, USA, pp. 319-328.
Teasley, S., Covi, L., Krishnan, M. S. and Olson, J. S. (2000) “How does radical collocation help a team succeed?”, In: Proceedings of the 2000 ACM conference on Computer supported cooperative work, Philadelphia, Pennsylvania, USA, pp. 339-346.
Carter, J. and Dewan, P. (2018) “Contextualizing inferred programming difficulties”, In: Proceedings of the 3rd International Workshop on Emotion Awareness in Software Engineering, Gothenburg, Sweden, pp. 32-38.
