Studying Programmer Behaviour at Scale: A Case Study Using Amazon Mechanical Turk
Developing and maintaining a correct and consistent model of how code will be executed is an ongoing challenge for software developers. However, validating the tools and techniques we develop to aid programmers can be a challenge plagued by small sample sizes, high costs, or poor generalisability.
This paper serves as a case study using a web-based crowdsourcing approach to study programmer behaviour at scale. We demonstrate this method to create controlled coding experiments at modest cost, highlight the efficacy of this approach with objective validation, and comment on notable findings from our prototype experiment into one of the most ubiquitous, yet understudied, features of modern software development environments: syntax highlighting.
Tue 23 MarDisplayed time zone: Belfast change
17:00 - 19:00
|Type Engineering: A design language for unified Software Engineering
Anton Dmukhovskiy Art Deco Code Ltd
|Studying Programmer Behaviour at Scale: A Case Study Using Amazon Mechanical Turk
|Towards End-user Web Scraping For Customization
|Towards exploratory understanding of software using test suites