MSR 2021 Challenge

Purpose

Chapman University MLAT

Location

Orange County, USA

Year

2021

MSR 2021 Challenge Website

Although our repository for this challenge is currently private due to the submission process for our research paper being underway, here are some snippets of the code and the way in which we chose to approach this challenge.

Screen Shot 2021-11-19 at 11.29.58 AM.png

This is an example of the data that we received from MSR. It contained the project name, the location of the bug, the bug type, the commit that fixed the bug, and the text of the line before and after the fix.

We decided that for our paper we were going to analyze the length of time between the commit that introduced the bug and the commit that fixed the bug in relation to the bug type. Additionally, we wanted to identify the rate at which the developer who introduced the bug was also the developer who fixed the bug. Lastly, we wanted to draw conclusions on the quality of code written when developers committed past regular work hours. Our hypothesis was that code written late at night was more frequently going to be the code that introduced bugs. However, in order to achieve this we would also need to have access to the commit that introduced the bug, which was not given to us in the MSR database. Our team created a custom traversal algorithm to produce a CSV file with all the information from the database as well as new information such as the commit and developer that introduced the bug.

These are two excepts from our algorithm that we used for the data extraction.

Screen Shot 2021-11-19 at 11.52.46 AM.png

Screen Shot 2021-11-19 at 12.06.55 PM.png

Here is an example of what our results looked like.

Once our results were produced we needed to calculate the interquartile range and remove the outliers.

Screen Shot 2021-11-19 at 11.51.51 AM.png

We are currently awaiting the peer-review process for this paper as of December 2021. Once published, this page will be updated with the link to the manuscript.