A GitHub study has found that the developers who report the greatest productivity gains from using GitHub Copilot, the company’s AI-based programming assistant, were those who accepted the most Copilot code suggestions. The study combined a survey of users’ perceived productivity with analysis of their Copilot usage.
GitHub on July 14 said it had surveyed more than 2,000 developers who have been using Copilot, which suggests lines of code using an AI model that has been trained on billions of lines of open source code. Copilot users who reported “huge” productivity gains were those who had found nearly 30% of Copilot’s suggestions acceptable. At the other end of the spectrum, users who reported “modest” productivity gains had found only about 23% of Copilot’s suggestions acceptable. Users reporting “medium” and “high” productivity gains had accepted roughly 27% and 28% of Copilot’s suggestions, respectively.