How to find GenAI usage stats
This post includes the steps to view the GenAI code usage in :
1) GitHub Copilot
2) Amazon CodeWhisperer
3) Sema AI Code Monitor
#1 To see the level of GenAI code use in GitHub Copilot, you can follow these steps:
1a) GitHub Copilot Dashboard
The QuickStart guide can be accessed here: https://docs.github.com/en/copilot/quickstart
GitHub provides a dashboard for Copilot users that includes usage statistics. This dashboard can show you how much of your code is being generated by Copilot. To access it:
- Open Visual Studio Code (VS Code) or any other supported IDE where you have GitHub Copilot installed.
- Click on the GitHub Copilot icon in the sidebar or navigate to the Copilot settings.
- Look for a section labeled "Copilot Statistics" or similar. This section will display metrics such as the percentage of code suggestions accepted, the number of suggestions made, and other relevant usage statistics.
1b) GitHub Copilot Insights
GitHub Copilot Insights is a feature that provides detailed analytics on how Copilot is being used in your projects. This can include:
- The percentage of code generated by Copilot.
- The types of suggestions being made.
- The acceptance rate of Copilot's suggestions.
To access Copilot Insights:
- Go to the GitHub Copilot website or the settings within your IDE.
- Navigate to the "Insights" or "Analytics" section.
#2 To see the level of GenAI code use in Amazon CodeWhisperer, you can utilize several methods and tools provided by AWS:
2a) CodeWhisperer Usage Analyzer
The QuickStart guide can be accessed here: https://docs.aws.amazon.com/codewhisperer/latest/userguide/getting-started.html
AWS provides a specific tool called the Amazon CodeWhisperer Usage Analyzer. This tool helps organizations analyze the usage of CodeWhisperer by collecting metrics on code suggestions and security scans. Here’s how you can use it:
- Deployment: You need to deploy the usage analyzer in your AWS account. This involves cloning the repository, installing dependencies, and bootstrapping the AWS Cloud Developer Kit (CDK).
- Metrics Collection: Once deployed, the analyzer will publish metrics into a data pipeline, making the information available for querying via Amazon Athena.
- Queries: You can write queries to report on various usage metrics, such as the number of unique users, popular programming languages, and the number of security scans performed.
These queries help you understand how extensively CodeWhisperer is being used within your organization
2b) Manual Review and Insights
Similar to GitHub Copilot, you can manually review the codebase to identify the extent of CodeWhisperer’s contributions. This can be done by:
- Reviewing commit messages and comments that indicate CodeWhisperer’s involvement.
- Using code review tools to track changes and identify patterns in the code that suggest CodeWhisperer’s assistance.
#3 To see the level of GenAI code use in AI Code Monitor, you can follow these steps:
3a) GitHub Cloud-Based
Step1) Signup using this link: https://app.semasoftware.com/signup/
Step3) Go to Dashboard to view the GenAI usage stats
3b) Other Version Control Systems
If you need any other connection, you may contact us.