semasoftware Release Notes logo
Back to Homepage Subscribe to Updates

Release Notes

See the latest features, improvements, and product updates

Labels

  • All Posts
  • Fix
  • Announcement
  • Improvement

Jump to Month

  • October 2026
  • September 2026
  • August 2026
  • July 2026
  • June 2026
  • May 2026
  • April 2026
  • March 2026
  • November 2024
  • October 2024
  • September 2024
  • August 2024
  • July 2024
  • June 2024
  • May 2024
  • April 2024
  • February 2024
  • January 2024
  • December 2023
  • November 2023
  • October 2023
Powered by

Create yours, for free!

2 years ago

How to find GenAI usage stats

This post includes the steps to view the GenAI code usage in :

1) GitHub Copilot

2) Amazon CodeWhisperer 

3) Sema AI Code Monitor

#1 To see the level of GenAI code use in GitHub Copilot, you can follow these steps:

1a) GitHub Copilot Dashboard

The QuickStart guide can be accessed here: https://docs.github.com/en/copilot/quickstart

GitHub provides a dashboard for Copilot users that includes usage statistics. This dashboard can show you how much of your code is being generated by Copilot. To access it:

  • Open Visual Studio Code (VS Code) or any other supported IDE where you have GitHub Copilot installed.
  • Click on the GitHub Copilot icon in the sidebar or navigate to the Copilot settings.
  • Look for a section labeled "Copilot Statistics" or similar. This section will display metrics such as the percentage of code suggestions accepted, the number of suggestions made, and other relevant usage statistics.

1b) GitHub Copilot Insights

GitHub Copilot Insights is a feature that provides detailed analytics on how Copilot is being used in your projects. This can include:

  • The percentage of code generated by Copilot.
  • The types of suggestions being made.
  • The acceptance rate of Copilot's suggestions.

To access Copilot Insights:

  • Go to the GitHub Copilot website or the settings within your IDE.
  • Navigate to the "Insights" or "Analytics" section.

#2 To see the level of GenAI code use in Amazon CodeWhisperer, you can utilize several methods and tools provided by AWS:

2a) CodeWhisperer Usage Analyzer

The QuickStart guide can be accessed here: https://docs.aws.amazon.com/codewhisperer/latest/userguide/getting-started.html

AWS provides a specific tool called the Amazon CodeWhisperer Usage Analyzer. This tool helps organizations analyze the usage of CodeWhisperer by collecting metrics on code suggestions and security scans. Here’s how you can use it:

  • Deployment: You need to deploy the usage analyzer in your AWS account. This involves cloning the repository, installing dependencies, and bootstrapping the AWS Cloud Developer Kit (CDK).
  • Metrics Collection: Once deployed, the analyzer will publish metrics into a data pipeline, making the information available for querying via Amazon Athena.
  • Queries: You can write queries to report on various usage metrics, such as the number of unique users, popular programming languages, and the number of security scans performed.

These queries help you understand how extensively CodeWhisperer is being used within your organization

2b) Manual Review and Insights

Similar to GitHub Copilot, you can manually review the codebase to identify the extent of CodeWhisperer’s contributions. This can be done by:

  • Reviewing commit messages and comments that indicate CodeWhisperer’s involvement.
  • Using code review tools to track changes and identify patterns in the code that suggest CodeWhisperer’s assistance.

#3 To see the level of GenAI code use in AI Code Monitor, you can follow these steps:

3a) GitHub Cloud-Based 

Step1) Signup using this link: https://app.semasoftware.com/signup/

Step2) Connect your GitHub or AzureDevOps repositories


Step3) Go to Dashboard to view the GenAI usage stats

3b) Other Version Control Systems 

If you need any other connection, you may contact us.

Avatar of authorMatt Van Itallie