Attestation at Code Review level: How-to-Video
Video: https://youtu.be/bwmdfDXNi7c
Development / Engineering team members of your organization can manage the GenAI code composition statistics during the Code review phase of the SDLC. When they have opened a Pull Request in GitHub, the GenAI code composition for that Pull Request is visible to them on the Pull Request details page and then on the AICM Tool's Pull Request details page. They can agree with the GenAI code labels provided by the AICM tool or they can override and re-label it based on their knowledge.
On one hand, this allows them to verify and rectify the GenAI code composition labels for this PR, while on the other hand allows them to approve/reject a Pull Request based on GenAI code usage.
Follow these steps to do 'Attestation':
Step1. Go to the GitHub or AzureDevOps tools to look for Pull Requests
Step2. Go to the 'Checks' page where all otehr checks are listed. Here you will find Sema GenAI Detector
Step3. Click on 'Sema GenAI Detector' link to view the GenAI Composition for this PR
Step4. You can further click on 'More Details' link to go to the PR detail page on AICM tool to view the GenAI Composition for this PR and the code assocaietd with this PR. Once you are on this page, you can take the following actions w.r.t. 'Attestation'.
- Agree – By clicking the 'Tick' icon, you are Attesting that you agree with the GenAI code labelling.
- Disagree [add comments (optional)] – By clicking the 'Cross' icon, you are Attesting that you do not agree with the GenAI code labelling, and you select from the given options of Blended, PureGenAI, NotGenAI – that you think is the correct label.
- Do nothing - This doesn't count as attestation.
After doing Attestation, the chunk will show the name of the person who did the Attestation and the timestamp of when this was done. You also have an option to Edit.
Note: When you attest a chunk in a PR, the PR GenAI stats moves based on the action taken by the most recent user.
Stats before Attestation
Stats after Attestation:
Attestation actions:
1) Agree with one chunk labelled as NotGenAI
2) Relabeled another NotGenAI chunk as Blended - because of this the stats changed at PR level
Old Stats: Overall = 4.83 %, Pure = 0.76 , Blended = 4.07 %
New Stats: Overall = 5.85 %, Pure = 0.77 , Blended = 5.08 % (Blended and Overall increased significantly)