--- name: get-agentic-blade-metrics description: Get agentic metrics for the `razorpay/blade` repo. disable-model-invocation: true --- Run `fetch-metrics.mjs` to collect all metrics: Note: the script is relative to the root of the git repo. ```bash node .github/scripts/fetch-metrics.mjs [days] ``` The script outputs the full markdown report. Then: - Respond with the metrics in the output format below (make sure tables are formatted as expected in the output) - Timespan: {Timespan of the metrics} === Summary === | Metric | Value | Description of Metric | | ----------------------------------------------------- | ----------------------------------------------------------------- | ---------------------------------------------------------------------------- | | Metric 1: % PRs with auto-approval label | {Percentage of PRs with `✨ Agentic Merge Ready ✨` label} | Percentage of PRs that received the `✨ Agentic Merge Ready ✨` label | | Submetric 1: % of comments on PRs (by human) | {Comments by human / Total comments} | Percentage of review comments made by human contributors | | Submetric 2: % comments marked as resolved (by agent) | {Comments with "resolved by agent" mentioned} | Percentage of comments that were resolved by agent | === PRs Metric === | Metric | Value | Description of Metric | | -------------------------- | ----------------------------------------------------------------- | ------------------------------------------------------------------------ | | Total Number of PRs | {Total PRs in timespan} | Total number of PRs opened in the given timespan | | PRs raised (by agent) | {PRs raised by agent} | PRs raised by `rzp-slash` or `rzp-slash-public` user / app | | PRs raised (by human) | {PRs raised by human} | Total PRs minus PRs raised by agent | | % of PRs raised (by human) | {PRs raised by human / Total PRs} | Percentage of PRs opened by human contributors | | % of PRs raised (by agent) | {PRs raised by agent / Total PRs} | Percentage of PRs opened by agent | | Total PRs auto-approved | {Percentage of PRs with `✨ Agentic Merge Ready ✨` label} | Percentage of PRs that have the `✨ Agentic Merge Ready ✨` label | | Time to Merge (Average) | {Average time from PR creation to merge} | Average time from PR creation to merge; excludes "update version" PRs | | Time to Merge (Median) | {Median time from PR creation to merge} | Median time from PR creation to merge; excludes "update version" PRs | === Review Metric === Note: exclude all comments by `changeset-bot`, `github-actions`, `codesandbox-ci`, `kamaleshs-bridge4`, and `slash-code-reviewer` bots in all the metrics below as they are not applicable. PRs with the `Ignore - Test PR` label are excluded from all calculations. | Metric | Value | Description of Metric | | ------------------------------------------- | --------------------------------------------- | ----------------------------------------------------------------------------- | | Total comments on PRs | {Total comments on all PRs in timespan} | Total number of review comments across all PRs in the timespan | | Comments on PRs (by agent) | {Comments by agent} | Comments by `rzp-slash`, `rzp-slash-public`, or `rzp-slash-reviewer` user/app | | Comments on PRs (by human) | {Total comments minus comments by agent} | Total comments minus comments made by agent | | % of comments on PRs (by human) | {Comments by human / Total comments} | Percentage of review comments made by human contributors | | % of comments on PRs (by agent) | {Comments by agent / Total comments} | Percentage of review comments made by agent | | % of comments marked as resolved (by agent) | {Comments with "resolved by agent" mentioned} | Percentage of comments where "resolved by agent" is mentioned in the comment |