xiaxinhang/pr-agent
1
0
Fork 0
mirror of https://github.com/qodo-ai/pr-agent.git synced 2025-07-04 21:00:40 +08:00
Code Issues Packages Projects Releases Wiki Activity

docs: add Gemini-2.5-flash-preview benchmark comparisons to PR benchmark table

Browse Source
This commit is contained in:
mrT23
2025-05-14 07:35:09 +03:00
parent 3ddd53d4fe
commit 72bcb0ec4c
1 changed files with 13 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

13
docs/docs/pr_benchmark/index.md
View File

@ -47,6 +47,18 @@ Here's a summary of the win rates based on the benchmark:
<td style="text-align:left;">Gemini-2.5-pro-preview-05-06</td> <td style="text-align:left;">Gemini-2.5-pro-preview-05-06</td>
<td style="text-align:left;">Sonnet 3.7</td> <td style="text-align:left;">Sonnet 3.7</td>
<td style="text-align:center; color: #1E8449;"><b>78.1%</b></td> <td style="text-align:center; color: #D8000C;"><b>21.9%</b></td> </tr> <td style="text-align:center; color: #1E8449;"><b>78.1%</b></td> <td style="text-align:center; color: #D8000C;"><b>21.9%</b></td> </tr>
<tr>
<td style="text-align:left;">Gemini-2.5-pro-preview-05-06</td>
<td style="text-align:left;">Gemini-2.5-flash-preview-04-17</td>
<td style="text-align:center; color: #1E8449;"><b>73.0%</b></td> <td style="text-align:center; color: #D8000C;"><b>27.0%</b></td> </tr>
<tr>
<td style="text-align:left;">Gemini-2.5-flash-preview-04-17</td>
<td style="text-align:left;">GPT-4.1</td>
<td style="text-align:center; color: #1E8449;"><b>54.6%</b></td> <td style="text-align:center; color: #D8000C;"><b>45.4%</b></td> </tr>
<tr>
<td style="text-align:left;">Gemini-2.5-flash-preview-04-17</td>
<td style="text-align:left;">Sonnet 3.7</td>
<td style="text-align:center; color: #1E8449;"><b>60.6%</b></td> <td style="text-align:center; color: #D8000C;"><b>39.4%</b></td> </tr>
<tr> <tr>
<td style="text-align:left;">GPT-4.1</td> <td style="text-align:left;">GPT-4.1</td>
<td style="text-align:left;">Sonnet 3.7</td> <td style="text-align:left;">Sonnet 3.7</td>
@ -54,6 +66,7 @@ Here's a summary of the win rates based on the benchmark:
</tbody> </tbody>
</table> </table>
## Gemini-2.5-pro-preview-05-06 - Model Card ## Gemini-2.5-pro-preview-05-06 - Model Card
### Comparison against GPT-4.1 ### Comparison against GPT-4.1