| Model Name | Providers | Count of Finish Reason stop | Count of Finish Reason Tool calls | Count of Finish Reason others | Schema Validation Error Count | Successful Tool Call Count | Similarity compared to the official Implementation |
|---|---|---|---|---|---|---|---|
| deepseek-v3.1-terminus | DeepSeek Official | 1195 | 805 | 0 | 0 | 805 | - |
| DeepInfra | 1167 | 832 | 1 | 1 | 831 | 97.66% | |
| AtlasCloud | 1008 | 964 | 25 | 27 | 937 | 85.94% | |
| NovitaAI | 962 | 1030 | 6 | 25 | 1005 | 80.92% | |
| OpenRouter | 939 | 1052 | 9 | 26 | 1026 | 79.02% |
Created
September 27, 2025 16:08
-
-
Save juvi21/4d7f64ebf6fc92448a6d9e3783fda073 to your computer and use it in GitHub Desktop.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment