← Back to Test Cases
Create Batch Manufacturing Record for Metformin Tablets
Task CompletionBatch Recordhard
Cross-Model Comparison
| Model | Score | Latency | Tokens In | Tokens Out |
|---|---|---|---|---|
| Qwen3.8 Max (2.4T-A95B) | N/A | N/A | - | - |
| Qwen3.8-Flash | N/A | N/A | - | - |
| Qwen3.8-Flash | N/A | N/A | - | - |
| GLM-5.3 | N/A | N/A | - | - |
| GLM-5.3 | N/A | N/A | - | - |
| Muse Glimmer 30B | N/A | N/A | - | - |
| Muse Glimmer 30B | N/A | N/A | - | - |
| Muse Glimmer 30B | N/A | N/A | - | - |
| GLM-5.3 | N/A | N/A | - | - |
| MiniMax M3 | N/A | N/A | - | - |
| MiniMax M3 | N/A | N/A | - | - |
| Qwen3.8-Flash | N/A | N/A | - | - |
| Hy4 Preview | N/A | N/A | - | - |
| Qwen3.8 Max (2.4T-A95B) | N/A | N/A | - | - |
| MiniMax M3 | N/A | N/A | - | - |
| Qwen3.8-Flash | N/A | 374.6s | 560 | 48,000 |
| Hy4 Preview | N/A | N/A | - | - |
| Qwen3.8 Max (2.4T-A95B) | N/A | N/A | - | - |
| Hy4 Preview | N/A | N/A | - | - |
| Claude Opus 5 | 93.0% | 439.4s | 786 | 39,686 |
| GPT-5.4 | 91.5% | 83.6s | 461 | 7,148 |
| Claude Opus 5 | 91.2% | 422.0s | 786 | 36,407 |
| GLM-5.3-Flash | 91.0% | 556.6s | 476 | 23,110 |
| Claude Opus 5 | 90.8% | 498.0s | 786 | 42,541 |
| Kimi K3 | 90.7% | 700.4s | 559 | 19,513 |
| GLM-5.3-Flash | 90.6% | 478.0s | 476 | 21,545 |
| Kimi K3 | 90.6% | 517.4s | 559 | 15,674 |
| Qwen3.5-397B-A17B | 90.5% | 47.6s | 522 | 5,631 |
| GPT-5.4 mini | 90.5% | 24.3s | 461 | 5,254 |
| Hy4 Preview | 89.6% | 287.3s | 485 | 23,378 |
| GLM-5.3 | 89.3% | 265.8s | 476 | 29,316 |
| Qwen3.8 Max (2.4T-A95B) | 89.1% | 633.7s | 560 | 28,824 |
| Kimi K3 | 88.8% | 669.0s | 562 | 18,833 |
| Claude Sonnet 5 | 88.8% | 97.5s | 786 | 10,325 |
| DeepSeek-V3.2 | 88.5% | 109.5s | 472 | 4,248 |
| Mistral Large 3 675B | 88.5% | 101.5s | 504 | 6,472 |
| DeepSeek-R1 | 88.5% | 117.4s | 472 | 4,550 |
| MiniMax M2.7 | 88.4% | 109.4s | 463 | 14,612 |
| Hy4 Preview | 88.3% | 263.9s | 485 | 21,512 |
| Hy4 Preview | 88.2% | 249.4s | 485 | 21,138 |
| GPT-5.6 Terra | 86.8% | 137.2s | 461 | 8,924 |
| GPT-5.6 Terra | 86.8% | 142.4s | 461 | 12,582 |
| GPT-5.6 Luna | 86.6% | 80.8s | 461 | 8,813 |
| Qwen3.8-Flash | 86.4% | 208.6s | 560 | 27,129 |
| GPT-5.6 Sol | 86.4% | 129.9s | 461 | 10,507 |
| Claude Sonnet 5 | 86.3% | 87.7s | 786 | 10,002 |
| MiniMax M3 | 86.2% | 57.2s | 617 | 10,802 |
| Qwen3.8 Max (2.4T-A95B) | 86.2% | 700.6s | 560 | 31,143 |
| Qwen3.5-35B-A3B | 86.1% | 43.4s | 523 | 6,107 |
| Claude Haiku 4.5 | 86.0% | 89.7s | 549 | 14,977 |
| MiniMax M3 | 85.8% | 123.8s | 617 | 10,408 |
| Qwen3.6 35B A3B | 85.7% | 32.0s | 522 | 6,738 |
| Qwen3.6 27B | 85.5% | 171.9s | 522 | 6,301 |
| Claude Opus 4.8 | 85.4% | 74.7s | 786 | 6,939 |
| GPT-5.6 Luna | 85.3% | 71.8s | 461 | 7,966 |
| GPT-5.4 nano | 85.0% | 29.5s | 461 | 6,076 |
| GLM-5.3 | 84.8% | 43.7s | 477 | 5,673 |
| DeepSeek V4 Pro | 84.5% | 159.7s | 472 | 9,837 |
| Qwen3.6 27B | 84.4% | 239.3s | 522 | 8,267 |
| DeepSeek V4 Pro | 84.3% | 241.2s | 472 | 8,271 |
| Qwen3.6 27B | 84.3% | 89.8s | 522 | 8,218 |
| Claude Opus 4.6 | 84.3% | 199.0s | 550 | 16,000 |
| MiniMax M3 | 83.9% | 62.9s | 565 | 9,456 |
| GPT-5.6 Luna | 83.9% | 86.2s | 461 | 8,968 |
| GLM-5.3-Flash | 83.8% | 529.7s | 476 | 22,889 |
| GLM-5.2 | 83.7% | 223.4s | 476 | 14,787 |
| Qwen3.6 27B | 83.7% | 106.1s | 522 | 6,958 |
| Qwen3.8 27B | 83.5% | 423.2s | 560 | 28,534 |
| Qwen3.6 35B A3B | 83.3% | 45.4s | 522 | 8,511 |
| Claude Sonnet 5 | 83.3% | 86.5s | 786 | 9,741 |
| GLM-5.2 | 83.0% | 187.9s | 476 | 12,630 |
| Qwen3.8 27B | 82.8% | 519.5s | 560 | 30,017 |
| GPT-5.6 Sol | 82.8% | 144.0s | 461 | 12,957 |
| Gemini 3.1 Pro | 82.5% | 75.7s | 498 | 5,228 |
| DeepSeek V4 Pro | 82.3% | 191.7s | 472 | 6,257 |
| Qwen3.8 Max (2.4T-A95B) | 81.3% | 157.5s | 560 | 35,043 |
| GLM-5.3 | 81.3% | 59.8s | 477 | 8,250 |
| Qwen3.6 35B A3B | 81.3% | 49.3s | 522 | 7,390 |
| Qwen3.8-Flash | 81.0% | 319.8s | 560 | 38,647 |
| GPT-5.6 Sol | 80.6% | 149.9s | 461 | 13,315 |
| DeepSeek V4 Flash | 80.3% | 50.5s | 472 | 5,917 |
| GPT-5.6 Terra | 79.4% | 99.9s | 461 | 8,681 |
| GLM-5.2 | 79.3% | 50.7s | 470 | 4,186 |
| Qwen3.8-Flash | 79.0% | 246.8s | 560 | 28,695 |
| Qwen3.5-397B-A17B | 78.8% | 86.5s | 522 | 5,870 |
| Qwen3.5-397B-A17B | 78.5% | 76.2s | 522 | 5,653 |
| Claude Sonnet 4.6 | 78.5% | 137.8s | 550 | 16,000 |
| MiniMax M2.7 | 78.3% | 119.1s | 461 | 12,157 |
| Mistral Small 2603 | 78.1% | 15.2s | 516 | 3,174 |
| Qwen3.6 35B A3B | 78.0% | 85.4s | 522 | 7,337 |
| Qwen3.8 27B | 77.8% | 379.9s | 560 | 22,590 |
| DeepSeek V4 Flash | 77.0% | 69.9s | 472 | 5,057 |
| DeepSeek-V3.2 | 75.5% | 151.4s | 472 | 4,315 |
| DeepSeek V4 Pro | 75.0% | 120.9s | 472 | 7,205 |
| DeepSeek-V3.2 | 74.6% | 137.7s | 472 | 3,953 |
| DeepSeek-V3.2 | 74.5% | 106.0s | 472 | 3,890 |
| MiniMax M2.7 | 74.3% | 145.4s | 461 | 14,271 |
| Qwen3.5-397B-A17B | 73.9% | 648.3s | 522 | 6,713 |
| DeepSeek-R1 | 72.9% | 269.7s | 471 | 4,662 |
| Muse Glimmer 30B | 72.5% | 53.5s | 482 | 3,447 |
| MiniMax M2.7 | 72.1% | 127.6s | 461 | 12,786 |
| Muse Glimmer 30B | 71.1% | 55.5s | 482 | 3,648 |
| DeepSeek-V3.2 | 70.9% | 135.1s | 472 | 3,918 |
| DeepSeek V4 Flash | 70.5% | 217.8s | 472 | 7,930 |
| Claude Haiku 4.5 | 70.5% | 74.3s | 549 | 13,652 |
| Claude Haiku 4.5 | 70.2% | 90.9s | 549 | 16,208 |
| GLM-5.2 | 69.2% | 82.3s | 476 | 4,272 |
| Mistral Large 3 675B | 69.2% | 56.3s | 504 | 5,328 |
| Gemma 4 31B IT | 68.8% | 76.8s | 532 | 2,024 |
| Gemma 4 31B IT | 68.3% | 57.5s | 515 | 1,952 |
| Muse Glimmer 30B | 68.0% | 65.4s | 482 | 4,205 |
| Mistral Large 3 675B | 67.7% | 52.7s | 504 | 4,621 |
| Llama 4 Maverick | 67.6% | 88.4s | 469 | 1,692 |
| Gemini 3 Flash | 67.5% | 14.2s | 498 | 2,134 |
| DeepSeek V4 Flash | 67.3% | 44.2s | 472 | 4,718 |
| Gemma 4 26B A4B IT | 67.2% | 47.1s | 516 | 1,904 |
| Mistral Small 2603 | 64.5% | 39.7s | 516 | 5,009 |
| Gemma 4 31B IT | 63.7% | 68.0s | 515 | 2,121 |
| Gemma 4 26B A4B IT | 63.4% | 29.9s | 515 | 1,976 |
| Gemma 4 31B IT | 63.2% | 74.4s | 515 | 2,196 |
| Mistral Large 3 675B | 63.0% | 41.6s | 504 | 3,764 |
| Mistral Small 2603 | 62.5% | 23.8s | 516 | 4,143 |
| Qwen3.5-35B-A3B | 62.0% | 30.7s | 522 | 4,213 |
| Qwen3.5-35B-A3B | 60.0% | 67.1s | 522 | 9,125 |
| Claude Haiku 4.5 | 59.5% | 97.6s | 549 | 16,637 |
| DeepSeek-R1 | 59.5% | 117.0s | 471 | 1,987 |
| DeepSeek-R1 | 58.8% | 114.7s | 473 | 2,199 |
| Gemma 4 26B A4B IT | 58.8% | 40.4s | 516 | 2,572 |
| Mistral Small 2603 | 57.8% | 21.6s | 516 | 3,681 |
| Qwen3.5-35B-A3B | 56.5% | 73.3s | 522 | 8,530 |
| Gemma 4 26B A4B IT | 54.5% | 37.5s | 515 | 1,905 |
| Llama 4 Maverick | 52.0% | 102.2s | 469 | 1,640 |
| Llama 3.3 70B Instruct | 51.5% | 38.4s | 479 | 1,289 |
| Llama 3.3 70B Instruct | 49.5% | 22.0s | 479 | 1,170 |
| DeepSeek-R1-Distill-Qwen-32B | 45.3% | 174.1s | 495 | 1,720 |
| Llama 3.3 70B Instruct | 45.0% | 34.6s | 498 | 1,208 |
| Llama 4 Maverick | 44.3% | 33.4s | 469 | 1,679 |
| Llama 4 Scout | 43.8% | 16.9s | 469 | 1,202 |
| Gemini 3.1 Flash-Lite | 42.5% | 4.6s | 500 | 1,043 |
| Llama 4 Scout | 42.3% | 41.5s | 469 | 1,034 |
| Llama 3.3 70B Instruct | 42.3% | 17.6s | 479 | 1,220 |
| Llama 4 Scout | 40.8% | 39.5s | 469 | 992 |
| Llama 4 Scout | 36.0% | 46.1s | 469 | 1,114 |
| Llama 4 Maverick | 20.3% | 34.3s | 581 | 519 |
Tags
batch_recordtablet_manufacturingwet_granulationdocumentation