GMP Bench
← Back to Test Cases

gmp-001

GMP KnowledgeGeneral Gmpeasy
Question

According to 21 CFR 211.192, what is required when any unexplained discrepancy or failure of a batch to meet specifications is found?

Choices

  1. A. The batch should be immediately destroyed
  2. B. A thorough investigation should be made, extending to other batches that may have been associated with the specific failure or discrepancy
  3. C. Only the affected batch needs to be quarantined; no investigation is needed
  4. D. The discrepancy can be noted in the batch record without further action

Cross-Model Comparison

ModelScoreLatencyTokens InTokens Out
Qwen3.8-FlashN/AN/A--
GLM-5.3N/AN/A--
MiniMax M3N/AN/A--
Hy4 PreviewN/AN/A--
Muse Glimmer 30BN/AN/A--
Qwen3.8 Max (2.4T-A95B)N/AN/A--
Claude Sonnet 4.6100.0%8.1s115322
Llama 4 Scout100.0%5.1s108401
Claude Opus 4.6100.0%9.2s115332
Llama 4 Maverick100.0%6.4s109406
Llama 3.3 70B Instruct100.0%1.9s110178
Mistral Small 2603100.0%1.7s119279
Qwen3.5-397B-A17B100.0%12.7s115844
DeepSeek-R1100.0%12.1s107406
DeepSeek-R1-Distill-Qwen-32B100.0%52.1s107615
Mistral Large 3 675B100.0%3.4s107199
Gemini 3 Flash100.0%2.0s102138
DeepSeek V4 Pro100.0%6.6s101354
Gemini 3.1 Pro100.0%6.5s102607
Gemini 3.1 Flash-Lite100.0%1.4s102143
Qwen3.6 27B100.0%19.8s115897
DeepSeek V4 Flash100.0%3.2s161156
Qwen3.6 35B A3B100.0%5.1s1151,066
DeepSeek-V3.2100.0%4.0s101107
DeepSeek V4 Flash100.0%4.2s101405
Gemma 4 26B A4B IT100.0%2.9s115160
Gemma 4 31B IT100.0%7.5s115139
Llama 4 Maverick100.0%11.0s166330
Claude Opus 4.8100.0%5.4s150327
GLM-5.2100.0%11.7s111358
Qwen3.8 27B100.0%8.2s219277
Llama 4 Scout100.0%8.0s166225
Llama 3.3 70B Instruct100.0%47.7s169357
Mistral Small 2603100.0%2.8s182341
Qwen3.5-35B-A3B100.0%8.8s1771,017
Mistral Large 3 675B100.0%2.2s170148
Qwen3.6 27B100.0%30.5s1771,112
Qwen3.6 35B A3B100.0%6.9s1771,409
Hy4 Preview100.0%8.8s178673
Qwen3.5-397B-A17B100.0%6.9s177568
DeepSeek V4 Pro100.0%6.9s16156
DeepSeek-V3.2100.0%6.2s167133
Claude Sonnet 5100.0%1.3s2389
Gemma 4 26B A4B IT100.0%2.8s177204
DeepSeek-R1100.0%59.8s160927
Gemma 4 26B A4B IT100.0%7.8s177212
Gemma 4 31B IT100.0%12.5s177184
MiniMax M2.7100.0%5.6s198419
GLM-5.2100.0%17.5s171549
Kimi K3100.0%11.1s244401
Muse Glimmer 30B100.0%6.1s213389
GLM-5.3-Flash100.0%6.7s171255
GPT-5.6 Luna100.0%1.7s16288
GPT-5.4 mini100.0%736ms10430
MiniMax M2.7100.0%2.5s139310
GPT-5.4 nano100.0%1.4s10469
Claude Haiku 4.5100.0%2.4s115273
DeepSeek-V3.2100.0%24.2s101109
GPT-5.4100.0%1.6s10467
Qwen3.8 Max (2.4T-A95B)100.0%2.1s219181
Qwen3.8-Flash100.0%1.7s228138
MiniMax M3100.0%1.8s333324
GLM-5.3100.0%1.8s172147
Claude Opus 5100.0%7.6s238449
Claude Haiku 4.5100.0%2.5s179232
GPT-5.6 Sol100.0%2.1s16247
GPT-5.6 Terra100.0%1.8s16268
Qwen3.5-35B-A3B0.0%6.0s1151,039

Tags

deviationsinvestigationbatch_disposition