GMP Bench
← Back to Test Cases

ichq7-003

GMP KnowledgeIch Q7hard
Question

According to ICH Q7, which of the following best describes the requirements for impurity profiles of APIs?

Choices

  1. A. Impurity profiles are only needed for APIs used in clinical trials
  2. B. The impurity profile should be compared at appropriate intervals against the impurity profile in the regulatory submission, and it should describe identified and unidentified impurities
  3. C. Only genotoxic impurities require profiling; other impurities need only meet overall purity limits
  4. D. Impurity profiles need only be established once during initial development and do not require ongoing monitoring

Cross-Model Comparison

ModelScoreLatencyTokens InTokens Out
GLM-5.3N/AN/A--
Qwen3.8-FlashN/AN/A--
Qwen3.8 Max (2.4T-A95B)N/AN/A--
Hy4 PreviewN/AN/A--
Muse Glimmer 30BN/AN/A--
MiniMax M3N/AN/A--
Llama 4 Scout100.0%1.1s114410
Llama 4 Maverick100.0%3.4s183394
Llama 3.3 70B Instruct100.0%10.3s120195
Mistral Small 2603100.0%2.0s119308
DeepSeek-V3.2100.0%4.8s113126
DeepSeek-R1100.0%22.4s113852
DeepSeek-R1-Distill-Qwen-32B100.0%26.4s112595
Mistral Large 3 675B100.0%6.2s107355
Gemini 3.1 Pro100.0%13.7s103848
Gemini 3 Flash100.0%1.9s103220
Gemini 3.1 Flash-Lite100.0%1.8s104214
Qwen3.6 27B100.0%44.2s1201,590
Qwen3.6 35B A3B100.0%5.4s120998
DeepSeek V4 Pro100.0%12.0s107446
DeepSeek-V3.2100.0%6.5s113103
Llama 4 Scout100.0%13.6s172372
DeepSeek V4 Flash100.0%13.5s107496
Gemma 4 26B A4B IT100.0%7.2s116248
Gemma 4 31B IT100.0%7.6s116250
MiniMax M2.7100.0%11.4s146628
Claude Opus 4.8100.0%7.9s179556
GLM-5.2100.0%6.8s121793
Llama 4 Maverick100.0%6.4s172303
Llama 3.3 70B Instruct100.0%10.8s180343
Mistral Small 2603100.0%2.3s182288
Mistral Large 3 675B100.0%3.5s170215
Qwen3.5-35B-A3B100.0%12.2s1821,202
Qwen3.6 27B100.0%30.9s1821,062
Qwen3.6 35B A3B100.0%49.2s1821,410
Qwen3.5-397B-A17B100.0%13.5s1821,174
DeepSeek V4 Pro100.0%7.4s167420
DeepSeek-V3.2100.0%6.7s173149
DeepSeek V4 Flash100.0%3.0s167117
DeepSeek-R1100.0%75.6s166862
Gemma 4 26B A4B IT100.0%4.3s178274
Gemma 4 26B A4B IT100.0%5.8s178271
Gemma 4 31B IT100.0%4.6s178199
Hy4 Preview100.0%22.9s1841,726
MiniMax M2.7100.0%8.6s204589
GLM-5.2100.0%12.0s181567
Qwen3.8 27B100.0%3.8s292439
Kimi K3100.0%23.9s252839
GLM-5.3-Flash100.0%15.7s181561
Muse Glimmer 30B100.0%5.3s218316
GPT-5.6 Luna100.0%2.1s17078
GPT-5.4 mini100.0%772ms11266
GPT-5.4 nano100.0%641ms11244
Claude Haiku 4.5100.0%4.0s128358
Claude Sonnet 4.6100.0%7.9s128316
Claude Opus 4.6100.0%11.6s128420
GPT-5.6 Terra100.0%1.8s17064
GPT-5.4100.0%3.1s112205
Qwen3.8 Max (2.4T-A95B)100.0%2.1s224160
Qwen3.8-Flash100.0%2.3s233187
MiniMax M3100.0%7.0s339420
GLM-5.3100.0%74.5s18113,837
Claude Opus 5100.0%7.2s267390
Claude Sonnet 5100.0%2.3s2679
Claude Haiku 4.5100.0%3.0s192304
GPT-5.6 Sol100.0%1.8s17040
Qwen3.5-35B-A3B0.0%6.7s1201,043
Qwen3.5-397B-A17B0.0%44.1s1201,288

Tags

impurity_managementimpurity_profilequality_control