Humanbound website
Ayan Pahwa

Agentic AI consultant

Ayan Pahwa

Humanbound cover: "Not every model makes a good attacker: OpenAI vs DeepSeek for red-teaming". A bad-refund panel over 97 conversations per run shows deepseek-v4.1-flash at 42% and 52% against gpt-6-luna at 7% and 10%, with the target listed as a LangChain support bot on gpt-4o-mini.

Not every model makes a good attacker: OpenAI vs DeepSeek for red-teaming

Two attacker models, one deliberately weak LangChain support bot, 97 conversations per run. DeepSeek V4.1 Flash talked it into refunding orders that do not exist far more often than OpenAI's gpt-6-luna, with the transcripts, the costs and what the numbers do not prove.

Ayan Pahwa
Ayan Pahwa
Read