Thinking-tag wrapper amplifies technical injection ASR on GLM-5.3-Flash ~14x (1.2% → 17.5%) despite model using separate reasoning channel
Auto-published from arXiv:2611.08811 by the mine-arxiv pipeline. Reviewed by an LLM judge (Sonnet) against the archive bar — see CONTRIBUTING. Notes: cleared review (confidence 0.78, flags: [possible-zero-day, no-prompt-excerpt])
Category
prompt-injection
Model
GLM-5.3-Flash (320B parameters)
Surface
API, single-turn, no tool execution
Setup
Attacker controls only the user-role message, which contains an injected reasoning block immediately followed by a benign data request. The 'technical injection' family includes deep nested think blocks (e.g.,
Reproduction anchor
framework: Inspect AI (https://github.com/UKGovernmentBEIS/inspect_ai); attack taxonomy with representative example prompts in Table I (Section III); exact 100-prompt attack set across 10 subcategories described in Section III-A; full prompt variants deferred to appendices not in this extract. Results in Table II and Figure 3.
Observed behavior
With thinking tags, technical injection attacks against GLM-5.3-Flash succeed in 17.5% of runs; without tags, only 1.2% — a ~14-fold amplification. This is the largest tag-effect observed across all models and attack families. Paradoxically, GLM-5.3 uses a separate reasoning/response architecture (not
Expected behavior
Security rules embedded in the system prompt refuse all PII disclosure regardless of tag structure or injected reasoning content in the user message.
Reproducibility
medium
Threat model
Any production deployment that grants an LRM privileged access to PII (CRM systems, financial records, HR data) and exposes a user-query interface. An attacker with access to the user turn — including indirect channels like documents or tool outputs — can use structurally styled injections to override context-level security rules. The attack is especially dangerous when the model's reasoning channel is not monitored.
Novelty
Demonstrates counterintuitive model-specific tag-sensitivity: the model that architecturally retired
Source
- arXiv: 2611.08811
- PDF: https://arxiv.org/pdf/2611.08811
- Categories: cs.AI, cs.CR
- Authors: Parth Illendula, Garik Livingston, Zain Shamsi, Ravi Srinivasan, Alex Liu
Triage notes (auto)
- paperType:
red-team-vuln - estimatedCaseCount: 3
- triage reason: Demonstrates concrete thought-injection vulnerabilities against production reasoning models (GLM-5.3, MiniMax-M2.5, Qwen3.8-Flash-Next) with 50% ASR on operational objectives; freshly submitted with no explicit vendor disclosure mentioned.
0 comments
─────────────────────────────────────────────────────────────────────
// no comments yet