Verify model provenance before granting agent tools
Source: Microsoft Research
Microsoft Research reports a method that changes a few dormant neurons without retraining. An agent can behave normally until a hidden trigger causes it to issue an attacker command. This is a research demonstration, not evidence of attacks in customer deployments; the risk is acute when an agent has terminal or other powerful tool access.
Why this matters: Record the model publisher and trusted checkpoint, check weight integrity, restrict tool and secret access, and review consequential commands. Standard behavior tests alone cannot establish that a model has not been altered.
Read Microsoft's model-backdoor research