How much can we really trust background agents?