It makes a little sense, for instance say you've got a public server on a fixed IP that an attacker manages to exfiltrate the key but nothing else. This'd keep them out of your network.

But I think it'd probably be better to alert the administrator rather than simply blocking them.