That is just for that very moment. But if you close the interface and look at it later, there is no mention of Self-Defense being disabled anywhere. So you can and you will forget to set it back. Only thing that reflects the status is that checkbox under Troubleshooting section.