Delete a policy

Deletes the specified alerting policy from the application.