Can I remove a grinder guard because it gets in the way?

No. Guards are safety equipment. Removing or defeating a guard significantly increases the risk of serious injury from wheel contact, fragments, or kickback.