If your Group is a confirmed opt-in Group, you can now periodically delete unconfirmed e-mail addresses from your Group. You can do this by performing a "Scrub" on your Group. Along with the usual scrub types (removing unsubscribes, bounces, duplicates, etc.), you can now choose to scrub out unconfirmed Group members.
You can do this as a one-time or a scheduled scrub.