Take a look at this extension called **Delete My Account

http://extensions.joomla.org/extensions/clients-a-communities/user-management/26011

It allows users to delete their own account via the frontend. There is also a feature where it notifies all admins if a user has deleted their account. Looks like a promising extension and exactly what you need. Compatible with Joomla 2.5 and 3.x