A default Joomla (V3) environment, is 21 MB. The only significant candidate for removal might be the hathor administrator template, and the sample images. Possibly the tinymce editor, but most implementations are likely will want that. Note that anything anything that is removed might return when you perform a regular maintenance update.
Here's an expanded tree showing the larger directories in a default environment.
- / - 21 MB
- /administrator - 6 MB
- /administrator/components - 3 MB
- /administrator/language - 1 MB
- /administrator/templates - 2 MB
- /administrator/templates/hathor - 1 MB
- /administrator/templates/isis - 1 MB
- /components - 1 MB
- /images - 1 MB
- /libraries - 6 MB
- /libraries/cms - 1 MB
- /libraries/fof - 1 MB
- /libraries/joomla - 3 MB
- /media - 5 MB
- /media/editors - 2 MB
- /media/editors/tinymce - 1 MB
- /media/jui - 2 MB
- /media/system - 1 MB
- /plugins - 1 MB
- /templates - 1 MB
There are other directories that might grow that could be removed.
And then there are development directories, but these are only found in a source checkout.