You can also just use du -hs, eg. to show the size of all subdirectories under ~/Library/Caches/ do:

  du -hs ~/Library/Caches/*