It seems that ruby 2.0.0 has added "default" gems to the mix and makes them non removable by gem uninstall.
How can you remove all non default gems?