How to host a HTML site on WordPress without using any theme? Is that Possible?

I want to host my HTML coded site (it's just HTML) on WordPress without any themes, is that possible? To remove the theme but still use WordPress to host and access the HTML pages, how would that be done? Where would I paste the HTML then if I remove the theme?

I also noticed when I try to remove the themes manually, it collapses WordPress and I can't access the WP-admin control panel. So how do I keep WordPress instated and accessible without a theme installed on it?

Please see this quick 1:50 second video: http://youtu.be/5Jd_KV3p5Kw (it shows a demo of it)