Emacs switching out of terminal

When running terminal mode in Emacs using M-x term using C-x C-o I cannot switch to another buffer to continue working on things. I know that this is possible with M-x shell but with this command there are certain aspects of the shell that do not work (less, more, man pages, etc...). I was wondering if there is a way around this or if when using terminal mode you are confined to the buffer that the terminal is open in until you exit.