An SEO's Guide to Video Hosting and Embedding

How should you host your videos for SEO purposes? Is it better to use YouTube, Vimeo or third party hosting? It depends on the style of your content and what you want to achieve with it.