HTML5 video was meant to be this easy. html5media enables <video> and <audio> tags in all major browsers.

Visit “HTML5 video and audio tags in all major browsers”