I can second iScribe. It does everything you want. I use it on a USB
drive all the time.
The HTML capabilites are sometimes a little limited because it has its
own system instead of using IE. But, that also means that you don't
have the IE security flaws.