Is there a simple, self-hosted blog that supports images, Latex, code highlighting, etc., that is easy to setup and configure? I don't want to rely on someones service for my content.

I've used Jekyll in the past, and while it supports Markdown quite well, I'm not sure about its native support for LaTeX. You might need to integrate MathJax or another JavaScript library to render LaTeX properly.