I can’t believe I haven’t fixed this before. Installing the qlmarkdown plugin so macOS’s Quick Look can display markdown files. I think it also allows spotlight to index the full text of markdown files.

Install using homebrew:

brew cask install qlmarkdown

See also this relevant stackexchange question.