I can’t believe I haven’t fixed this before. Installing the qlmarkdown plugin so macOS’s Quick Look can display markdown files. I think it also allows spotlight to index the full text of markdown files.
Install using homebrew:
brew cask install qlmarkdown
See also this relevant stackexchange question.