Hi @KBloom, welcome to the community 
I had the same problem and couldn't make it work 
After some digging I found a pretty neat rich text editor implementation that extends easily, Quill.js.
Retool's rich text component uses quill under the hood. You can create custom component and fine-tune it as you like. I've documented a snippet here.
Hope that helps