The trick is simple: we can define a specific $\LaTeX$ command for superscripts and subscripts, i.e.:

$\let\sub_ \let\sup^$

before a page document. Then when we use MathJax with Hugo, along with the above definition, we are free from underscores being <em> and so on. No additional CSS is needed.