I have a simple LaTex code in my R notebook as
Display equations (surrounded with
$$) preview as a chunk result rather than a popup, as inline equations (
However, note that
$$ will print the math in its own paragraph/div while
$ produces inline output. AFAIK, there is no way to have inline equations preview without hovering over them.