You can create Require JS plugin in Magento with text! as a suffix and pass HTML file path in the dependency of the define( ) method in javascript.
An Example of a text plugin in Magento,
'text!Jesadiya_Blog/template/plugin.html'
3x Magento Master