How to use webpack to concat html pieces?

For example, I have a main entry html file:

<div>
   <!-- I'd like to include a html partial here -->
</div>

And I have a partial html

<span>I'm a partial html piece</span>

I hope that I can use webpack to generate a final html like below:

<div>
  <span>I'm a partial html piece</span>
</div>

Is it possible to do this with webpack plugin/loaders?