I asked and answered my own question, so I'll post it here in case it helps
If you want a table of figures in Rmarkdown or Bookdown, and you want to use Markdown formatting you cannot put it within the Rmarkdown chunk itself:
```{r chunk1,fig.scap="my *short* caption"}
knitr::include_graphics("some_figure.png")
```