Apostrophe rendered differently in html, notebook and Rstudio

Question

This is a problem I have been having for the longest time and have found no solution.

When a rmd file below is used to render html, notebook and pdf, the apostrophe is rendered differently. In Rstudio it is also rendered differently.

---
title: "R Notebook"
output: 
  html_document: default
  html_notebook: default
  pdf_document: default
---

```{r}
library(tidyverse)
```

I am using RStudio (Version 1.3.1093) on Windows 10 Pro Language settings on English USA

How to fix such that the Rstudio and notebook renders the apostrophe correctly?

HTML Document render

Notebook document render

PDF Document render

RStudio Rmarkdown render