I am trying to scrap class availability on my colleges website using puppeteer. I successfully did it with selenium but I am having trouble with puppeteer. When I click enter on the form, the next page is blank regardless of what I input.
what it shows when i browse myself
what it shows when i use puppeteer
Heres the code I used, it just opens the website, selects the semester and class number and presses enter:
const puppeteer = require('puppeteer')
async function start() {
const browser = await puppeteer.launch({headless:false})
var [page] = await browser.pages();
await page.goto("https://usfweb.usf.edu/DSS/StaffScheduleSearch")
await page.select('#P_SEMESTER', "202208")
await page.type("#P_REF", "81151")
await page.click("button[value='Search']")
}
start()
It works in selenium, and i tried opening the website on chromium and it works there to. Thank you to anyone who gives advice!
