Assistance Logging in Site via Python

vahnx 0
Viewed 22

I'm trying to make a script to auto-login to this website and I'm having some troubles. I was hoping I could get assistance with making this work. I have the below code assembled but I get 'Your request cannot be processed at this time\n' in the bottom of what's returned to me when I should be getting some different HTML if it was successful:

from pyquery import PyQuery
import requests

url = 'https://licensing.gov.nl.ca/miriad/sfjsp?interviewID=MRlogin'
values = {'d_1553779889165': 'email@email.com',
          'd_1553779889166': 'thisIsMyPassw0rd$$$',
          'd_1618409713756': 'true',
          'd_1642075435596': 'Sign in'
          }
r = requests.post(url, data=values)
print (r.content)
automation web-scraping html python
1 Answers

I do this in .NET, but I think the logic can be written in Python as well. Firstly, I always use Fiddler to capture requests that a webpage sends then identify the request which you want to replicate and add all the cookies and headers that are sent with it in your code.

After sending the login request you will get some cookies that will identify that you've logged in and you use those cookies to proceed further in your site. For example, if you want to retrieve user's info after logging in first you need to trick the server thinking that you are logged in and that is where those log in cookies will help you

Also, I don't think the login would be so simple through a script because if you're trying to automate a government site, they may have some anti-bot security there lying there, some kind of fingerprint or captcha.

Hope this helps!

Hamzah Saleem0
Related