extract reCaptcha from web page to be completed externally via cURL and then return results to view page

Seeing that the community on Stack overflow didn't bother to respond to my question I had to go through hours of trial and error and have found the solution. I figured since I actually want to benefit the community I would answer my own question:

The issue here was that the site I was scraping has setup scraper detection and not that of a recaptcha as I had before thought. So after some tinkering with my scraper I have managed to give it the ability to bypass the sites detection. I wont bother sharing code seeing that there is noone else having this issue, but I had to better represent my scraper as a actual browser.

If anyone else finds themselves running into this kind of issue, feel free to contact me and I will share some of my code.

based on the high demand for code, HERE is my upgraded scraper that bypassed this specific issue. However my attempt to obtain the captcha did not work and I still have not solved how to obtain it.

  include "simple_html_dom.php";
  /**
   * Get a web file (HTML, XHTML, XML, image, etc.) from a URL.  Return an
   * array containing the HTTP server response header fields and content.
   */
  // This function is where the Magic comes from. It bypasses ever peice of security carsales.com.au can throw at me
  function get_web_page( $url ) { 
    $options = array(
        CURLOPT_RETURNTRANSFER => true,     // return web page
        CURLOPT_HEADER         => false,    // don't return headers
        CURLOPT_FOLLOWLOCATION => true,     // follow redirects
        CURLOPT_ENCODING       => "",       // handle all encodings
        CURLOPT_USERAGENT      => "spider", // who am i
        CURLOPT_AUTOREFERER    => true,     // set referer on redirect
        CURLOPT_CONNECTTIMEOUT => 120,      // timeout on connect
        CURLOPT_TIMEOUT        => 120,      // timeout on response
        CURLOPT_MAXREDIRS      => 10,       // stop after 10 redirects
        CURLOPT_SSL_VERIFYPEER => false     // Disabled SSL Cert checks
    );

    $ch      = curl_init( $url ); //initiate the Curl program that we will use to scrape data off the webpage
    curl_setopt_array( $ch, $options ); //set the data sent to the webpage to be readable by the webpage (JSON)
    $content = curl_exec( $ch ); //creates function to read pages content. This variable will be used to hold the sites html
    $err     = curl_errno( $ch ); //errno function that saves all the locations our scraper is sent to. This is just for me so that in the case of a error,
    //I can see what parts of the page has it seen and more importantly hasnt seen
    $errmsg  = curl_error( $ch ); //check error message function. for example if I am denied permission this string will be equal to: 404 access denied
    $header  = curl_getinfo( $ch ); //the information of the page stored in a array
    curl_close( $ch ); //Closes the Curler to save site memory

    $header['errno']   = $err; //sending the header data to the previously made errno, which contains a array path of all the places my scraper has been
    $header['errmsg']  = $errmsg; //sending the header data to the previously made error message checker function.
    $header['content'] = $content; //sending the header data to the previously made content checker that will be the variable holder of the webpages HTML.
    return $header; //Return all the pages data and my identifying functions in a array. To be used in the presentation of the search results.
  };

  //using the function we just made, we use the url genorated by the form to get a developer view of the scraping.
  $response_dev = get_web_page($url);
  
  // print_r($response_dev);

  $response = end($response_dev); //takes only the end of the developer response because the rest is for my eyes only in  the case that the site runs into a issue

Datadome is currently utilizing Recaptcha v2 and GeeTest captchas, so this is what your script should do:

1. Navigate to redirection https://geo.captcha-delivery.com/captcha/?initialCid=….
2. Detect what type of captcha is used.
3. Obtain token for this captcha using any captcha solving service like Anti Captcha.
4. Submit the token, check if you were redirected to the target page.
5. Sometimes target page contains an iframe with address https://geo.captcha-delivery.com/captcha/?initialCid=.. , so you need to repeat from step 2 in this iframe.

I’m not sure if steps above could be made with PHP, but you can do it with browser automation engines like Puppeteer, a library for NodeJS. It launches a Chromium instance and emulates a real user presence. NodeJS is a must you want to build pro scrapers, worth investing some time in Youtube lessons. Here’s a script which does all steps above: https://github.com/MoterHaker/bypass-captcha-examples/blob/main/geo.captcha-delivery.com.js You’ll need a proxy to bypass GeeTest protection.