Grabbing specific elements inside DIV from external page

Question

I need to scrap the following elements inside each one of these div's class="product-grid-item" (page contains several of them), but in fact I have no clue how to do it... so, I need help not to pull my hair out.

1 - The link and image inside the div: class="product-element-top2;

(just need the link)

The title goes here (just the title)

3 - Last but not least, I need to grab tha price inside this;

€20,00 (just the "€20.00")

Here's the full HTML:




    
            
    
    

        The title goes here        
                
        
    €20,00

        
            Options 
    

    
                            
                Buy
            
    
                quick view
            
                            
                Wishlist
            
            
                
                Close

One of my clumsy attempts:

$html = file_get_contents("https://url-here.goetohere");
$DOM = new DOMDocument();
$DOM->loadHTML($html);
$finder = new DomXPath($DOM);
$classname = 'product-grid-item';
$classname = 'product-element-top2';
$classname = 'product-element-top2';
$classname = 'wd-entities-title';
$classname = 'price';
$nodes = $finder->query("//*[contains(@class, '$classname')]");
foreach ($nodes as $node) {
    echo 'here »» ' . htmlentities($node->nodeValue) . '
';
}

Professor Abronsius · Answer

Assuming that the HTML is being fetched correctly prior to attempting any DOM processing then it is fairly straightforward to construct some basic XPath expressions to find the indicated content.

As per the comment page contains several of them there are 2 product-grid-item divs as you'll note in the output.

$html='
    
        
            
                
            
            
                
                    The title goes here
                
                
                    
                        
                            €20,00
                        
                    
                
                
                    
                        Options
                    
                 
            

            
                
                    Buy
                
                
                    quick view
                
                
                    Wishlist
                
            
            
                
                    Close
                
                
            
        
    
    
    
        
            
                
            
            
                
                    Oh look, another title!
                
                
                    
                        
                            €540,00
                        
                    
                
                
                    
                        Options
                    
                 
            

            
                
                    Buy
                
                
                    quick view
                
                
                    Wishlist
                
            
            
                
                    Close
                
                
            
        
    ';

To process the downloaded HTML

# set the libxml parameters and create new DOMDocument/XPath objects.
libxml_use_internal_errors( true );
$dom=new DOMDocument;
$dom->validateOnParse=false;
$dom->strictErrorChecking=false;
$dom->recover=true;
$dom->loadHTML( $html );
libxml_clear_errors();

$xp=new DOMXPath( $dom );

# some basic XPath expressions
$exprs=(object)array(
    'product-link'      =>  '//a[@class="product-image-link"]',
    'product-img-src'   =>  '//a[@class="product-image-link"]/img',
    'h3-title-text'     =>  '//h3[@class="wd-entities-title"]',
    'price'             =>  '//span[@class="price"]/span/bdi'
);
# find the keys (for convenience) to be used below
$keys=array_keys( get_object_vars( $exprs ) );

# store results here
$res=array();

# loop through all patterns and issue XPath query.
foreach( $exprs as $key => $expr ){
    # add key to output and set as an array.
    $res[ $key ]=[];
    $col=$xp->query( $expr );
    
    # find the data if the query succeeds
    if( $col && $col->length > 0 ){
        foreach( $col as $node ){
            switch( $key ){
                case $keys[0]:$res[$key][]=$node->getAttribute('href');break;
                case $keys[1]:$res[$key][]=$node->getAttribute('src');break;
                case $keys[2]:$res[$key][]=trim($node->textContent);break;
                case $keys[3]:$res[$key][]=trim($node->textContent);break;
            }
        }
    }
}
# show the result or do really interesting things with the data
printf('%s',print_r($res,true));

Which yields:

Array
(
    [product-link] => Array
        (
            [0] => https://...linkhere
            [1] => https://www.example.com/banana
        )

    [product-img-src] => Array
        (
            [0] => https://image-goes-here.jpg
            [1] => https://www.example.com/kittykat.jpg
        )

    [h3-title-text] => Array
        (
            [0] => The title goes here
            [1] => Oh look, another title!
        )

    [price] => Array
        (
            [0] => â¬20,00
            [1] => â¬540,00
        )

)

Grabbing specific elements inside DIV from external page

1 Answers