MatthewJohnSymons MatthewJohnSymons - 7 months ago 55
PHP Question

PHP Web Scraping from table HTML tags

I'm looking at scraping data from a website, from a table, and display in a clean table in PHP.

Website example is below, you will notice the table of flight data. Any idea on how I can get PHP to loop over the data and place it into a table?

Data Example

Answer

Yes, i would recommend using Xpath

<h1>This is scraping flight radar:</h1>
   <?php
    $url = "https://www.flightradar24.com/data/flights/southwest-airlines-wn-swa";
    $html = file_get_contents($url);
    libxml_use_internal_errors(true);
    $doc = new \DOMDocument();
    if($doc->loadHTML($html))
    {
        $result = new \DOMDocument();
        $result->formatOutput = true;
        $table = $result->appendChild($result->createElement("table"));
        $thead = $table->appendChild($result->createElement("thead"));
        $tbody = $table->appendChild($result->createElement("tbody"));

        $xpath = new \DOMXPath($doc);

        $newRow = $thead->appendChild($result->createElement("tr"));

        foreach($xpath->query("//table[@id='tbl-datatable']/thead/tr/th[position()>1]") as $header)
        {
            $newRow->appendChild($result->createElement("th", trim($header->nodeValue)));
        }

        foreach($xpath->query("//table[@id='tbl-datatable']/tbody/tr") as $row)
        {
            $newRow = $tbody->appendChild($result->createElement("tr"));

            foreach($xpath->query("./td[position()>1 and position()<7]", $row) as $cell)
            {
                $newRow->appendChild($result->createElement("td", trim($cell->nodeValue)));
            }
        }

        echo $result->saveXML($result->documentElement);
    }
    ?>