How to select html tr elements with a specific td class

SchoolOfTheYear 0
Viewed 45

I am using selenium to scrape a website, the website has a calendar and i want to get the days out of that calendar that have available times. I have inspected the calendar and found these elements

<table class="ui-datepicker-calendar">
   <thead>
      <tr>
         <th scope="col"><span title="Monday">Mån</span></th>
         <th scope="col"><span title="Tuesday">Tis</span></th>
         <th scope="col"><span title="Wednesday">Ons</span></th>
         <th scope="col"><span title="Thursday">Tor</span></th>
         <th scope="col"><span title="Friday">Fre</span></th>
         <th scope="col" class="ui-datepicker-week-end"><span title="Saturday">Lör</span></th>
         <th scope="col" class="ui-datepicker-week-end"><span title="Sunday">Sön</span></th>
      </tr>
   </thead>
   <tbody>
      <tr>
         <td class=" ui-datepicker-other-month ui-datepicker-unselectable ui-state-disabled unavailable"><span class="ui-state-default">29</span></td>
         <td class=" ui-datepicker-other-month ui-datepicker-unselectable ui-state-disabled unavailable"><span class="ui-state-default">30</span></td>
         <td class=" ui-datepicker-other-month ui-datepicker-unselectable ui-state-disabled unavailable"><span class="ui-state-default">31</span></td>
         <td class=" ui-datepicker-unselectable ui-state-disabled unavailable"><span class="ui-state-default">1</span></td>
         <td class=" ui-datepicker-unselectable ui-state-disabled unavailable"><span class="ui-state-default">2</span></td>
         <td class=" ui-datepicker-week-end ui-datepicker-unselectable ui-state-disabled unavailable"><span class="ui-state-default">3</span></td>
         <td class=" ui-datepicker-week-end ui-datepicker-unselectable ui-state-disabled unavailable"><span class="ui-state-default">4</span></td>
      </tr>
      <tr>
         <td class=" ui-datepicker-unselectable ui-state-disabled unavailable"><span class="ui-state-default">5</span></td>
         <td class=" ui-datepicker-unselectable ui-state-disabled unavailable"><span class="ui-state-default">6</span></td>
         <td class=" ui-datepicker-unselectable ui-state-disabled unavailable"><span class="ui-state-default">7</span></td>
         <td class=" ui-datepicker-unselectable ui-state-disabled unavailable"><span class="ui-state-default">8</span></td>
         <td class=" ui-datepicker-unselectable ui-state-disabled unavailable"><span class="ui-state-default">9</span></td>
         <td class=" ui-datepicker-week-end ui-datepicker-unselectable ui-state-disabled unavailable"><span class="ui-state-default">10</span></td>
         <td class=" ui-datepicker-week-end ui-datepicker-unselectable ui-state-disabled unavailable"><span class="ui-state-default">11</span></td>
      </tr>
      <tr>
         <td class=" unavailable ui-datepicker-today" data-handler="selectDay" data-event="click" data-month="8" data-year="2022"><a class="ui-state-default ui-state-highlight" href="#">12</a></td>
         <td class=" available" data-handler="selectDay" data-event="click" data-month="8" data-year="2022"><a class="ui-state-default" href="#">13</a></td>
         <td class=" available" data-handler="selectDay" data-event="click" data-month="8" data-year="2022"><a class="ui-state-default" href="#">14</a></td>
         <td class=" unavailable" data-handler="selectDay" data-event="click" data-month="8" data-year="2022"><a class="ui-state-default" href="#">15</a></td>
         <td class=" unavailable" data-handler="selectDay" data-event="click" data-month="8" data-year="2022"><a class="ui-state-default" href="#">16</a></td>
         <td class=" ui-datepicker-week-end unavailable" data-handler="selectDay" data-event="click" data-month="8" data-year="2022"><a class="ui-state-default" href="#">17</a></td>
         <td class=" ui-datepicker-week-end unavailable" data-handler="selectDay" data-event="click" data-month="8" data-year="2022"><a class="ui-state-default" href="#">18</a></td>
      </tr>
      <tr>
         <td class=" unavailable" data-handler="selectDay" data-event="click" data-month="8" data-year="2022"><a class="ui-state-default" href="#">19</a></td>
         <td class=" unavailable" data-handler="selectDay" data-event="click" data-month="8" data-year="2022"><a class="ui-state-default" href="#">20</a></td>
         <td class=" unavailable" data-handler="selectDay" data-event="click" data-month="8" data-year="2022"><a class="ui-state-default" href="#">21</a></td>
         <td class=" unavailable" data-handler="selectDay" data-event="click" data-month="8" data-year="2022"><a class="ui-state-default" href="#">22</a></td>
         <td class=" unavailable" data-handler="selectDay" data-event="click" data-month="8" data-year="2022"><a class="ui-state-default" href="#">23</a></td>
         <td class=" ui-datepicker-week-end unavailable" data-handler="selectDay" data-event="click" data-month="8" data-year="2022"><a class="ui-state-default" href="#">24</a></td>
         <td class=" ui-datepicker-week-end unavailable" data-handler="selectDay" data-event="click" data-month="8" data-year="2022"><a class="ui-state-default" href="#">25</a></td>
      </tr>
      <tr>
         <td class=" unavailable" data-handler="selectDay" data-event="click" data-month="8" data-year="2022"><a class="ui-state-default" href="#">26</a></td>
         <td class=" unavailable" data-handler="selectDay" data-event="click" data-month="8" data-year="2022"><a class="ui-state-default" href="#">27</a></td>
         <td class=" unavailable" data-handler="selectDay" data-event="click" data-month="8" data-year="2022"><a class="ui-state-default" href="#">28</a></td>
         <td class=" unavailable" data-handler="selectDay" data-event="click" data-month="8" data-year="2022"><a class="ui-state-default" href="#">29</a></td>
         <td class=" unavailable" data-handler="selectDay" data-event="click" data-month="8" data-year="2022"><a class="ui-state-default" href="#">30</a></td>
         <td class=" ui-datepicker-week-end ui-datepicker-other-month ui-datepicker-unselectable ui-state-disabled unavailable"><span class="ui-state-default">1</span></td>
         <td class=" ui-datepicker-week-end ui-datepicker-other-month ui-datepicker-unselectable ui-state-disabled unavailable"><span class="ui-state-default">2</span></td>
      </tr>
   </tbody>
</table>

as you can see the days that have times available have td class= " available" those are the days I want to save and keep in a list.

I have managed to get the day number printed out so I seem to have all the rows saved as elements since when I do

avail = driver.find_elements(By.CLASS_NAME,"ui-datepicker-calendar")

for elem in avail:
    print(elem.text)

the output I get is 29,30,31,1,2,3,4...

How do I only save the rows that have td class= " available"?

xpath class web-scraping selenium html-table
1 Answers

UPD
Since the parent td class may contain additional class names we can use contains instead of equals and use not to exclude unavailable dates. As following:

avail = driver.find_elements(By.XPATH,"//td[not(contains(@class,'unavailable'))]//a[@class='ui-state-default']")

for elem in avail:
    print(elem.text)
Prophet0
Related