2

i'm trying to extract data (logo image, name, location, etc) from this website : https://websummit.com/startups/featured-startups?q=eyJwYWdlIjoxLCJjb25maWd1cmUiOnsiaGl0c1BlclBhZ2UiOjQ4LCJ0YWdGaWx0ZXJzIjpbIndzMjEiXX19

The problem is that when clicking on an image, a visual popup appears (the url doesn't change) so i tried various selectors (site map example i used : home >> popup selector (with the Multiple option) >> text selectors for name, location etc) but none of them works (i could see the data but after scraping no data is available)

Can someone please tell me what's wrong with the site map or what selectors to use to access the data in the visual popups ?

General Grievance
  • 4,555
  • 31
  • 31
  • 45
Chihiro
  • 21
  • 1
  • This thread might be helpful for you: https://stackoverflow.com/questions/27789023/interacting-with-pop-up-boxes-using-selenium-in-python – Kazi Sep 23 '21 at 19:27

1 Answers1

4

Instead of using the selector button, I used the popup link selector with CSS I extracted from the page, then selected multiple checkboxes

ID  Selector    type    Multiple    Parent selectors    Actions
startup-logo    .MuiPaper-root.MuiCard-root.jss51.MuiPaper-elevation1.MuiPaper-rounded  SelectorPopupLink   yes _root

enter image description here

I've also created the following child selector

ID  Selector    type    Multiple    Parent selectors    Actions
startup-name    span.jss53  SelectorText    no  startup-logo

enter image description here

enter image description here

This approach works for me for all other selectors, but it does not work for PopupLink, which leads me to believe the popup link selector is broken.

This is corroborated by multiple pages saying the plugin returns no data.

So essentially, stop using this plugin and instead use other alternatives. Here's a few that I know of:

Alternatively, if you are willing a bit of programming, take a look at selenium as it is the ultimate tool for gathering data.

Zyy
  • 764
  • 9
  • 12