0

I'm new to web scraping and i was trying to scrape through FUTBIN (FUT 22) player database "https://www.futbin.com/players" . My code is below and I don't know why if can't get any sort of results from the FUTBIN page but was successful in other webpages like IMDB.

CODE :`

import requests
from bs4 import BeautifulSoup

request = requests.get("https://www.futbin.com/players")
src = request.content
soup = BeautifulSoup(src, features="html.parser")

results = soup.find("a", class_="player_name_players_table get-tp`enter code here`")
print(results)
Tahsin Wahid
  • 11
  • 1
    Website is protected by Cloudflare - Check your `soup` if the expected content is available. – HedgeHog Jun 02 '22 at 19:13
  • Yes it stops on cloudflare challenge: Please Wait... | Cloudflare as mentioned HedgeHog. It works with playwright i just tried it. PW use real browser and you can bypass. Here you have playwright documentation https://playwright.dev/python/docs/intro. I – MeT Jun 05 '22 at 21:18
  • This post may solve your problem: https://stackoverflow.com/questions/70369790/python-requests-response-403-forbidden – user20029368 Sep 19 '22 at 01:04

0 Answers0