All of the items that you are looking for are not available directly. You can use selenium to click on load more button multiple times to load all the data and the fetch the page source.
Code:
from selenium import webdriver
from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC
from selenium.common.exceptions import TimeoutException
from bs4 import BeautifulSoup
driver = webdriver.Chrome(executable_path='/home/bitto/chromedriver')
url="https://www.washingtonpost.com/graphics/politics/trump-claims-database/?noredirect=on&utm_term=.777b6a97b73d"#your url here
driver.get(url)
claim_list=[]
date_list=[]
source_list=[]
i=50
while i<=50: #change to 9000 to scrape all the texts
element=WebDriverWait(driver, 10).until(EC.presence_of_element_located((By.CSS_SELECTOR ,'button.pg-button')))
element.click()
i+=50
#getting the data and printng it out
soup=BeautifulSoup(driver.page_source,'html.parser')
claim_rows=soup.find_all('div',class_='claim-row')
for row in claim_rows:
date=row.find('div',class_='dateline').text.strip()
claim=row.find('div',class_='claim').text.replace('"','').strip()
source=row.find('div',class_='details not-expanded').find_all('p')[1].find('span').text
claim_list.append(claim)
date_list.append(date)
source_list.append(source)
#we will zip it make it easier to view the output
print(list(zip(date_list,claim_list,source_list)))
Output
[('Mar 3 2019', "“Presidential Harassment by 'crazed' Democrats at the highest level in the history of our Country. Likewise, the most vicious and corrupt Mainstream Media that any president has ever had to endure.”", 'Twitter'), ('Mar 3 2019', "“After more than two years of Presidential Harassment, the only things that have been proven is that Democrats and other broke the law. The hostile Cohen testimony, given by a liar to reduce his prison time, proved no Collusion! His just written book manuscript showed what he said was a total lie, but Fake Media won't show it. I am an innocent man being persecuted by some very bad, conflicted & corrupt people in a Witch Hunt that is illegal & should never have been allowed to start - And only because I won the Election!”", 'Twitter'), ('Mar 3 2019', '“The reason I do not want military drills with South Korea is to save hundreds of millions of dollars for the U.S. for which we are not reimbursed. ”', 'Twitter'), ('Mar 3 2019', "“For the Democrats to interview in open hearings a convicted liar & fraudster, at the same time as the very important Nuclear Summit with North Korea, is perhaps a new low in American politics and may have contributed to the 'walk.' Never done when a president is overseas. Shame!”", 'Twitter'), ('Mar 3 2019', '“The most successful first two years for any President. We are WINNING big, the envy of the WORLD.”', 'Twitter'), ('Mar 2 2019', '“Remember you have Nebraska. We won both [Electoral College votes] in Nebraska. We won the half.”', 'Remarks'),...]
