How to get price from Amazon website by selenium

Question

I want to get the price from the Amazon website.

How can I take the price number?

#---------------------------------------------------------------------------------
chrome_driver_path = r"C:\Users\user\Desktop\Development\chromedriver.exe"
service = Service('C:\Program Files\Chrome Driver\chromedriver.exe')

driver = webdriver.Chrome(service=service)

driver.get("https://www.amazon.com/Apple-MacBook-16-Inch-Storage-2-6GHz/dp/B08CZT64VP/ref=sr_1_4?crid=2T5BGI71K1C8W&keywords=macbook&qid=1689176236&sprefix=macboo%2Caps%2C357&sr=8-4")

price = driver.find_element(By.CLASS_NAME,"a-offscreen").get_attribute("aria-hidden")

print(price)
#---------------------------------------------------------------------------------

#output: None

score 0 · Accepted Answer · answered Jul 12 '23 at 16:21

There are multiple tags with the same class, due to which you may not be able to get the tag that you need. Also you were trying to get an attribute which the element doesn't even have.

Therefore change line

price = driver.find_element(By.CLASS_NAME,"a-offscreen").get_attribute("aria-hidden")

to

price = driver.find_element(By.CSS_SELECTOR,"span.a-price.a-text-price.a-size-medium span.a-offscreen").get_attribute("innerText")

Output:

$849.69

score 0 · Answer 2 · answered Jul 12 '23 at 16:26

Your program returns None because the find_element() returns the first span (with the a-offscreen class), that does not have an aria-label; then by default if one was not found get_attribute("aria-label") returns None. If you want to find the price text use the .text attribute of the span object, eg price = driver.find_element(By.CLASS_NAME,"a-offscreen").text

You may refer to https://pythonexamples.org/python-selenium-find-element-by-css-selector/

undetected Selenium · Answer 3 · 2023-07-12T20:12:17.613

To extract the text $845.69 ideally you need to induce WebDriverWait for the visibility_of_element_located() and you can use the following locator strategies:

Using CSS_SELECTOR and text attribute:

driver.get("https://www.amazon.com/Apple-MacBook-16-Inch-Storage-2-6GHz/dp/B08CZT64VP/ref=sr_1_4?crid=2T5BGI71K1C8W&keywords=macbook&qid=1689176236&sprefix=macboo%2Caps%2C357&sr=8-4")
print(WebDriverWait(driver, 20).until(EC.visibility_of_element_located((By.CSS_SELECTOR, "div#apex_desktop div#corePrice_desktop table.a-lineitem span.apexPriceToPay[data-a-color='price']"))).text)

Console output:
```
$845.69
```

Note : You have to add the following imports :

from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.common.by import By
from selenium.webdriver.support import expected_conditions as EC

You can find a relevant discussion in How to retrieve the text of a WebElement using Selenium - Python

How to get price from Amazon website by selenium

3 Answers3