bash curl | grep a specific website content

Question

I'm trying to extract a specific piece of information from a website, but the content seems to be included in the class definition:

<div class= "some_div_class">
  <strong content="999" itemprop="price" class="strong_class">
      999
  </strong>
</div>

I'm targeting the "999", which I can if I do:

curl -s url |grep -zPo '<strong content="999" itemprop="price" class="strong_class">\s*\K.*?(?=\s*</strong>)'

If the "999" is in the content though, and it changes, grep would become invalid. Wildcards wouldn't return anything

Answer 1

Please(!) have a look at the following urls before you attempt to parse a website with RegEx:

• Why it's not possible to use regex to parse HTML/XML: a formal explanation in layman's terms
• RegEx match open tags except XHTML self-contained tags
• How do I extract data from an HTML or XML file?

With an HTML/XML parser like xidel it's as simple as:

xidel -s "<url or file>" -e '//div[@class="some_div_class"]/strong/@content'

or

xidel -s "<url or file>" -e '//div[@class="some_div_class"]/normalize-space(strong)'