regex to extract html value

Question

im trying to write small scraper script from google search, im write the program, bat have small problem i need regex for extract data-href value from google search, please help me :

exemple html code of google search :

data-href="www.buxmob.net/index.php?id=577">
data-href="www.webopedia.com/TERM/K/keyword.html">
data-href="moz.com/beginners-guide-to-seo/keyword-research">

need only the url present in this value, only this :

hxxp://www.webopedia.com/TERM/K/keyword.html
hxxp://moz.com/beginners-guide-to-seo/keyword-research
hxxp://www.buxmob.net/index.php?id=577

thanks you

Don't parse HTML with regexes. Use a proper parser (which make xpath's very yummy). — Wrikken, Feb 09 '14 at 02:34
Scraping Google search results is against their TOS. You need to sign up for an API key and go about this the legitimate way. — Marc B, Feb 09 '14 at 02:35
Obligatory reading: http://stackoverflow.com/questions/1732348/regex-match-open-tags-except-xhtml-self-contained-tags/1732454#1732454 — Jim Garrison, Feb 09 '14 at 02:38
im use this in ubotstudio, uniq street is regex ! need regex ! — pythoncoder, Feb 09 '14 at 02:42
Just because you know regex does not mean every problem can be solved using regexes. — Jim Garrison, Feb 09 '14 at 04:41

score 0 · Accepted Answer · answered Feb 09 '14 at 05:09

All the examples you gave can be matched with

(?:data-href=")(.*?)(?:">)

See demo at http://regex101.com/r/rB4nS1

That does NOT mean it's a good idea to try to parse (general) html with regex - but sometimes, when the response is well formed and well known, you get away with it.

Note that you mentioned you wanted hxxp:// in front of the string - that is not the job of the regular expression, but belongs with the language you use to implement the expression. The above is a "non greedy match starting after the string data-href=" and ending at the next ">

regex to extract html value

1 Answers1