Python Looped regex only 1 data is inserted

Question

This is a follow up question from here

Using Racialz answer i can loop everything using the regex but only the last line of data is stored in the database how do i store all of the data instead of only the last 1

for thisMatch in re.findall(r"<td>(.+?)</td>.+?<td>(.+?)</td>.+?<td>(.+?)</td>.+?<td>(.+?)</td>", match3, re.DOTALL):
        print(thisMatch[0], thisMatch[1], thisMatch[2])

sinfo = scrapyitem(name=thisMatch[0], hp=thisMatch[1], email=thisMatch[2])


 try:
     sinfo().save

EDIT

match2 and match are just regex to narrow down on the search data.( i know it might be redundant and some might ask me to use parser instead )

my_string = str(i)
    match = re.search("\<!-- populate table from mysql database -->(.*?)\     /tbody>" , my_string).group(1)    
match2 = re.findall('\<div class = "info">(.*?)</tr>' , match)
match3 = str(match2)

data:

 <div class = "info"> 
  <div class="name"><td>random</td></div>
  <div class="hp"><td>123456</td></div>
  <div class="email"><td>random@mail.com</td></div> 
 </div>

 <div class = "info"> 
  <div class="name"><td>random123</td></div>
  <div class="hp"><td>654321</td></div>
  <div class="email"><td>random123@mail.com</td></div> 
 </div>

The info saved into database will only be :

  random123
  654321
  random123@mail.com

match3 gives me:

<div class="name"><td>random</td></div>
<div class="hp"><td>123456</td></div>
<div class="email"><td>random@mail.com</td></div> 


<div class="name"><td>random123</td></div>
<div class="hp"><td>654321</td></div>
<div class="email"><td>random123@mail.com</td></div> 

Answer 1

I think you need to go and read the python doc for re.findall():

https://docs.python.org/2/library/re.html

re.findall(pattern, string, flags=0) Return all non-overlapping matches of pattern in string, as a list of strings. The string is scanned left-to-right, and matches are returned in the order found. If one or more groups are present in the pattern, return a list of groups; this will be a list of tuples if the pattern has more than one group. Empty matches are included in the result unless they touch the beginning of another match.

So in your code you are iterating through all the matches in that list returned back from re.findall() however you are not storing the individual sets of data anywhere except for the last set in your list. So you would probably need to do a save per set or pass in a list to save in your backend DB.

Try this:

sinfo = []
for thisMatch in re.findall(r"<td>(.+?)</td>.+?<td>(.+?)</td>.+?<td>(.+?)</td>.+?<td>(.+?)</td>", match3, re.DOTALL):
    print(thisMatch[0], thisMatch[1], thisMatch[2])
    sinfo.append(scrapyitem(name=thisMatch[0], hp=thisMatch[1], email=thisMatch[2]))

try:
    for scrapyInfo in sinfo:
        scrapyInfo.save()
...

Thanks,

-Abe.