Combine Two Different BeautifulSoup For Loops in a row

Question

I'm getting data in two different for loops with BeautifulSoup, but I couldn't find how to combine data from these two different loops in excel.

file = open('/path/test.csv', "a", encoding= "utf-8", newline='')
writer = csv.writer(file)
writer.writerow(["Phone Number","Firm Name"])
response = requests.get(url)
soup = BeautifulSoup(response.content, "lxml")

phones = soup.findAll("div", attrs={"class":"PhonesBox"})
names = soup.findAll("h2", attrs={"class":"CompanyName"})

try:  
        for phone in phones:
                firm_phone = phone.find("label").text
                writer.writerow([firm_phone])
        for name in names:
                firm_name = name.find("span").text      
                writer.writerow([firm_name])
except:
        pass

If I use it like this, of course I get the results one after the other, but what I need is ([firm_phone,firm_name]) in excel file. Any help appreciated.

you can use [zip](https://docs.python.org/3.3/library/functions.html#zip) like `for phone, name in zip(phones, names):...` but it would be better if you could loop through a common parent tag that contains both phone and firm in case some firms don't have numbers listed, which would mess up your data (see [this](https://stackoverflow.com/a/74821773/6146136) for example) — Driftr95, Feb 25 '23 at 13:33

M H · Accepted Answer · 2023-02-25T13:27:41.903

If the Phone numbers and Firm Name does not need any further matching you can try assuming phones and names are lists:

file = open('/path/test.csv', "a", encoding= "utf-8", newline='')
writer = csv.writer(file)
writer.writerow(["Phone Number","Firm Name"])
response = requests.get(url)
soup = BeautifulSoup(response.content, "lxml")

phones = soup.findAll("div", attrs={"class":"PhonesBox"})
names = soup.findAll("h2", attrs={"class":"CompanyName"})

try:  
        for phone, name in zip(phones, names):
                firm_phone = phone.find("label").text
                firm_name = name.find("span").text 
                writer.writerow([firm_phone, firm_name])     
except:
        pass

Combine Two Different BeautifulSoup For Loops in a row

1 Answers1