How to export results to Excel or CSV?

Question

I am using the script below to get the Google News results for a brand. However, I would love to be able to export the results to a CSV or Excel file. Can someone help me out, please?

pip install pygooglenews --upgrade

from pygooglenews import GoogleNews

gn = GoogleNews(country = 'IE')

def get_titles(search):
  stories = []
  search = gn.search(search)
  newsitem = search['entries']
  for item in newsitem:
      story = {
        'title' : item.title,
        'link' : item.link
      }
      stories.append(story)
  return stories

print(get_titles('aldi'))

The [csv](https://docs.python.org/3/library/csv.html) module has examples on how to do this. I think its more a question of where you want it integrated into your code than the mechanics of writing the csv. — tdelaney, Sep 20 '21 at 17:58

score 1 · Answer 1 · answered Sep 20 '21 at 18:02

1

You could use the CSV module to write the rows as you pull them from the search.

from pygooglenews import GoogleNews
import csv

gn = GoogleNews(country = 'IE')

def write_csv(filename, search):
    search = gn.search(search)
    with open(filename, "w", newline="") as fileobj:
        csv.writer(fileobj).writerows((item.title, item.link) 
          for item in search['entries'])

write_csv('output.csv', 'aldi')

answered Sep 20 '21 at 18:02

tdelaney

73,364
6
83
116

Thanks a mill for your help. I used the option above. – Micheal Brennan Sep 21 '21 at 14:21

score 0 · Answer 2 · answered Sep 20 '21 at 17:55

An easy (but heavy) way would be to use pandas, which easily converts a list of dictionaries into a data frame

import pandas as pd

pd.DataFrame(stories).to_csv("result_list.csv")

The built-in way is answered here: How do I convert this list of dictionaries to a csv file?

import csv

with open("results_list.csv", "w", encoding="utf-8") as f:
    writer = csv.DictWriter(f, fieldnames=stories[0].keys())
    writer.writeheader()
    writer.writerows(stories)

Thanks a mill for your help. I used the option above. – Micheal Brennan Sep 21 '21 at 14:21 — Micheal Brennan, Sep 21 '21 at 14:21

score 0 · Answer 3 · answered Sep 20 '21 at 18:07

You can try the below.

Get the data as list of dicts, loop over the list and write each entry to the file.

from pygooglenews import GoogleNews

gn = GoogleNews(country = 'IE')

def get_titles(search):
  stories = []
  search = gn.search(search)
  newsitem = search['entries']
  for item in newsitem:
      story = {
        'title' : item.title,
        'link' : item.link
      }
      stories.append(story)
  return stories

stories = get_titles('aldi')
with open('stories.csv','w',encoding='utf-8') as f:
    f.write('title,link\n')
    for s in stories:
        f.write(f'{s["title"]},{s["link"]}\n')

stories.csv

title,link
Aldi to trial first checkout-free supermarket - BreakingNews.ie,https://www.breakingnews.ie/business/aldi-to-trial-first-checkout-free-supermarket-1186611.html
Green light given to plans for new Aldi store in Ennis - Clare Champion,https://clarechampion.ie/green-light-given-to-plans-for-new-aldi-store-in-ennis/
Kildare woman scoops up top prize at Aldi's National Brown Bread Baking Competition 2021 - Leinster Leader,https://www.leinsterleader.ie/news/local-news/666996/kildare-woman-scoops-up-top-prize-at-aldi-s-national-brown-bread-baking-competition-2021.html
Aldi to open new shops in Co Mayo and Co Galway - RTE.ie,https://www.rte.ie/news/business/2021/0909/1245582-two-new-aldi-stores-for-connacht/
Aldi, Lidl and Tesco Ireland customers reveal their favourite 'hidden gems' with some unknown bargains - Irish Mirror,https://www.irishmirror.ie/lifestyle/aldi-lidl-tesco-ireland-customers-25021723
"It's a massive boost for us." Grow with Aldi winners - Newstalk,https://www.newstalk.com/podcasts/highlights-from-the-pat-kenny-show/its-a-massive-boost-for-us-grow-with-aldi-winners
Gourmet sausage, burger sauce, cookies: Winners of Grow with Aldi announced - Agriland,https://www.agriland.ie/farming-news/gourmet-sausage-burger-sauce-cookies-winners-of-grow-with-aldi-announced/
Elderly Clare couple fined for refusing to wear masks in Aldi - Clare Champion,https://clarechampion.ie/elderly-clare-couple-fined-for-refusing-to-wear-masks-in-aldi/
Tesco, Aldi, M&S and Morrisons supermarkets acquired by real estate investment giant in £113.1m deal - Business Live,https://www.business-live.co.uk/commercial-property/tesco-aldi-ms-morrisons-supermarkets-21616148
Aldi And IRFU Launch New Cookbook In Support Of Barnardos - Irish Rugby,https://www.irishrugby.ie/2021/09/12/aldi-and-irfu-launch-new-cookbook-in-aid-of-barnardos/
Aldi unveils plan to build store in Thames Ditton with 50 jobs created - Surrey Live,https://www.getsurrey.co.uk/news/surrey-news/aldi-unveils-plan-build-store-21625481
Aldi Salad Dressing Is Getting Recalled Due To Contamination - Delish.com,https://www.delish.com/food-news/a37665205/aldi-salad-dressing-recall-september-2021/
...

Thanks a mill for your help. The script works perfectly in Google Colab. This will be a massive help. — Micheal Brennan, Sep 21 '21 at 14:21
Glad I managed to help. You can accept the answer / vote up. — balderman, Sep 21 '21 at 14:23
This solution assumes there won't be commas in the title. If there is a comma, the title will be split across multiple columns putting the link in the wrong place. — Yanofsky, Sep 21 '21 at 17:14

How to export results to Excel or CSV?

3 Answers3