Pandas - Adding a column to DF href

Question

I am working on a webscrape script. The pandas data frame that is generated is fantastic however I need to add a unique_id column with the value of a href URL contained in the HTML.

<td><a href="/admin/tasks/edit/82689"> ADDRESS </a> CLIENT </td>

Currently the Pandas data frame has a column containing 'ADDRESS CLIENT' but how can I add a seperate column containing the href URL?

I am currently able to get a comma separated list of the unique_id values using the following:

unique_id = [a['href'] for a in table.select('a[href]')]

any direction would be much appreciated!

Here is the a unique question: https://stackoverflow.com/questions/12555323/adding-new-column-to-existing-dataframe-in-python-pandas — Dark, Aug 06 '18 at 06:36

score 0 · Accepted Answer · answered Aug 06 '18 at 07:18

The correct way to do it will be using the pandas.DataFrame.assign method

df.assign(url=unique_id)

This will give you a new column in the DataFrame with name url and values the values from the numpy array. As far as I know column assignment like df['url] = unique_id is deprecated. You can read more here.

Pandas - Adding a column to DF href

1 Answers1