How to ask for input to slice a pandas data frame

Question

I've got a list if 10,000 URLs that I need to check and I'm automatizing the process of opening those URLs.

So far, I've done this and it works:

import webbrowser
import pandas as pd

urls  = pd.read_csv('urls.csv', delimiter='\'')

urls = urls['urls']

for url in urls[:100]:
    webbrowser.open_new(url)

Now, the problem is that with this I have to go to the code and change the slicing every time I need new URLs to be open. Do you think is possible to ask for an input to the users in order to select by themselves the range of slicing?

I've tried this:

for url in urls[{''}:{''}].format(input('Enter first line:  '), input('Enter last line:   ')):
    webbrowser.open_new(url)

And I get this error:

TypeError: cannot do slice indexing on <class 'pandas.core.indexes.range.RangeIndex'> with 
these indexers [{''}] of <class 'set'>

Thoughts?

What is the content of your csv file ? can you provide a minimal csv file ? — Prince Francis, Dec 04 '19 at 11:50
Does this answer your question? [How to iterate over rows in a DataFrame in Pandas?](https://stackoverflow.com/questions/16476924/how-to-iterate-over-rows-in-a-dataframe-in-pandas) — Vishnudev Krishnadas, Dec 04 '19 at 11:50
What are you facing issue with? Iterating the dataframe or taking input from user in python? — Vishnudev Krishnadas, Dec 04 '19 at 12:19
@PrinceFrancis just one columns =['urls'] that contains urls such as https://www.google.com — pyseo, Dec 04 '19 at 12:23
@Vishnudev The error occurs when trying to take input from user to slice df — pyseo, Dec 04 '19 at 12:24
@pyseo Where is that code? Can I know reason behind asking the user for slice range? — Vishnudev Krishnadas, Dec 04 '19 at 12:58
@Vishnudev I'm sorry, I totally forgot to put it in the question... I've just added! — pyseo, Dec 04 '19 at 13:00
refer https://stackoverflow.com/questions/70797/user-input-and-command-line-arguments — Vishnudev Krishnadas, Dec 04 '19 at 13:02
What is the reasoning behind slicing? Why not iterate through whole list? — Alex Bodnya, Dec 04 '19 at 13:08
`slice_idx = int(input('Enter index to slice at: '))` and then `urls.loc[:slice_idx, 'urls']` — Vishnudev Krishnadas, Dec 04 '19 at 13:08
Where the code says `urls = pd.read_csv('urls.csv', delimiter='\'')`, why does it (correctly!) **not** say `urls = pd.read_csv({''}, delimiter={''}).format('urls.csv', '\'')`? Does this give you some insight as to what is wrong with the current attempt? if you wanted to use a an existing variable `filename` to give the name of the file to open, how would you write that? That would look like... `urls = pd.read_csv(filename, delimiter='\'')`, right? Do you understand why? So.... — Karl Knechtel, Feb 05 '23 at 12:07

score 0 · Accepted Answer · answered Dec 04 '19 at 13:23

0

Use

slice_idx = int(input('Enter index to slice at: '))

to get the index to slice at and then

urls.loc[:slice_idx, 'urls']

to get series of sliced urls.

answered Dec 04 '19 at 13:23

Vishnudev Krishnadas

10,679
2
23
55

score 0 · Answer 2 · answered Dec 04 '19 at 13:47

If limiting the amount of URLs to check and the library are not mandatory, you could try request library.

Something like:

import requests
import pandas as pd

urls  = pd.read_csv('urls.csv', delimiter='\'')

urls = urls['urls']

results = []

for url in urls:

    request = requests.get(url)

    if request.status_code == 200:
        results.append(url)

Bare in mind that with this aproach, URLs should have http:// in the csv file. For example http://www.someweb.com

How to ask for input to slice a pandas data frame

2 Answers2