1

I have csv files in azure which I read using the function with the following header :

get_blob_to_stream(container_name, blob_name, stream, snapshot=None,
        start_range=None, end_range=None, validate_content=False,
        progress_callback=None, max_connections=2, lease_id=None,
        if_modified_since=None, if_unmodified_since=None, if_match=None,
        if_none_match=None, timeout=None)

The start_range and end_range are good parameters if you want to bring a number of bytes from said blob, but say I know my blob is a csv and I precisely want it to bring me the lines from 1 to 1000, kind of like how I tell pandas pd.read_csv(...,nrow=1000, skiprows = range(0,1)). How would I proceed?

Imad
  • 2,358
  • 5
  • 26
  • 55

1 Answers1

0

Looking at the Azure Documentation, it doesn't look like that function will offer that functionality.

However, I found this answer, which seems promising. Maybe you can redirect the stream directly into pandas read_csv function and continue from there.

TomMP
  • 715
  • 1
  • 5
  • 15