14

Yesterday the following cell sequence in Google Colab would work.

enter image description here

(I am using colab-env to import environment variables from Google Drive.)

This morning, when I run the same code, I get the following error.

enter image description here

It appears to be a new issue with s3fs and aiobotocore. I have some experience with Google Colab and library version dependency issues that I have previously solved by upgrading libraries in a particular order:

!pip install --upgrade library_name

But I am a bit stuck this morning with this one. It is affecting all of my Google Colab notebooks so I thought that perhaps it is affecting others who are using data stored in Amazon AWS S3 with Google Colab.

The version of s3fs that gets installed is 2021.07.0, which appears to be the latest.

enter image description here

Andrew Gaul
  • 2,296
  • 1
  • 12
  • 19
Andrew Fogg
  • 645
  • 1
  • 8
  • 16
  • Looks like this might be related https://github.com/dask/s3fs/issues/514 – Andrew Fogg Aug 20 '21 at 17:05
  • I’m voting to close this question because it's a transient error that has been resolved. – cigien Sep 05 '21 at 17:05
  • im limited to s3fs version `2021.7.0` because of some dependency issues and needing to support python 3.7. its unfortunate that they dont fix the issue with this specific version of aiobotocore – eljusticiero67 Jun 01 '23 at 13:07

1 Answers1

16

Indeed, the breakage was with the release of aiobotocore 1.4.0 (today, 20 Aug 2021), which is fixed in release 2021.08.0 of s3fs, also today.

mdurant
  • 27,272
  • 5
  • 45
  • 74
  • 2
    AMAZING! What a fast fix! I can confirm it is all working again. Thank you and thank you for all your work on s3fs. I ❤️ that library. Thank you @mdurant – Andrew Fogg Aug 20 '21 at 17:19
  • I have s3fs==2021.5.0 fixed on my requirements, how did this break from one day to the other? are transitive dependencies not fixed? – alete Aug 21 '21 at 15:23
  • 2
    Generally no, packages rely on their dependencies being well behaved, so you are free to upgrade where other packages might require it. Aiobotocore changes too often, we have now decided to pin the version. – mdurant Aug 21 '21 at 18:08