0

I want my app to download an XML file and process it daily. The XML file comes in a ~100MB zip file - ~1GB when extracted. The processed output is less than 1MB.

I noticed the URL fetch (and urllib) response size quota is 32MB: http://code.google.com/appengine/docs/python/urlfetch/overview.html#Quotas_and_Limits

Is there a workaround?

hoju
  • 28,392
  • 37
  • 134
  • 178

1 Answers1

2

You will need to use Blobstores

giodamelio
  • 5,465
  • 14
  • 44
  • 72
  • I don't need to store the XML files - just download and process them. Problem is the urlfetch/urllib download size limit. – hoju Dec 23 '11 at 17:43