How can I accomplish file uploads in twisted.web that don't suck?

Question

I've searched and searched but can't seem to find a way to upload files to my twisted.web application in any reasonable way.

Currently, posting file uploads to a resource results in a request.args['file'] variable, that is a list populated with file contents. I can't find a way to get any information about the file: mime type, filename, filesize (other than just taking the length of the strings in args['file'][]), etc.

I have read that twisted.web2 is better at file uploads. However I don't know how much better it is, or how I would use twisted.web2 to handle file uploads in a twisted.web application.

Any suggestions? This is bugging me like crazy -- Oh and I looked at the request headers, and didn't really find anything of any significance. How can I get some more meta information about file uploads with Twisted?

Also,

How can I just get the bare HTTP request from a request object? Is it possible?

Actually, I just found out about `request.content` to grab the request content. It didn't appear in any of the documentation I read. — Carson Myers, Jul 17 '10 at 11:00

score 5 · Accepted Answer · answered Apr 27 '11 at 12:39

This is an old question, but a quick search of stackoverflow didn't turn up a comparable question/answer, so here is a quick example of using twisted.web2 for file uploads.

The hidden form variable file_foo shares the same name as a file upload variable, to show how Twisted will split these out:

<form action="/upload?a=1&b=2&b=3" enctype="multipart/form-data"
        method="post">
    <input type="hidden" name="foo" value="bar">
    <input type="hidden" name="file_foo" value="not a file">
    file_foo: <input type="file" name="file_foo"><br/>
    file_foo: <input type="file" name="file_foo"><br/>
    file_bar: <input type="file" name="file_bar"><br/>
    <input type="submit" value="submit">
</form>

In your Resource.render() method, here's how you could access the form variables:

def render(self, ctx):
    request = iweb.IRequest(ctx)
    for key, vals in request.args.iteritems():
        for val in vals:
            print key, val

    print 'file uploads ----------------'
    for key, records in request.files.iteritems():
        print key
        for record in records:
            name, mime, stream = record
            data = stream.read()
            print '   %s %s %s %r' % (name, mime, stream, data)

    return http.Response(stream='upload complete.')

Output:

         a: 1
         b: 2 3
       foo: bar
  file_foo: not a file

file_bar
   bar.txt MimeType('text', 'plain', {}) <open file '<fdopen>', mode 'w+b' at 0x2158a50> 'bar data.\n\n'
file_foo
   foo.txt MimeType('text', 'plain', {}) <open file '<fdopen>', mode 'w+b' at 0x2158930> 'foo data.\n\n'
   foo.txt MimeType('text', 'plain', {}) <open file '<fdopen>', mode 'w+b' at 0x21589c0> 'foo data.\n\n'

score 3 · Answer 2 · edited May 23 '17 at 11:53

3

I did it like it is described here: solution for upload. The solution uses cgi.FieldStorage to parse the payload.

Also: For the purpose of parsing you need request.content not request[args]. As you can see, the results are almost the same as in web2 request.files.

edited May 23 '17 at 11:53

Community

1
1

answered Mar 21 '12 at 18:53

laidback

545
4
16

One also can use fp not value to use streams with FieldStorage. twisted request.files did not worked for me , no mime, no filename etc. – Sergey May 25 '16 at 13:15

How can I accomplish file uploads in twisted.web that don't suck?

Also,

2 Answers2

Linked