Node Busboy abort upload

Question

I'm using busboy, writing my uploaded file to a buffer and performing some validation on it (width, height and filesize). I can't for the life of me figure out how to abort / stop the stream once I find something wrong with the upload.

For instance if I have a max filesize of 500kb that I want to allow, I keep track of the size of the buffer as it's uploading and I want to abort if the size is over 500kb.

Here's a simplified version of my code.

var self = this;
var busboy = new Busboy({
    headers: self.req.headers,
    limits: {
        files: 1
    }
});
busboy.on('file', function(fieldname, file, filename, encoding, mimetype) {

    file.fileRead = [];
    var size = 0;
    file.on('data', function(chunk) {

        size += chunk.length;

        /* DO VALIDATION HERE */
        if( size > 500000) {
            /*** ABORT HERE ***/
        }


        file.fileRead.push(chunk);
    });

    file.on('end', function() {
        var data = Buffer.concat(file.fileRead, size);
        // ... upload to S3
    });

    self.req.pipe(busboy);
});

You can limit the file size as a parameter to busyboy - it's just a `fileSize` property... — Benjamin Gruenbaum, May 29 '15 at 19:47
What if I want to validate the width and height of the file? I would need to abort the stream then, instead of counting on the `limit` event. — imns, May 29 '15 at 20:10
I have a post about this _somewhere_ in my accepted bounties but it's not using busbuy. — Benjamin Gruenbaum, May 29 '15 at 20:11
@BenjaminGruenbaum I'd love to see it if you dig it up. Post an answer and if it's what I need I will accept it. — imns, May 29 '15 at 20:25
It performs the check on the header but can be very easily applied to do whatever you want it to http://stackoverflow.com/a/16349882/1348195 — Benjamin Gruenbaum, May 29 '15 at 20:26

score 6 · Answer 1 · answered Aug 26 '15 at 09:29

Ok, so I had the same problem and I solved it with file.resume();

var fstream;
req.busboy.on('file', function (fieldname, file, filename, encoding, mimetype) {

    // Validate file mimetype
    if(mimetype != 'image/png'){
        file.resume();
        return res.json({
            success: false,
            message: 'Invalid file format'
        });
    }

    // Upload
    fstream = fs.createWriteStream(__dirname + '/tmp/' + timestamp + filename);
    file.pipe(fstream);
    fstream.on('close', function () {
        return res.json({
            success: true
        });
    });

});

req.pipe(req.busboy);

This doesn't abort the upload it just waits until all data has been consumed. — Dustin Deus, Oct 11 '20 at 15:41

score 2 · Answer 2 · answered Jun 04 '15 at 06:21

The answer is simple one.

// do the required validation like size check etc.
if( size > 500000) 
{
    self.req.unpipe();
    return;
}

The context is this. I see in busboy code that busboy is implemented as WritableStream and underneath uses Dicer module for parsing which is also implemented as WritableStream. Flow is like this:

req stream ==> busboy ==> dicer ==> dicer raises events ==> busboy raises events on file ==> these events are consumed in your code.

To stop this whole flow of code - the above unpipe should do.

score 1 · Answer 3 · answered May 29 '15 at 19:43

1

I would try something like this:

var self = this;
var busboy = new Busboy({
    headers: self.req.headers,
    limits: {
        files: 1,
        fileSize: 500000
    }
});
busboy.on('file', function(fieldname, file, filename, encoding, mimetype) {

    file.fileRead = [];

    file.on('limit', function() {
        //Clear variables
    });

    file.on('data', function(chunk) {
        file.fileRead.push(chunk);
    });

    file.on('end', function() {
        var data = Buffer.concat(file.fileRead, size);
        // ... upload to S3
    });

    self.req.pipe(busboy);
});

Basically I added a new limit in the configuration of Busboy: fileSize: 500 * 1024

And I started listening limit event:

    file.on('limit', function() {
        //Clear vars
    });

answered May 29 '15 at 19:43

Rodrigo Moreno

629
9
24

I'm not sure this makes sense to me. What variables would I clear in limit and why / how would that stop the stream? The ideas is I don't want to parse a 5gig file if I know after 200kb that it's the wrong filetype or size. – imns May 29 '15 at 20:08
I also should say that I am doing other validation, like the width and height of the file. – imns May 29 '15 at 20:09
1

To abort the communication may be used: `file.resume();` according to: https://github.com/mscdex/busboy/issues/22, https://github.com/mscdex/busboy/pull/23 & https://github.com/mscdex/busboy#busboy-special-events (at note) – Rodrigo Moreno May 29 '15 at 20:23

score 1 · Answer 4 · answered Jun 05 '15 at 03:31

I would think the proper thing to do was to just close the socket and end the request

busboy.on('file', function(fieldname, file, filename, encoding, mimetype) {

    file.fileRead = [];
    var size = 0;
    file.on('data', function(chunk) {

        size += chunk.length;

        /* DO VALIDATION HERE */
        if( size > 500000) {

            self.req.socket.end();
            self.res.end();

        }


        file.fileRead.push(chunk);
    });

    file.on('end', function() {
        var data = Buffer.concat(file.fileRead, size);
        // ... upload to S3
    });

    self.req.pipe(busboy);
});

score -1 · Answer 5 · answered Jun 10 '15 at 14:14

-1

I was able to access the underlying Dicer parser which has an ignore method which essentially stops uploading the file.

Here's how I did it: busboy._parser.parser._ignore()

It does seem very hackish, but it works and does exactly what I wanted.

answered Jun 10 '15 at 14:14

imns

4,996
11
57
80

Functions starting with an underscore usually signal private methods that should not be accessed from outside the library. I would highly advice against this. – Max Nov 11 '15 at 02:26

Node Busboy abort upload

5 Answers5

Linked