Jq cannot parse MongoDB output document

Question

Jq is a wonderfull tool to deals with JS document in bash. But I can't use to parse some MongoDB output documents due to function like added by Mongodb. Example of MongoDB Json return:

{
    "_id" : "example",
    "version" : 23,
    "members" : [
        {
            "_id" : 0,
            "host" : "192.168.0.1:27017",
            "slaveDelay" : NumberLong(0),   <---- Here jq failed to parse this line
            "votes" : 1
        }
]}

The error given by jq is:

parse error: Invalid numeric literal at line 15, column 32

Any help would be greatly appreciated.

score 24 · Accepted Answer · answered Dec 31 '16 at 21:29

24

I know I am a little too late here but Mongo shell has built-in JavaScript support. So you can use JSON.stringify.

For the specific example above, you can use below

mongo --quiet --eval "JSON.stringify(rs.config())"

answered Dec 31 '16 at 21:29

Gökhan Şengün

583
5
18

1

Woow. Many thank's for this. I think it is a best answer than the workaround given below. – jmcollin92 Jan 02 '17 at 17:12

score 7 · Answer 2 · answered Sep 12 '16 at 11:32

7

A workaround that could be sufficient for certain use is to transform the output of the mongo shell command. I use this pattern for a workaround:

mongo --quiet --eval "rs.config()" | sed -e 's/: [a-zA-Z]*(\(.*\))/: "\1"/' | jq '.'

It removes all functions call after the ':' and keep only the value.

answered Sep 12 '16 at 11:32

jmcollin92

2,896
6
27
49

2

that nice workaround! – profesor79 Sep 12 '16 at 11:50
I found I got better luck with this sed expression: `sed -e 's/: [a-zA-Z]*(\([^\)]*\))/: \1/g'`. Just thought I'd share. – mprivat Apr 08 '18 at 00:46

score 5 · Answer 3 · answered Sep 12 '16 at 10:49

5

this is caused because mongo uses BSON in the backend see this

using mongoexport with json option will allow to generate clean json files:

 "CreatedDate":{"$date":"2016-08-13T01:01:20.833Z"}

instead of:

 "CreatedDate" : ISODate("2016-08-13T01:01:20.833Z"),

answered Sep 12 '16 at 10:49

profesor79

9,213
3
31
52

2

Thank's for your answer but I need this for mongo shell command output and not in data export. For instance, I need to parse the result of the "rs.config()" which show the ReplicatSet configuration. The exact I would like to parse is the following: mongo --eval "rs.config()" – jmcollin92 Sep 12 '16 at 11:29
See http://stackoverflow.com/questions/32097209/force-mongodb-to-output-strict-json. I ran into the exact same issue! – whereswalden Dec 31 '16 at 21:52

Jq cannot parse MongoDB output document

3 Answers3