Questions tagged [yajl]

yajl is an event-driven C JSON parser and generator

76 questions
12
votes
3 answers

How can I process huge JSON files as streams in Ruby, without consuming all memory?

I'm having trouble processing a huge JSON file in Ruby. What I'm looking for is a way to process it entry-by-entry without keeping too much data in memory. I thought that yajl-ruby gem would do the work but it consumes all my memory. I've also…
thisismydesign
  • 21,553
  • 9
  • 123
  • 126
6
votes
2 answers

Parse large JSON hash with ruby-yajl?

I have a large file (>50Mb) which contains a JSON hash. Something like: { "obj1": { "key1": "val1", "key2": "val2" }, "obj2": { "key1": "val1", "key2": "val2" } ... } Rather than parsing the entire file and taking say the…
rainkinz
  • 10,082
  • 5
  • 45
  • 73
5
votes
4 answers

Yajl parse error with githubarchive.org JSON stream in Python

I'm trying to parse a GitHub archive file with yajl-py. I believe the basic format of the file is a stream of JSON objects, so the file itself is not valid JSON, but it contains objects which are. To test this out, I installed yajl-py and then used…
Bialecki
  • 30,061
  • 36
  • 87
  • 109
4
votes
1 answer

Cannot import jsonstreamer / cannot pip install yajl-py

I'm trying to use JSON streamer to parse a large 11gb JSON file. JSONstreamer appears to be the only package that streams the file without having to load the entire file into memory first. When I try to import jsonstreamer in python I get this…
rgalbo
  • 4,186
  • 1
  • 19
  • 29
4
votes
0 answers

How can I install yajl in windows?

I would like to install yajl-py. I tried this: pip install yajl-py. But there is an error: OSError : Yajl shared object cannot be found . Please install Yajl and confirm it is on your shared lib path. Have you got any idea?
4
votes
1 answer

Can't parse json Data via YAJLiOS

At first i'm trying to access local file in my app folder: NSData *data = [NSData dataWithContentsOfFile: [@"countries.json" stringByExpandingTildeInPath]]; result is always NULL then i tried to check is…
Vlad Z.
  • 3,401
  • 3
  • 32
  • 60
3
votes
0 answers

How to install py-yajl through setup.py?

I want to install py-yajl through setup.py like this. from setuptools import setup, find_packages here = os.path.abspath(os.path.dirname(__file__)) requires = [ 'yajl', ] setup( ... install_requires=requires, …
3
votes
1 answer

uninitialized constant StoreController::Yajl Rails app

I've included the yajl gem in my Gemfile via gem 'yajl-ruby', '~> 1.1.0' however upon calling parser = Yajl::Parser.new in my store controller I receive the error uninitialized constant StoreController::Yajl If I execute require 'yajl' at the…
rudolph9
  • 8,021
  • 9
  • 50
  • 80
3
votes
0 answers

Parse a massive JSON array of hashes

I am trying to parse a JSON object that consists of a few hashes and a massive array of hashes (sometimes 300,000 hashes inside the array, 200MB). Here is an example of the JSON object. I need to parse hash by hash inside the array…
kriztean
  • 229
  • 3
  • 13
3
votes
2 answers

How to build and install yajl-objc on iOS

Hey I am trying to get http://github.com/gabriel/yajl-objc to work on iOS. It says to "Add the YAJLIOS.framework to your project" but I am not sure how I can get/build YAJLIOS.framework Thanks! -Ray
Ray Morgan
  • 306
  • 3
  • 5
3
votes
1 answer

Problems to detect arrays in JSON files using YAJL trees in C

I try to parse a JSON file using yajl 2.0.4 (using yajl_tree.h) but I have some problems to detect whether the found value is an array or not (even if I use YAJL_IS_ARRAY, it seems that the type field is not set. Here is my JSON file : { …
chipou
  • 45
  • 1
  • 4
3
votes
1 answer

I am having infinite problems trying to install and run Jekyll

I'm trying to install and setup Jekyll as use it for github pages but is getting very complicated, I have to add that I just started programming few months ago so maybe I cannot see the mistake as easy. Followed the instructions on website: ~ $ gem…
gma992
  • 111
  • 1
  • 1
  • 6
3
votes
1 answer

Parse complex JSON sub objects in C with YAJL

I have YAJL parsing me simple elements like given in the included example without a problem. (strings, integers, arrays, ...) The example code can be found here: http://lloyd.github.io/yajl/yajl-2.0.1/example_2parse_config_8c-example.html but now I…
Basti
  • 31
  • 1
  • 4
3
votes
2 answers

Composing json from cached strings in ruby

Consider the following scenario, I have quite a few big hashes that I need to put in an array and then convert it to json: hash1 = { ... big hash ... } hash2 = { ... big hash ... } hash3 = { ... big hash ... } array = [hash1, hash2, hash3] json =…
teamon
  • 331
  • 1
  • 5
  • 14
3
votes
1 answer

make Yajl iOS framework file

i want to make the "YAJLiOS.framework" file from code getted from github:https://github.com/gabriel/yajl-objc There is one who tells me how to make it? because i tried by building the "Project-iOS" but there is no file made. Thanks.
Mejdi Lassidi
  • 999
  • 10
  • 22
1
2 3 4 5 6