Questions tagged [bulkloader]

167 questions
22
votes
3 answers

Hilbert sort by divide and conquer algorithm?

I'm trying to sort d-dimensional data vectors by their Hilbert order, for bulk-loading a spatial index. However, I do not want to compute the Hilbert value for each point explicitly, which in particular requires setting a particular precision. In…
Has QUIT--Anony-Mousse
  • 76,138
  • 12
  • 138
  • 194
10
votes
1 answer

Bulkloader CSV size error

Bulkloader raises the following error when importing a CSV file with large cells: [ERROR ] Error in data source thread: field larger than field limit (131072) This is a common problem for the csv module, which can be fixed…
hoju
  • 28,392
  • 37
  • 134
  • 178
9
votes
1 answer

hadoop java.net.URISyntaxException: Relative path in absolute URI: rsrc:hbase-common-0.98.1-hadoop2.jar

I have a map reduce job that connects to HBASE and I can't figure out where I am running into this error: Exception in thread "main" java.lang.reflect.InvocationTargetException at sun.reflect.NativeMethodAccessorImpl.invoke0(Native…
ihate3putts
  • 91
  • 1
  • 1
  • 2
8
votes
1 answer

AttributeError: 'module' object has no attribute 'strptime' -- Possible Bug?

I am a little bit confused as to why I am receiving the error AttributeError: 'module' object has no attribute 'strptime'. When I import datetime in my Python script and call datetime.datetime.strptime(string, format) everything works fine but when…
papezjustin
  • 2,223
  • 6
  • 24
  • 31
7
votes
0 answers

Java Google App Engine bulk loader download warning “No descending index on __key__, performing serial download”

Possible Duplicate: App engine bulk loader download warning "No descending index on key, performing serial download" My post is very similar to: App engine bulk loader download warning "No descending index on __key__, performing serial…
Stewie
  • 185
  • 11
7
votes
1 answer

Insert array of records into mysql with Node JS

I have a array of data something like var records = [ {Name: '', Id: 1}, {Name: '', Id: 2}, {Name: '', Id: 3}, {Name: '', Id: 4}, {Name: '', Id: 5}, {Name: '',…
6
votes
1 answer

Google app engine bulkloader opens empty file at upload

I'm running the following two commands: appcfg.py download_data --kind=Journal --url=http://appname.appspot.com/_ah/remote_api --filename=Journals.sql3 appcfg.py upload_data --url=http://localhost:8080/_ah/remote_api --kind=Journal…
5
votes
3 answers

Appengine BulkLoader problem using development server

I am doing something that should be simple and getting stuck over and over again. I am getting this error when uploading quite simple csv files to my development server: Error in WorkerThread-0: app "dev~fbdec" cannot access app "fbdec"'s data The…
Javier Reyes
  • 129
  • 1
  • 9
5
votes
1 answer

Where are the reference pages of the Google App Engine bulkloader transform?

From an empty datastore, I was able to auto-generate a bulkloader.yaml file. It only contains the python_preamble, but the transformers section was empty. python_preamble: - import: google.appengine.ext.bulkload.transform - import:…
Kit
  • 30,365
  • 39
  • 105
  • 149
5
votes
2 answers

Can MySqlBulkLoader be used with a transaction?

Can MySqlBulkLoader be used with a transaction? I don't see a way to explicitly attach a transaction to an instance of the loader. Is there another way?
Daniel
  • 47,404
  • 11
  • 101
  • 179
5
votes
1 answer

App Engine Bulk Loader Performance

I am using the App Engine Bulk loader (Python Runtime) to bulk upload entities to the data store. The data that i am uploading is stored in a proprietary format, so i have implemented by own connector (registerd it in bulkload_config.py) to convert…
Rahul
  • 19,744
  • 1
  • 25
  • 29
5
votes
2 answers

Google App Engine bulkloader issue when using yaml autogenerated configuration and entities with numeric ID

My application uses Django non-rel. I don't have access to model. I have my bulkloader.yaml file autogenerated by appcfg.py create_bulkloader_config. Problem is entities numeric ID's are being imported as string key names. So if I export entity…
jb.
  • 23,300
  • 18
  • 98
  • 136
5
votes
1 answer

GAE: Exceeded maximum allocated IDs

It seems gae assigns very high IDs to the models. When I download my entities, I get for some entries very big numbers. These were autogenerated in first place. Downloading them as csv is no problem. But deleting the existing data and re-uploading…
Houman
  • 64,245
  • 87
  • 278
  • 460
5
votes
2 answers

SQLXML BulkLoader not throwing any error but no data is inserted

I'm trying to use SQLXMLBulkLoader4 from C# code into an SQL 2008 DB. But for some reason it doesn't insert any rows at all despite not throwing any error. I've made use of the bulkloads own ErrorLog file, (to check for any errors that might not…
MrWizard
  • 55
  • 6
4
votes
2 answers

Clone movieclip in ActionScript3

I'm using BulkLoader to load MovieClips and Bitmaps into my AS3 app. Bitmaps are easy to clone, but I have some problems with complicated MovieClips, which has many children, buttons, symbols, etc. I've found many ways to clone MovieClips as…
Mikhail
  • 759
  • 2
  • 9
  • 26
1
2 3
11 12