2

I am working on Aerospike python client. I am inserting data into the cluster using aerospike loader. Now I need to see whether the records were stored on the cluster successfully.

The command being used:

command = 'java -cp /aerospike-loader/aerospike-load-2.2-jar-with-dependencies.jar ' \
              '-Dlog4j.configuration=file:/aerospike-loader/log4j.properties ' \
              'com.aerospike.load.AerospikeLoad -h %s -p %d -n %s -c %s %s'
command_str = command % (self.host, self.port, self.namespace, tmp_json_file.name, data_file_path)

the file tmp_json_file contains config file content exactly similar to this: https://www.aerospike.com/docs/tools/asloader/examples.html

Now how do I check whether the data was transferred successfully? I tried using client.exists(key), but the meta field returns None as writePolicy=true was not set. How to set that using python client any example? Or any other way to check that the records were successfully inserted?

user3868051
  • 1,147
  • 2
  • 22
  • 43

1 Answers1

2

You can extract all the keys from the JSON and for each assemble a tuple of (namespace, json-set, json-key) (I mean using the set and key fields of the each JSON object). You can then make use of aerospike.Client.exists_many to verify the existence of the keys using batch read operations.

Even if you didn't store the human-readable key (that's the default behavior and you probably don't want to spend the extra storage), each record has a unique 20B digest. That digest is created in the client by hashing the set and primary key part of the 3-tuple mentioned above. When you'll check for existence the client will once again hash those keys you gave it, getting the same digests, and check on their existence.

Ronen Botzer
  • 6,951
  • 22
  • 41