Stack Overflow
Stack Overflow

Questions tagged [drmaa]

DRMAA or Distributed Resource Management Application API is a high-level Open Grid Forum API specification for the submission and control of jobs to a Distributed Resource Management (DRM) system, such as a Cluster or Grid computing infrastructure. The scope of the API covers all the high level functionality required for applications to submit, control, and monitor jobs on execution resources in the DRM system. (From Wikipedia)

27 questions
4
votes
1 answer

snakemake job fails if --drmaa-log-dir specified

I am using snakemake v. 5.7.0. The pipeline runs correctly when either launched locally or submitted to SLURM via snakemake --drmaa: jobs get submitted, everything works as expected. However, in the latter case, a number of slurm log files is…
January
  • 16,320
  • 6
  • 52
  • 74
4
votes
3 answers

Is there a DRMAA Java library that works with Torque/PBS?

Does anybody know a Java implementation of the DRMAA-API that is known to work with PBS/Torque cluster software? The background behind this: I would like to submit jobs to a newly set-up linux cluster from Java using a DRMAA compliant API. The…
Michael
  • 232
  • 2
  • 12
2
votes
1 answer

SGE DRMAA python job process

I am using Python drmaa library to launch jobs on a SGE cluster. My services is available on REST API, during my test, all work fine, jobs are submitted / waited for completion / results retrieved once finished. Process is run once, in the same…
marcoooo
  • 417
  • 4
  • 11
2
votes
1 answer

Passing job array index as an argument in drmaa-python

I am using a lsf-drmaa implementation and interfacing through drmaa-python. I usually pass in the environment variable, $LSB_JOBINDEX, into my run.sh script as an argument. Through drmaa-python, I created JobTemplate jt and would like to pass it…
user1575175
  • 91
  • 1
  • 1
  • 4
2
votes
2 answers

Catching Python Exceptions and printing out a separate message

I'm currently trying to write code to catch exceptions, and depending upon which exception is thrown, a different module will be imported than when no exception was thrown. try: import sge_execution_engine as execution_engine except ImportError:…
AKKO
  • 973
  • 2
  • 10
  • 18
2
votes
1 answer

Is it possible to list running jobs with DRMAA?

I was wondering if it is possible to list all running jobs in the resource manager, using the DRMAA library, not just the ones started via DRMAA itself? That is, getting data similar to what is output by the squeue command for the SLURM resource…
Samuel Lampa
  • 4,336
  • 5
  • 42
  • 63
1
vote
0 answers

Sun Grid Engine DRMAA java memory leak

I am using sun grid engine and java DRMAA library to schedule jobs on to the cluster from inside a web application. Everything works well as far as jobs are concerned. But the application memory usuage is growing rapidly as the time goes and when i…
Kathir
  • 6,136
  • 8
  • 36
  • 67
1
vote
0 answers

How to get libdrmaa.so to use locally installed GLIBC?

I am trying to run drmaa (a python module that controls jobs in SGE) under a CentOS 6.x. According to the drmaa-python (https://github.com/pygridtools/drmaa-python) one of the requirement is libdrmaa.so, which I acquired from gridengine-libdrmaa-dev…
cc3423Chung
  • 11
  • 2
1
vote
1 answer

How can I wait for an external started job with DRMAA?

I want to wait for a job to finish which has been submitted externally. My first idea was to get the jobID by calling qstat and then executing session.wait(jobID, Session.TIMEOUT_WAIT_FOREVER);. But this doesn't work. Are there any other ideas…
schnarchnase
  • 13
  • 1
  • 8
1
vote
2 answers

DRMAA- Cant' link drmaa library when compiling c file

I wrote a small c file to test DRMAA but it keeps telling me that the DRMAA functions I used are not defined. I included the drmaa.h file in the C code. When I use -idrmaa I get this error: [mkatouzi@argo-1 ~]$ cc -o drmtest -I$SGE_ROOT/include/…
mkatouzi
  • 49
  • 6
1
vote
1 answer

dynaming linking error with pbs-drmaa

I've installed pbs-drmaa library, but I get an error while running a C program. Here's the compilation, I've used -L and -I to indicate the proper folders for pbs-drmaa files. As it shows, there's no compilation error: $ gcc teste_drmaa1.c -L…
ericariello
  • 111
  • 1
  • 11
1
vote
1 answer

Why python DRMAA library (drmaa-python) can not determine status of the job submitted to SGE (UNDETERMINED) sometimes?

I am using drmaa-python to submit and monitor jobs to and from SGE (Sun Grid Engine). I have following status in GUI Jobs active in Queue Running Jobs Completed Jobs Failed Jobs Status Undetermined Sometimes I get few jobs with Status…
World
  • 2,007
  • 7
  • 27
  • 37
0
votes
2 answers

Web service API for DRMAA on SGE

Does anyone know of any project to expose the DRMAA API (job scheduling and maintenance API) from SGE (Sun Grid Engine) as a web service API? A RESTful API would be best.
flipchart
  • 6,548
  • 4
  • 28
  • 53
0
votes
0 answers

How to submit bulk jobs using DRMAA-python

I have read the documentation about submitting jobs to DRMAA-python. For a single job, create a job template and then submit job using runJob. For bulk jobs the documentation just says replace the runJob with runBlkJobs but doesn't really explain…
Sheldon Cheng
  • 1
0
votes
0 answers

How to install libdrmaa.so.1.0.6 library in Linux RHEL7?

We have a python script which requires DRMAA module of Python. We could successfully install this module using pip. However, the script is looking for libdrmaa.so.1.0.6 libraries in /usr/lib64 path. How can these files be downloaded and installed?…
Rachana
  • 15
  • 3
1
2