0

Following the nthreads vs ncores issue we wanted to define in the yarn cluster API the number of threads per worker.

In the dask yarn CLI docs there is an option to define the number of threads.
But in the API docs we could not find the reference (only the option to define worker_vcores).

Any assistance would be appreciated.

skibee
  • 1,279
  • 1
  • 17
  • 37

1 Answers1

0

I believe dask-yarn will default to the number of vcores per worker as nthreads -- vcores is a term more familiar to the yarn community.

In the help for the CLI:

Number of threads. Defaults to number of vcores in the "container"

quasiben
  • 1,444
  • 1
  • 11
  • 19