6

This might be a naive question, but I'm really not sure how to do it. I submit a spark job and I get the following output.

Run job succeeded. Submission id: driver-20170824224209-0001

I want to programmatically query the status of this job. How can I use the output in the console to extract the id to a variable using a bash script. Any help appreciated.

Melissa Stewart
  • 3,483
  • 11
  • 49
  • 88
  • Do you mean when you run a program, it outputs that string `Run job...` and you want to get the id from that string into a variable? – lurker Nov 06 '18 at 23:44

1 Answers1

11

Let's say you command is cmd and you want to store the output of the command in ( say ) a variable called res, one way in bash is to run the command in single quotes

res=`cmd`

or embed the command within $()

res=$(cmd)

Capture both stdout and stderr in Bash

asio_guy
  • 3,667
  • 2
  • 19
  • 35