Native shell command set to extract node value from XML

Question

I'm trying to extract the value of a node from a pom.xml:

<?xml version="1.0" encoding="UTF-8"?>
<project>
    <parent>
        <groupId>org.me.labs</groupId>
        <artifactId>my-random-project</artifactId>
        <version>1.5.0</version>
    </parent>
    ...
</project>

I need to extract the artifactId and version from the XML using a shell command. I have the following requirements/observations:

1. The shell script will be done within a build assembly file we use at work, so the smaller the script the better.
2. Since it'll be used on multiple systems (usually RHEL5), I'm looking for something that can run natively on default images.
3. Tags like can occur elsewhere in the pom, so I can't simply awk for those tags.

I have tried the following:

1. xpath works on my Mac, but isn't available by default on RHEL machines. Similarly for xmllint --xpath, which I guess is only available on later versions of xmllint, which I don't have and can't enforce.
2. xmllint --pattern seemed promising, but I can't seem to get an output out of xmllint --pattern '//project/parent/version' pom.xml (prints entire XML) or xmllint --stream --pattern '//project/parent/version' pom.xml (no output).

I realize this is a common question here on SO, but the points above are why I can't use those answers. TIA for your help.

Answer 1

--format is used only to format (indent, etc) the document. You can do that using --xpath (tested in Ubuntu, libxml v20900):

$ xmllint --xpath "//project/parent/version/text()" pom.xml
1.5.0

Answer 2

I've managed to solve it for the time being with this rather unwiedly script using xmllint --shell.

echo "cat //project/parent/version" | xmllint --shell pom.xml | sed '/^\/ >/d' | sed 's/<[^>]*.//g'

If the XML nodes have namespace attributes like my pom.xml had, things get heavier, basically extracting the node by name:

echo "cat //*[local-name()='project']/*[local-name()='parent']/*[local-name()='version']" | xmllint --shell pom.xml | sed '/^\/ >/d' | sed 's/<[^>]*.//g'

Hope it helps. If anyone can simply these expressions, I'd be grateful.

Answer 3

I came here looking for a nice way to scrape a value from a website. The following example may be useful to those (unlike the poster) who have a version of xmllint which supports --xpath.

I needed to pull the most recent stable version of the elasticsearch .debfile and install it. The maintainers have helpfully put the version number in a span with the class "version".

version=`curl -s http://www.elasticsearch.org/download/ |\
 xmllint --html --xpath '//span[@class="version"]/text()'\
 2>/dev/null - `;

What goes on:

We use the curl -s (silent) option.

curl -s http://www.elasticsearch.org/download/

We use the xmllint --html and --xpath switches. The xpath arguments (in single quotes)

'//span[@class="version"]/text()'

... looks for a <span> node with the class attribute (@class) "version", and extracts the text value (/text()).

Since xmllint is (surprise!) a linter, it will squawk about the inevitable garbage in your html stream. We direct the stderr to /dev/null in the usual way:

 2>/dev/null

Finally, note the " - " at the end of the xmllint command, which tells xmllint the stream is coming from stdin.

Answer 4

Using the text() XPath function gives you the element value, rather than having to remove the XML tags:

echo "cat //project/parent/version/text()" | xmllint --shell pom.xml

Answer 5

You can try

xmllint --xpath "/*[name()='project']/*[name()='groupId']/text()" pom.xml

Answer 6

With POMs you may issue problems with namespaces which prevent xmllint to work as expected. This articles points you to an alternative and very good solution (look at sed paragraph).