Execute Pig from within Java Application

Question

Is it possible to run Apache Pig jobs from within a Java application, without forking an external process?

It seems both Pig and Hadoop are written in Java but don't really offer Java APIs. Rather than relying on shell scripts, I'd rather use these tools form within a Java Spring application.

score 2 · Answer 1 · answered Feb 21 '12 at 11:31

2

It seems there is Java API for Pig.

According to this API, there is a PigRunner class.

With that, you could easily add it to your Spring application, by creating a dedicated Spring bean.

answered Feb 21 '12 at 11:31

ndeverge

21,378
4
56
85

score 2 · Answer 2 · answered Feb 28 '12 at 02:45

2

From what I've seen document wise and example wise is to you the PigServer class. They have examples of using it here: http://pig.apache.org/docs/r0.8.1/setup.html#Sample+Code

answered Feb 28 '12 at 02:45

NerdyNick

813
1
9
17

score 1 · Accepted Answer · answered Feb 21 '12 at 11:40

1

See Spring Hadoop project and its Pig support.

answered Feb 21 '12 at 11:40

Costin Leau

26
1

Execute Pig from within Java Application

3 Answers3

Linked