Using Runtime.getRuntime().exec() in jsp. All commands except copy (copyFromLocal) not working

Question

I am trying to copy a file from local storage to hdfs in the following code. It works if I use command to list files i.e. hadoop fs -ls Alert but it doesn't work while copying a file.

Here is my code.

<html><%@ page import="java.util.*,java.io.*"%>
<%@ page import="java.lang.*"%>
<%@ page import="java.util.*"%>
<%@ page import="java.nio.file.Files"%>
<%@ page import="java.nio.file.Paths"%>
<%@ page import="java.nio.file.attribute.PosixFilePermission"%>
<body>
<font color=black>
<%
   String jobId=request.getParameter("jobId");
   String jobStatus=request.getParameter("jobStatus");
   String displayName=request.getParameter("displayName");
   String name=request.getParameter("name");
   String description=request.getParameter("description");
   String frequency=request.getParameter("frequestuency");
   String lastModifiedAt=request.getParameter("lastModifiedAt");
   String createdAt=request.getParameter("createdAt");  
   String createdBy=request.getParameter("createdBy");      
   String opPath=request.getParameter("opPath");        
   String env=request.getParameter("env");  
   PrintWriter writer = new PrintWriter("/var/lib/tomcat7/webapps/ROOT/log.txt", "UTF-8");
   writer.println("Job ID : "+jobId);
   writer.println("Job Status : "+jobStatus);
   writer.println("Rule Name : "+name);
   writer.println("Rule Display Name : "+displayName);
   writer.println("Rule Description : "+description);
   writer.println("Rule env : "+env);
   writer.println("Rule frequency : "+frequency);
   writer.println("Rule last modified at : "+lastModifiedAt);
   writer.println("Rule created at : "+createdAt);
   writer.println("Rule created by : "+createdBy);
   writer.println("Notification Path : "+opPath);
   writer.close();

   Set<PosixFilePermission> perms = new HashSet<PosixFilePermission>();
   perms.add(PosixFilePermission.OWNER_READ);
   perms.add(PosixFilePermission.OWNER_WRITE);
   perms.add(PosixFilePermission.OWNER_EXECUTE);
   perms.add(PosixFilePermission.GROUP_READ);
   perms.add(PosixFilePermission.GROUP_WRITE);
   perms.add(PosixFilePermission.GROUP_EXECUTE);
   perms.add(PosixFilePermission.OTHERS_READ);
   perms.add(PosixFilePermission.OTHERS_WRITE);
   perms.add(PosixFilePermission.OTHERS_EXECUTE);         
   Files.setPosixFilePermissions(Paths.get("/var/lib/tomcat7/webapps/ROOT/log.txt"), perms);
   Process p = Runtime.getRuntime().exec("/usr/local/hadoop/bin/hadoop fs -copyFromLocal /var/lib/tomcat7/webapps/ROOT/log.txt Alert/Notify");

   OutputStream os = p.getOutputStream();
   InputStream in = p.getInputStream();
   DataInputStream dis = new DataInputStream(in);
   String disr = dis.readLine();
   while ( disr != null ) 
   {
   out.println(disr);
   disr = dis.readLine();
   }
%>
</body>
</font>
</html>

Even -mkdir,-rmr,etc works perfectly. I think there is some problem in copying a file from the ROOT folder.

Do I need to do something more, specifically for copying files.

Any help is appreciated.

score 0 · Accepted Answer · edited May 23 '17 at 11:57

Sorry About unintentionally misguiding earlier. The problem actually lied in hadoop's storage system (hdfs) andI thought it was definitely a problem with tomcat or jsp. I thought of deleting the question as soon as I found this out but then I thought that It would benefit someone else , as I could not find anything on it for 2 days.

I found this to help me finally Permission denied at hdfs.

-copyFromLocal or -put needs to have some permissions I suppose and just adding the following in hdfs-site.xml and then running it worked.

 <property>
    <name>dfs.permissions</name>
    <value>false</value>
  </property>

Also I tried the same in php and it is much less of a hassle than jsp or servlet.

This is what I did finally in php

<?php
  if( $_GET["jobId"] || $_GET["jobStatus"] )
  {
     echo "Job Id ". $_GET['jobId']. "<br />";
     echo "Job Status ". $_GET['jobStatus']. "";
  }
  $jobId=$_GET["jobId"];
  $jobStatus=$_GET["jobStatus"];
  $displayName=$_GET["displayName"];
  $name=$_GET["name"];
  $description=$_GET["description"];
  $frequency=$_GET["frequestuency"];
  $lastModifiedAt=$_GET["lastModifiedAt"];
  $createdAt=$_GET["createdAt"];    
  $createdBy=$_GET["createdBy"];        
  $opPath=$_GET["opPath"];      
  $env=$_GET["env"];
  $file = fopen("log.txt","w");
  echo fwrite($file,"Job ID : ".$jobId."\n"."Job Status : ".$jobStatus."\n"."Display Name : ".$displayName."\n"."Name : "."\n"."Description : ".$description."\n"."Frequency : ".$frequency."\n"."Last Modified At".$lastModifiedAt."\n"."Created At".$createdAt."\n"."Created By : ".$createdBy);
  fclose($file);
  chmod("log.txt", 0777);
  $last_line = system('/usr/local/hadoop/bin/hadoop fs -put /var/www/html/log.txt /user/hduser/Alert/', $retval);
  $last_line = system('/usr/local/hadoop/bin/hadoop fs -ls /user/hduser/Alert/', $retval);
  echo '<pre>';
  $output2 = exec('hadoop fs -copyFromLocal /var/www/html/log.txt /user/hduser/Alert/Notify');
  echo '
    </pre>
    <hr />' . $last_line . '
    <hr />' . $retval;
        '<hr />' . $output1;

?>

Using Runtime.getRuntime().exec() in jsp. All commands except copy (copyFromLocal) not working

1 Answers1