5

Trying to establish a Hadoop cluster via Ambari 2.0, however failure occurs at installation phase. Here are failure logs from one of the datanodes:

stderr:   /var/lib/ambari-agent/data/errors-416.txt

Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY/scripts/hook.py", line 34, in <module>
    BeforeAnyHook().execute()
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 214, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY/scripts/hook.py", line 29, in hook
    setup_jce()
  File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY/scripts/shared_initialization.py", line 40, in setup_jce
    content = DownloadSource(format("{jce_location}/{jce_policy_zip}")),
  File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148, in __init__
    self.env.run()
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 152, in run
    self.run_action(resource, action)
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 118, in run_action
    provider_action()
  File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 108, in action_create
    content = self._get_content()
  File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 150, in _get_content
    return content()
  File "/usr/lib/python2.6/site-packages/resource_management/core/source.py", line 50, in __call__
    return self.get_content()
  File "/usr/lib/python2.6/site-packages/resource_management/core/source.py", line 181, in get_content
    web_file = opener.open(req)
  File "/usr/lib64/python2.6/urllib2.py", line 391, in open
    response = self._open(req, data)
  File "/usr/lib64/python2.6/urllib2.py", line 409, in _open
    '_open', req)
  File "/usr/lib64/python2.6/urllib2.py", line 369, in _call_chain
    result = func(*args)
  File "/usr/lib64/python2.6/urllib2.py", line 1190, in http_open
    return self.do_open(httplib.HTTPConnection, req)
  File "/usr/lib64/python2.6/urllib2.py", line 1165, in do_open
    raise URLError(err)
urllib2.URLError: <urlopen error [Errno 111] Connection refused>
Error: Error: Unable to run the custom hook script ['/usr/bin/python2.6', '/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY/scripts/hook.py', 'ANY', '/var/lib/ambari-agent/data/command-416.json', '/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY', '/var/lib/ambari-agent/data/structured-out-416.json', 'INFO', '/var/lib/ambari-agent/data/tmp']
stdout:   /var/lib/ambari-agent/data/output-416.txt

2015-05-12 14:46:24,028 - u"Directory['/var/lib/ambari-agent/data/tmp/AMBARI-artifacts/']" {'recursive': True}
2015-05-12 14:46:24,233 - u"File['/var/lib/ambari-agent/data/tmp/AMBARI-artifacts//UnlimitedJCEPolicyJDK7.zip']" {'content': DownloadSource('http://localhost:8080/resources//UnlimitedJCEPolicyJDK7.zip')}
2015-05-12 14:46:24,323 - Downloading the file from http://localhost:8080/resources//UnlimitedJCEPolicyJDK7.zip
Error: Error: Unable to run the custom hook script ['/usr/bin/python2.6', '/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY/scripts/hook.py', 'ANY', '/var/lib/ambari-agent/data/command-416.json', '/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY', '/var/lib/ambari-agent/data/structured-out-416.json', 'INFO', '/var/lib/ambari-agent/data/tmp']

I think the problem is here:

2015-05-12 16:21:44,698 - Downloading the file from http://localhost:8080/resources//UnlimitedJCEPolicyJDK7.zip

It tries to download from localhost, but I think it should be address of the namenode. Am I missing something?

Mogsdad
  • 44,709
  • 21
  • 151
  • 275
gunererd
  • 651
  • 9
  • 19
  • 1
    Does the ambari server node has a FQHN (fully-qualified-hostname) which is accessible from all the client nodes? – Zouzias May 13 '15 at 08:58
  • Thank you, setting a FQDN for ambari-server node solved my problem. If you post an answer instead of comment I can close this question. – gunererd May 13 '15 at 10:20
  • Good to hear. Feel free to close the answer. – Zouzias May 13 '15 at 12:31
  • 1
    I've used the FQDN in all the /etc/hosts and also while setting up Ambari Server. Still I am facing the issue. I've masters and slaves are in different subnets. I am not sure if it's due to keeping them in the same subnet. – java_enthu Sep 19 '15 at 11:38
  • I wish there was an option to re-open the question :) – java_enthu Sep 19 '15 at 14:42

1 Answers1

1

Use a FQHN (fully-qualified-hostname) on both ambari server and all its client nodes.

Zouzias
  • 2,330
  • 1
  • 22
  • 32