apache - Hadoop client not able to connect to server -

-

i set 2-node hadoop cluster, , running start-df.sh , start-yarn.sh works nicely (i.e. expected services running, no errors in logs).

however, when try run application, several tasks fail:

15/04/01 15:27:53 info mapreduce.job: task id : attempt_1427894767376_0001_m_000008_2, status : failed

i checked yarn , datanode logs, nothing reported there. in userlogs, syslogs files on slave node contain following error message:

2015-04-01 15:27:21,077 info [main] org.apache.hadoop.ipc.client: retrying connect server: slave.domain.be./127.0.1.1:53834. tried 9 time(s); retry policy retryuptomaximumcountwithfixedsleep(maxretries=10, sleeptime=1000 milliseconds) 2015-04-01 15:27:21,078 warn [main] org.apache.hadoop.mapred.yarnchild: exception running child : java.net.connectexception: call slave.domain.be./127.0.1.1 slave.domain.be.:53834 failed on connection exception: java.net.connectexception: connection refused; more details see: http://wiki.apache.org/hadoop/connectionrefused @ sun.reflect.nativeconstructoraccessorimpl.newinstance0(native method)

so problem slave cannot connect itself..

i checked whether there process running on slave node listening @ port 53834, there none. however, 'expected' ports being listened on (50020,50075,..). in configuration have used port 53834. it's different port on different runs.

any ideas on fixing issue?

your error might due loopback address in hosts file. go /etc/hosts file , comment line 127.0.1.1 in slave nodes , master node(if necessary). start hadoop processes.

edited:

  1. do in terminal edit hosts file without root permission: sudo bash

  2. enter current user password enter root login. can edit hosts file using: nano /etc/hosts


Comments

Post a Comment

Popular posts from this blog

c# - SharpSsh Command Execution -

-
Image
i trying create ssh client using c#. using tamir.sharpssh library. having issues sending command , getting appropriate response server. the way have been testing sending on ls command, followed cd.. command, followed ls command again -- see whether or not cd.. command being executed properly. however, there no difference between first ls command , second ls command. not entirely sure doing wrong. perhaps using wrong ssh type. have provided code , output getting. have added output expect. using tamir.sharpssh; namespace sshnetexample { class program { static void main(string[] args) { sshexec ssh = null; try { console.write("-connecting..."); ssh = new sshexec(host, username, password); ssh.connect(); console.writeline("ok ({0}/{1})", ssh.cipher, ssh.mac); console.writeline("server version={0}, client versio
Read more

python - Specify path of savefig with pylab or matplotlib -

-
i struggling on how find correct way specify save path (or repository) when calling function savefig in matplotlib or pylab. i tried several syntaxes, everytime python console returns : filenotfounderror: [errno 2] no such file or directory: '../mydocs/resource/frames/myimage.png' currently, have written following : pylab.savefig('../mydocs/resource/frames/myimage.png') does know how it? thanks in advance! the tilde operator , variable $home entered strings , therefore not function while saving. have provide either relative path (as did) or provide full path. eg. pylab.savefig("/home/username/desktop/myfig.png") .
Read more

How to run C# code using mono without Xamarin in Android? -

-
i want create program uses mono runtime run c# code (binary not application). i copied libmono.so unity app , i'm write code using documentation: http://www.mono-project.com/docs/advanced/embedding/ and it's working have problems references can access classes mscorlib.dll , have problems system.reflection.assembly class throwing exception, when print console see: system.missingmethodexception: method not found: 'system.reflection.assembly.op_inequality' can fix it? can use mono runtime in c binary on android? ps. i'm using android tests. edit: found solution loading libraries, need set environment variable mono_path libraries path. but have still problems assembly class. the system.missingmethodexception error have seems .net profile mismatch error, 1 explained here . can use mono runtime in c binary on android? yes, using ndk guess. there alternatives can use instead of rolling own, such xmadevlab .
Read more