Hbase installation in three node hadoop cluster -

-

i have installed hadoop 3 node cluster(master,slave1 , slave2). install hbase distrubuted mode. think install hbase master , zookeepr in hadoop cluster master machine(i.e namenode), , region servers in slave1 , slave2(i.e datanodes) machines. correct approach ?

sorry, may simple question new nosql systems , want installations.

i appreciate if able share reference document ths installation.

thanks in advance.

in order configure hbase , zookeeper on 3 nodes, i.e., 1 master , 2 slave nodes, need edit hbase-site.xml, regionservers, hbase-env.sh (found in $hbase_home/conf) , zoo.cfg (found in $zookeeper_home/conf).

let name master node master , slave nodes slave1 , slave2. let consider hadoop, hbase , zoopeeper folders in /usr/local/cluster/ folder. change following files:

1. hbase-site.xml:

<configuration> <property> <name>hbase.master</name> <value>master:60000</value> </property> <property> <name>hbase.rootdir</name> <value>hdfs://master:8020/hbase</value> </property> <property> <property> <name>hbase.cluster.distributed</name> <value>true</value> </property> <name>hbase.zookeeper.property.clientport</name> <value>2181</value> </property> <property> <name>hbase.zookeeper.quorum</name> <value>slave1,slave2</value> </property> <property> <name>hbase.tmp.dir</name> <value>/usr/local/cluster/zk-tmp</value> </property> </configuration>

2. hbase-env.sh:

--add these lines--

export java_home=/usr/lib/jvm/default-java

export hbase_home=/usr/local/cluster/hbase

export hadoop_home=/usr/local/cluster/hadoop

--modify these lines--

export hbase_pid_dir=/usr/local/cluster/zk-tmp

export hbase_manages_zk=false

3. regionservers:

(delete localhost , add these lines if want regionservers in slave1 , slave2 only)

slave1

slave2

4. zoo.cfg:

--modify these lines--

datadir=/usr/local/cluster/zk-tmp

--add these lines(since start zookeeper server on master node)--

server.0=master:2888:3888

5. etc/hosts:

edit /etc/hosts file , comment line 127.0.1.1 (to avoid loopback address problems)

--add these lines--

your-master-node-ip master

your-slave1-node-ip slave1

your-slave2-node-ip slave2

note: steps 1 5 in master, slave1 , slave2 nodes.

6. start zookeeper server in master node:

$zookeeper_home/bin/zkserver.sh start

7. start hbase processes in master node:

$hbase_home/bin/start-hbase.sh

8. check hbase , zookeeper processes: results jps command in each node should contain-

--master--

quorumpeermain

hmaster

hregionserver

--slave1--

hregionserver

--slave2--

hregionserver

9. stopping zookeeeper , hbase:

$zookeeper_home/bin/zkserver.sh start

$hbase_home/bin/stop-hbase.sh


Comments

Post a Comment

Popular posts from this blog

How to run C# code using mono without Xamarin in Android? -

-
i want create program uses mono runtime run c# code (binary not application). i copied libmono.so unity app , i'm write code using documentation: http://www.mono-project.com/docs/advanced/embedding/ and it's working have problems references can access classes mscorlib.dll , have problems system.reflection.assembly class throwing exception, when print console see: system.missingmethodexception: method not found: 'system.reflection.assembly.op_inequality' can fix it? can use mono runtime in c binary on android? ps. i'm using android tests. edit: found solution loading libraries, need set environment variable mono_path libraries path. but have still problems assembly class. the system.missingmethodexception error have seems .net profile mismatch error, 1 explained here . can use mono runtime in c binary on android? yes, using ndk guess. there alternatives can use instead of rolling own, such xmadevlab .
Read more

c# - SharpSsh Command Execution -

-
Image
i trying create ssh client using c#. using tamir.sharpssh library. having issues sending command , getting appropriate response server. the way have been testing sending on ls command, followed cd.. command, followed ls command again -- see whether or not cd.. command being executed properly. however, there no difference between first ls command , second ls command. not entirely sure doing wrong. perhaps using wrong ssh type. have provided code , output getting. have added output expect. using tamir.sharpssh; namespace sshnetexample { class program { static void main(string[] args) { sshexec ssh = null; try { console.write("-connecting..."); ssh = new sshexec(host, username, password); ssh.connect(); console.writeline("ok ({0}/{1})", ssh.cipher, ssh.mac); console.writeline("server version={0}, client versio...
Read more

python - Specify path of savefig with pylab or matplotlib -

-
i struggling on how find correct way specify save path (or repository) when calling function savefig in matplotlib or pylab. i tried several syntaxes, everytime python console returns : filenotfounderror: [errno 2] no such file or directory: '../mydocs/resource/frames/myimage.png' currently, have written following : pylab.savefig('../mydocs/resource/frames/myimage.png') does know how it? thanks in advance! the tilde operator , variable $home entered strings , therefore not function while saving. have provide either relative path (as did) or provide full path. eg. pylab.savefig("/home/username/desktop/myfig.png") .
Read more