Integrating LVM with hadoop and providing elasticity to datanode
First we have to set up namenode and datanode . For this I have installed hadoop software and jdk software.
Now we have to configure the hadoop namenode , for this go to dir called -
and put the dir name for namenode.
Now putting the namenode ip in -
here i am launching namenode in AWS cloud , so we have to put the neutral ip called 0.0.0.0 here with hdfs protocol.
Now configuring the datanode . putting the dir to be shared in master.
putting the public ip of namenode , so that datanode can go to the namenode and join to them and can share their storage.
Now at the data node machine , I am going to create a Logical Volume so that we can provide limited storage to cluster.
For this I have attached two hard disk here , called /dev/sdb and /dev/sdc.