Hello Friends My Name is Mohit Talpara and To'day i am Showing You How To install apache hadoop cluster cdh4 cloudera digitalocean
we choose digitalocean because his Provided Kvm Virtualization, Shared Private Networking, ECC Ram and RAID SSD storage and Tier-1 Bandwidth All servers come with 1Gb/sec so its best configration for Clusters and is chepest then other provider so we always say to used digitalocean for Cluster Stability.
Now First You Need To Creat Some Node in Digitalocean Control Panel and Setup DNS For Eatch one .
in my Tutorial i am used 4 Droplets with 1GB Memory and 30GB Disk Space and setup host name for eatch one
so now i have 4 Droplets with this host name
node1.datatube.co.in 192.241.162.77
node2.datatube.co.in 162.243.80.11
node3.datatube.co.in 162.243.81.68
node4.datatube.co.in 162.243.82.23
now Chabged Password Of All Node And Created New Same Password For All Users Because in cloudera Setup i will choose root password authentication option
now Fisrt Login In To All Droplets Using SSH
And Update Yum Using This Command
yum -y install perl openssh-clients
Now Edit Host File For Add All Cluster Nodes Please Note Its My Configration You Need To Add Your Own Host Domain Name.
Edit Host File using This Command
nano /etc/hosts
And Add This Config in host file please note do not delete any existing host just add new host
192.241.162.77 node1.datatube.co.in n1
162.243.80.11 node2.datatube.co.in n2
162.243.81.68 node3.datatube.co.in n3
162.243.82.23 node4.datatube.co.in n4
Now Edit /etc/resolv.conf File Using This Command.[It is use to configure client side access to the Internet Domain Name System (DNS). This file defines which name servers to use.]
nano /etc/resolv.conf
Now Delete All Data in file and Add This Data
search datatube.co.in
nameserver 8.8.8.8
Now Edit Network using This Commands
nano /etc/sysconfig/network
Delete All Config and Add this Following Config [Please Not in this config HOSTNAME= is Your server(drop) Host Name So change with your Server Host Name]
NETWORKING=yes
HOSTNAME=node1.datatube.co.in
GATEWAY=8.8.8.8
Now Edit selinux Configration using This Command
nano /etc/selinux/config
And See In This File this option SELINUX is disabled
SELINUX=disabled
Now Check Your Iptables off
chkconfig iptables off
Now Edit Yum Config Disable For fastestmirror checking.So edit fastestmirror.conf file using this Commandline
nano /etc/yum/pluginconf.d/fastestmirror.conf
edit in config file enabled=1 to enabled=0
enabled=0
And After Restart The Network using This Command
/etc/init.d/network restart
now edit ssh config file For Stop To Check Hostkey using This Command
nano /etc/ssh/ssh_config
edit in Config File StricHostkeyChecking no
StricHostkeyChecking no
now All Node Is Ready For Install Cloudera manager So just install in only main node using This Command
wget http://archive.cloudera.com/cm4/insta...
chmod +x cloudera-manager-installer.bin
./cloudera-manager-installer.bin
Now Followin
