๋ฐ์ดํ„ฐ๋ถ„์„๊ฐ€ ๊ณผ์ •/Hadoop

DAY79. Hadoop Basic Slave ์„œ๋ฒ„ ํ™˜๊ฒฝ์„ค์ •, ์ธ์ฆํ‚ค ์ƒ์„ฑ ๋ฐ ๋ณต์‚ฌ

LEE_BOMB 2022. 1. 12. 22:42
Slave ์„œ๋ฒ„ ํ™˜๊ฒฝ์„ค์ •

1. Slave ๊ฐ€์ ธ์˜ค๊ธฐ

VMware > Open Virtual Machine > ๋ฏธ๋ฆฌ ๋งŒ๋“ค์–ด๋‘์—ˆ๋˜ Slave1 ํด๋” ์„ ํƒ > Master ์„ ํƒ

 

 

2. Slave ํ™˜๊ฒฝ์„ค์ • ๋ณ€๊ฒฝ

1) VMware ์ตœ์ƒ๋‹จMaster > Edit virtual machine settings

2) Options > General > Virtual machine name์„ Slave1๋กœ ๋ณ€๊ฒฝ

3) Hardware > Network Adapter > Advanced... > Generate > OK

 

 

3. ๊ฐ€์ƒ ๋จธ์‹  ์‹คํ–‰

VMware > Slave1 > Play virtual machine

* ํŒ์—…์ฐฝ ๋œจ๋ฉด I Moved It ์„ ํƒ

๊ฐ€์ƒํ™˜๊ฒฝ ์ตœ์ƒ๋‹จ์—์„œ Slave1 ๊ฐ€์ƒ๋จธ์‹  ๋กœ๊ทธ์ธ ํ™•์ธ

 

 

4. Hostname ๋ณ€๊ฒฝ

[Hadoop@master ~]$ su root -> ๊ด€๋ฆฌ์ž ๋ชจ๋“œ ์ง„์ž…
์•”ํ˜ธ:
[root@master hadoop]#hostnamectl set-hostname slave1 -> ์„œ๋ฒ„ ์ด๋ฆ„ ๋ณ€๊ฒฝ
[root@master hadoop]#hostname -> ์„œ๋ฒ„ ์ด๋ฆ„ ํ™•์ธ
slave1

 

 

5. ๋„คํŠธ์›Œํฌ ๋ณ€๊ฒฝ (์„ค์ • > ๋„คํŠธ์›Œํฌ)

1) ์‹ ์› > MAC์ฃผ์†Œ ์„ ํƒ

2) IPv4 > IPv4๋ฐฉ์‹ ์ˆ˜๋™ > ์ฃผ์†Œ๋Š” salve1์˜ ์ฃผ์†Œ, ๋„คํŠธ๋งˆ์Šคํฌ์™€ ๊ฒŒ์ดํŠธ์›จ์ด, ๋„ค์ž„์„œ๋ฒ„๋Š” ๋ณธ์ธ IP์ฃผ์†Œ

 

 

6. hosts์„ค์ • ํ™•์ธ

[root@master hadoop]# vi /etc/hosts

172.16.57.5 master
172.16.57.10 slave1 -> IP์ฃผ์†Œ์™€ ํ˜ธ์ŠคํŠธ ์ด๋ฆ„ ํ™•์ธ

์ธํ„ฐ๋„ท ์—ฐ๊ฒฐ ํ™•์ธ > Slave1 ์„œ๋ฒ„ ์žฌ๋ถ€ํŒ… > Slave1 ์„œ๋ฒ„ ๋„คํŠธ์›Œํฌ ํ™˜๊ฒฝ์„ค์ • ํ™•์ธ

 

 

Master์„œ๋ฒ„ ์‹œ์ž‘

VMware > Master > Play virtual machine

 

 

7. ์ƒํ˜ธ ์„œ๋ฒ„ ์ ‘์†(Master -> Slave)

[hadoop@master ~]$ ssh hadoop@slave1 -> hadoop ๊ณ„์ •์œผ๋กœ slave1 ์„œ๋ฒ„์™€ ์ ‘์†
yes
hadoop@slave1's passwaod: -> hadoop ์‚ฌ์šฉ์ž ๋น„๋ฐ€๋ฒˆํ˜ธ ์ž…๋ ฅ

[hadoop@slave1 ~]$ hostname -> ์ ‘์†ํ•œ ์„œ๋ฒ„์˜ host๋ช… ํ™•์ธ
slave1
[hadoop@slave1 ~]$ logout -> ๋กœ๊ทธ์•„์›ƒ
Connection to slave1 closed.
[hadoop@master ~]$ hostname -> ํ˜„์žฌ ์„œ๋ฒ„๋ช… ํ™•์ธ
master

 

 

8. ์ƒํ˜ธ ์„œ๋ฒ„ ์ ‘์† (Slave -> Master)

[hadoop@master ~]$ ssh hadoop@master -> hadoop ๊ณ„์ •์œผ๋กœ master ์„œ๋ฒ„์™€ ์ ‘์†
yes
hadoop@master's passwaod: -> hadoop ์‚ฌ์šฉ์ž ๋น„๋ฐ€๋ฒˆํ˜ธ ์ž…๋ ฅ

[hadoop@slave1 ~]$ hostname -> ์ ‘์†ํ•œ ์„œ๋ฒ„์˜ host๋ช… ํ™•์ธ
master
[hadoop@slave1 ~]$ logout -> ๋กœ๊ทธ์•„์›ƒ
Connection to slave1 closed.
[hadoop@master ~]$ hostname -> ํ˜„์žฌ ์„œ๋ฒ„๋ช… ํ™•์ธ
slave1

 

 

9) Master/Slave ์„œ๋ฒ„ ์ข…๋ฃŒ

 

 

 

 

 

Master/Slave ์ธ์ฆํ‚ค ์ƒ์„ฑ ๋ฐ ๋ณต์‚ฌ

1) VMware > Master/Slave1 ๊ฐ€์ƒ๋จธ์‹  ์‹คํ–‰

 

 

2) ์ธ์ฆํ‚ค ์ƒ์„ฑ/์•”ํ˜ธ ํ•ด์ œ (master ์ž‘์—…)

* ์ธ์ฆํ‚ค ์ƒ์„ฑ ๋ชฉ์  : ํด๋Ÿฌ์Šคํ„ฐ๋กœ ๊ตฌ์„ฑ๋œ ๊ฐ ์„œ๋ฒ„ ๊ฐ„์˜ ์ ‘์†๊ณผ์ •์—์„œ ์•”ํ˜ธ ์ž…๋ ฅ์—†์ด ์ ‘์†

[hadoop@master ~]$ pwd
/home/hadoop
[hadoop@master ~]$
[hadoop@master ~]$ ssh-keygen -t rsa -> ๊ณต๊ฐœ ํ‚ค ์ƒ์„ฑ ํ›„ Enter key 3ํšŒ

 

 

3) ๊ณต๊ฐœํ‚ค๋Š” ํ™ˆ ๋””๋ ‰ํ„ฐ๋ฆฌ ํ•˜์œ„์— .ssh ํด๋”๋กœ ์ƒ์„ฑ

[hadoop@master ~]$ cd .ssh -> ๋””๋ ‰ํ„ฐ๋ฆฌ ์ด๋™
[hadoop@master .shh]$
[hadoop@master .shh]$
[hadoop@master .shh]$ ls -> ๊ณต๊ฐœ ํ‚ค ํ™•์ธ
id_rsa  id_rsa.pub  known_hosts
[hadoop@master .shh]$

 

 

4) ๋‹ค๋ฅธ ์„œ๋ฒ„(slave1)์— ์ธ์ฆํ‚ค ๋ณต์‚ฌ

- Master์—์„œ ๊ณต๊ฐœํ‚ค๋ฅผ ๋ณต์ œํ•˜์—ฌ Slave1์œผ๋กœ ๋ณต์‚ฌํ•˜์—ฌ ๊ณต๊ฐœํ‚ค๋ฅผ ๊ณต์œ 

[hadoop@master .shh]$

[hadoop@master .shh]$ scp id_rsa.pub authorized_keys -> Master ๊ณต๊ฐœ ํ‚ค ๋ณต์‚ฌ
[hadoop@master .shh]$ ls
autorized_keys  id_rsa  id_rsa.pub  known_hosts

[hadoop@master .shh]$ scp id_rsa.pub hadoop@slave1:/home/hadoop/.ssh/authorized_keys -> Slave1 ๋ณต์‚ฌ
haddop@slave's password:

Master ์„œ๋ฒ„ ์žฌ์‹œ์ž‘

 

 

5) Master -> Slave1 ์„œ๋ฒ„ ์ ‘์† ํ…Œ์ŠคํŠธ

[hadoop@master ~]$ pwd
/home/hadoop
[hadoop@master ~]$ ssh hadoop@slave1 -> Slave1 ์—ฐ๊ฒฐ. ์•”ํ˜ธ ์š”๊ตฌ ์—†์Œ!

[hadoop@slave1 ~]$ hostname -> ์ ‘์† ์„œ๋ฒ„ ํ™•์ธ
slave1

[hadoop@slave1 ~]$ logout -> ๋กœ๊ทธ์•„์›ƒ
Connection to slave1 closed.
[hadoop@master ~]$
[hadoop@master ~]$ hostname -> ์ ‘์† ์„œ๋ฒ„๋ช… ํ™•์ธ
master

 

Slave1 -> Master ์„œ๋ฒ„ ์ ‘์† ํ…Œ์ŠคํŠธ

[hadoop@slave1 ~]$ pwd
/home/hadoop
[hadoop@slave1 ~]$ ls.sssh -> ๊ณต๊ฐœ ํ‚ค ๋ณต์ œ ํ™•์ธ
autorized_keys  known_hosts

[hadoop@slave1 ~]$ ssh hadoop@master
hadoop@master's password: -> ์•”ํ˜ธ ๋ฌผ์–ด๋ด„

[hadoop@master ~]$ logout
Connection to master closed.
[hadoop@slave1 ~]$