這篇文章主要介紹“MacOS下Hadoop3的安裝步驟”，在日常操作中，相信很多人在MacOS下Hadoop3的安裝步驟問題上存在疑惑，小編查閱了各式資料，整理出簡(jiǎn)單好用的操作方法，希望對(duì)大家解答”MacOS下Hadoop3的安裝步驟”的疑惑有所幫助！接下來，請(qǐng)跟著小編一起來學(xué)習(xí)吧！

這篇文章主要介紹“MacOS下Hadoop3的安裝步驟”，在日常操作中，相信很多人在MacOS下Hadoop3的安裝步驟問題上存在疑惑，小編查閱了各式資料，整理出簡(jiǎn)單好用的操作方法，希望對(duì)大家解答”MacOS下Hadoop3的安裝步驟”的疑惑有所幫助！接下來，請(qǐng)跟著小編一起來學(xué)習(xí)吧！

網(wǎng)站建設(shè)哪家好，找成都創(chuàng)新互聯(lián)！專注于網(wǎng)頁設(shè)計(jì)、網(wǎng)站建設(shè)、微信開發(fā)、重慶小程序開發(fā)公司、集團(tuán)企業(yè)網(wǎng)站建設(shè)等服務(wù)項(xiàng)目。為回饋新老客戶創(chuàng)新互聯(lián)還提供了樂陵免費(fèi)建站歡迎大家使用！

1 檢查JDK

Matching Java Virtual Machines (1):

    1.8.0_201, x86_64:"Java SE 8"/Library/Java/JavaVirtualMachines/jdk1.8.0_201.jdk/Contents/Home

/Library/Java/JavaVirtualMachines/jdk1.8.0_201.jdk/Contents/Home

2 安裝Brew

nancylulululudeMacBook-Air:~ nancy$ /usr/bin/ruby -e "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install)"

3 密鑰

ssh-keygen -t rsa -P '' -f ~/.ssh/id_rsa

cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys

nancylulululudeMacBook-Air:.ssh nancy$ ls

authorized_keysid_rsaid_rsa.pubknown_hosts

nancylulululudeMacBook-Air:.ssh nancy$ chmod 0600 ~/.ssh/authorized_keys

4 brew安裝hadoop

 brew install hadoop

5 hadoop配置

路徑：

/usr/local/Cellar/hadoop/3.1.1/libexec/etc/hadoop

core-site.xml

<configuration>

 <property>

    <name>fs.default.name</name>

    <value>hdfs://localhost:8020</value>

  </property>

 <property>

    <name>hadoop.tmp.dir</name>

    <value>file:/usr/local/Cellar/hadoop/tmp</value>

  </property>

 <property>

    <name>fs.trash.interval</name>

    <value>4320</value>

  </property>

</configuration>

hdfs-site.xml

<configuration>

<property>

   <name>dfs.namenode.name.dir</name>

   <value>file:/usr/local/Cellar/hadoop/tmp/dfs/name</value>

 </property>

 <property>

   <name>dfs.datanode.data.dir</name>

   <value>file:/usr/local/Cellar/hadoop/tmp/dfs/data</value>

 </property>

 <property>

   <name>dfs.replication</name>

   <value>1</value>

 </property>

 <property>

   <name>dfs.webhdfs.enabled</name>

   <value>true</value>

 </property>

 <property>

   <name>dfs.permissions.superusergroup</name>

   <value>admin</value>

 </property>

 <property>

   <name>dfs.permissions.enabled</name>

   <value>false</value>

 </property>

</configuration>

yarn-site.xml

<configuration>

<!-- Site specific YARN configuration properties -->

<property>

   <name>yarn.resourcemanager.hostname</name>

   <value>localhost</value>

</property>

 <property>

   <name>yarn.nodemanager.aux-services</name>

   <value>mapreduce_shuffle</value>

 </property>

 <property>

   <name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>

   <value>org.apache.hadoop.mapred.ShuffleHandler</value>

 </property>

 <property>

   <name>yarn.resourcemanager.address</name>

   <value>localhost:18040</value>

 </property>

<property>

   <name>yarn.resourcemanager.scheduler.address</name>

   <value>localhost:18030</value>

 </property>

 <property>

   <name>yarn.resourcemanager.resource-tracker.address</name>

   <value>localhost:18025</value>

 </property>

 <property>

   <name>yarn.resourcemanager.admin.address</name>

   <value>localhost:18141</value>

 </property>

<property>

   <name>yarn.resourcemanager.webapp.address</name>

   <value>localhost:18088</value>

</property>

<property>

   <name>yarn.log-aggregation-enable</name>

   <value>true</value>

</property>

<property>

   <name>yarn.log-aggregation.retain-seconds</name>

   <value>86400</value>

</property>

<property>

   <name>yarn.log-aggregation.retain-check-interval-seconds</name>

   <value>86400</value>

</property>

<property>

   <name>yarn.nodemanager.remote-app-log-dir</name>

   <value>/tmp/logs</value>

</property>

<property>

   <name>yarn.nodemanager.remote-app-log-dir-suffix</name>

   <value>logs</value>

</property>

</configuration>

mapred-site.xml

<configuration>

<property>

  <name>mapreduce.framework.name</name>

  <value>yarn</value>

</property>

<property>

  <name>mapreduce.jobtracker.http.address</name>

  <value>localhost:50030</value>

</property>

<property>

  <name>mapreduce.jobhisotry.address</name>

  <value>localhost:10020</value>

</property>

<property>

  <name>mapreduce.jobhistory.webapp.address</name>

  <value>localhost:19888</value>

</property>

<property>

  <name>mapreduce.jobhistory.done-dir</name>

  <value>/jobhistory/done</value>

</property>

<property>

  <name>mapreduce.intermediate-done-dir</name>

  <value>/jobhisotry/done_intermediate</value>

</property>

<property>

  <name>mapreduce.job.ubertask.enable</name>

  <value>true</value>

</property>

</configuration>

slaves

localhost

6 創(chuàng)建文件夾

nancylulululudeMacBook-Air:hadoop nancy$ mkdir  /usr/local/Cellar/hadoop/tmp

nancylulululudeMacBook-Air:hadoop nancy$ mkdir -p  /usr/local/Cellar/hadoop/tmp/dfs/name

nancylulululudeMacBook-Air:hadoop nancy$ mkdir  /usr/local/Cellar/hadoop/tmp/dfs/data

7 hdfs格式化

 hdfs namenode -format

格式化成功

2019-03-22 16:48:24,632 INFO common.Storage: Storage directory /usr/local/Cellar/hadoop/tmp/dfs/name has been successfully formatted.

Here comes the last step~

startup！

nancylulululudeMacBook-Air:3.1.1 nancy$ cd /usr/local/Cellar/hadoop/3.1.1/sbin

nancylulululudeMacBook-Air:sbin nancy$ ./start-all.sh

WARNING: Attempting to start all Apache Hadoop daemons as nancy in 10 seconds.

WARNING: This is not a recommended production deployment configuration.

WARNING: Use CTRL-C to abort.

Starting namenodes on [localhost]

Starting datanodes

Starting secondary namenodes [nancylulululudeMacBook-Air.local]

nancylulululudeMacBook-Air.local: Warning: Permanently added 'nancylulululudemacbook-air.local,192.168.1.142' (ECDSA) to the list of known hosts.

2019-03-22 17:24:04,021 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

Starting resourcemanager

Starting nodemanagers

nancylulululudeMacBook-Air:sbin nancy$ jps

3266 NodeManager

3171 ResourceManager

2980 SecondaryNameNode

2748 NameNode

2847 DataNode

3327 Jps

登陸地址 http://localhost:9870/    

               http://localhost:8088/

文章名稱：MacOS下Hadoop3的安裝步驟
網(wǎng)站路徑：http://aaarwkj.com/article38/deisp.html

成都網(wǎng)站建設(shè)公司_創(chuàng)新互聯(lián)，為您提供企業(yè)網(wǎng)站制作、網(wǎng)站建設(shè)、定制網(wǎng)站、網(wǎng)站收錄、服務(wù)器托管、響應(yīng)式網(wǎng)站

廣告

聲明：本網(wǎng)站發(fā)布的內(nèi)容（圖片、視頻和文字）以用戶投稿、用戶轉(zhuǎn)載內(nèi)容為主，如果涉及侵權(quán)請(qǐng)盡快告知，我們將會(huì)在第一時(shí)間刪除。文章觀點(diǎn)不代表本網(wǎng)站立場(chǎng)，如需處理請(qǐng)聯(lián)系客服。電話：028-86922220；郵箱：631063699@qq.com。內(nèi)容未經(jīng)允許不得轉(zhuǎn)載，或轉(zhuǎn)載時(shí)需注明來源： 創(chuàng)新互聯(lián)