【Hadoop】HBase组件配置

目录

• HBase实验步骤：
  • 1、配置时间同步（所有节点）
  • 2、部署HBase（master节点）
  • 3、配置HBase（master节点）
  • 4、拷贝文件到slave节点
  • 5、修改权限，切换用户（所有节点）
  • 6、启动hadoop（master节点）
  • 7、启动hbase（master节点）
  • 8、查看浏览器页面
  • 9、hbase语法应用（master节点）
  • 10、关闭hbase（master节点）

HBase实验步骤：

需要在Hadoop-全分布式配置的基础上进行配置

1、配置时间同步（所有节点）

[root@master ~]# yum -y install chrony[root@master ~]# vi /etc/chrony.confserver 0.time1.aliyun.com iburst#保存[root@master ~]# systemctl restart chronyd[root@master ~]# systemctl enable chronydCreated symlink from /etc/systemd/system/multi-user.target.wants/chronyd.service to /usr/lib/systemd/system/chronyd.service.[root@master ~]# systemctl status chronyd● chronyd.service - NTP client/server   Loaded: loaded (/usr/lib/systemd/system/chronyd.service; enabled; vendor preset: enabled)   Active: active (running) since Fri 2022-04-15 15:39:55 CST; 23s ago Main PID: 1900 (chronyd)   CGroup: /system.slice/chronyd.service           └─1900 /usr/sbin/chronyd#看到running则表示成功

2、部署HBase（master节点）

先使用xftp上传hbase软件包至/opt/software

# 解压[root@master ~]# tar xf /opt/software/hbase-1.2.1-bin.tar.gz -C /usr/local/src/[root@master ~]# cd /usr/local/src/[root@master src]# mv hbase-1.2.1 hbase[root@master src]# lshadoop  hbase  hive  jdk# 配置hbase环境变量[root@master src]# vi /etc/profile.d/hbase.shexport HBASE_HOME=/usr/local/src/hbaseexport PATH=${HBASE_HOME}/bin:$PATH#保存[root@master src]# source /etc/profile.d/hbase.sh[root@master src]# echo $PATH/usr/local/src/hbase/bin:/usr/local/src/jdk/bin:/usr/local/src/hadoop/bin:/usr/local/src/hadoop/sbin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/usr/local/src/hive/bin:/root/bin#看到环境变量中有hbase的路径则表示成功

3、配置HBase（master节点）

# 配置HBase[root@master src]# cd /usr/local/src/hbase/conf/[root@master conf]# vi hbase-env.shexport JAVA_HOME=/usr/local/src/jdkexport HBASE_MANAGES_ZK=trueexport HBASE_CLASSPATH=/usr/local/src/hadoop/etc/hadoop/#保存[root@master conf]# vi hbase-site.xml<configuration>        <property>                <name>hbase.rootdir</name>                <value>hdfs://master:9000/hbase</value>        </property>        <property>                <name>hbase.master.info.port</name>                <value>60010</value>        </property>        <property>                <name>hbase.zookeeper.property.clientPort</name>                <value>2181</value>        </property>        <property>                <name>zookeeper.session.timeout</name>                <value>10000</value>        </property>        <property>                <name>hbase.zookeeper.quorum</name>                <value>master,slave1,slave2</value>        </property>        <property>                <name>hbase.tmp.dir</name>                <value>/usr/local/src/hbase/tmp</value>                </property>        <property>                <name>hbase.cluster.distributed</name>                <value>true</value>        </property></configuration>#保存[root@master conf]# vi regionservers192.168.100.20192.168.100.30#保存[root@master conf]# mkdir -p /usr/local/src/hbase/tmp

4、拷贝文件到slave节点

# master节点[root@master conf]# scp -r /usr/local/src/hbase slave1:/usr/local/src/[root@master conf]# scp -r /usr/local/src/hbase slave2:/usr/local/src/[root@master conf]# scp /etc/profile.d/hbase.sh slave1:/etc/profile.d/[root@master conf]# scp /etc/profile.d/hbase.sh slave2:/etc/profile.d/

5、修改权限，切换用户（所有节点）

# master节点[root@master conf]# chown -R hadoop.hadoop /usr/local/src[root@master conf]# ll /usr/local/src/total 0drwxr-xr-x. 12 hadoop hadoop 183 Apr  9 09:57 hadoopdrwxr-xr-x   8 hadoop hadoop 171 Apr 15 15:59 hbasedrwxr-xr-x. 11 hadoop hadoop 215 Apr  9 10:40 hivedrwxr-xr-x.  8 hadoop hadoop 255 Sep 14  2017 jdk[root@master conf]# su - hadoop# slave1节点[root@slave1 ~]# chown -R hadoop.hadoop /usr/local/src[root@slave1 ~]# ll /usr/local/src/total 0drwxr-xr-x. 12 hadoop hadoop 183 Apr  9 09:59 hadoopdrwxr-xr-x   8 hadoop hadoop 171 Apr 15 16:19 hbasedrwxr-xr-x.  8 hadoop hadoop 255 Apr  8 17:24 jdk[root@slave1 ~]# su - hadoop# slave2节点[root@slave2 ~]# ll /usr/local/src/总用量 0drwxr-xr-x. 12 hadoop hadoop 183 4月   9 09:59 hadoopdrwxr-xr-x   8 hadoop hadoop 171 4月  15 16:19 hbasedrwxr-xr-x.  8 hadoop hadoop 255 4月   8 17:24 jdk[root@slave2 ~]# su - hadoop

6、启动hadoop（master节点）

#在master上启动分布式hadoop集群[hadoop@master ~]$ start-all.sh[hadoop@master ~]$ jps3210 Jps2571 NameNode2780 SecondaryNameNode2943 ResourceManager# 查看slave1节点[hadoop@slave1 ~]$ jps2512 DataNode2756 Jps2623 NodeManager# 查看slave2节点[hadoop@slave2 ~]$ jps3379 Jps3239 NodeManager3135 DataNode#确保master上有NameNode、SecondaryNameNode、 ResourceManager进程, slave节点上要有DataNode、NodeManager进程

7、启动hbase（master节点）

[hadoop@master ~]$ start-hbase.sh[hadoop@master ~]$ jps3569 HMaster2571 NameNode2780 SecondaryNameNode3692 Jps2943 ResourceManager3471 HQuorumPeer# 查看slave1节点[hadoop@slave1 ~]$ jps2512 DataNode2818 HQuorumPeer2933 HRegionServer3094 Jps2623 NodeManager# 查看slave2节点[hadoop@slave2 ~]$ jps3239 NodeManager3705 Jps3546 HRegionServer3437 HQuorumPeer3135 DataNode#确保master上有HQuorumPeer、HMaster进程，slave节点上要有HQuorumPeer、HRegionServer进程

8、查看浏览器页面

在windows主机上执行:
在C:\windows\system32\drivers\etc\下面把hosts文件拖到桌面上，然后编辑它加入master的主机名与IP地址的映射关系，在浏览器上输入http://master:60010访问hbase的web界面

192.168.100.10  master  master.example.com192.168.100.20  slave1  slave1.example.com192.168.100.30  slave2  slave2.example.com

9、hbase语法应用（master节点）

[hadoop@master ~]$ hbase shellSLF4J: Class path contains multiple SLF4J bindings.SLF4J: Found binding in [jar:file:/usr/local/src/hbase/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]SLF4J: Found binding in [jar:file:/usr/local/src/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]HBase Shell; enter 'help<RETURN>' for list of supported commands.Type "exit<RETURN>" to leave the HBase ShellVersion 1.2.1, r8d8a7107dc4ccbf36a92f64675dc60392f85c015, Wed Mar 30 11:19:21 CDT 2016# 创建一张名为scores的表，表内有两个列簇hbase(main):001:0> create 'scores','grade','course'0 row(s) in 1.3950 seconds=> Hbase::Table - scores# 查看hbase状态hbase(main):002:0> status1 active master, 0 backup masters, 2 servers, 0 dead, 1.5000 average load# 查看数据库版本hbase(main):003:0> version1.2.1, r8d8a7107dc4ccbf36a92f64675dc60392f85c015, Wed Mar 30 11:19:21 CDT 2016# 查看表hbase(main):004:0> listTABLE                                                                                            scores                                                                                           1 row(s) in 0.0150 seconds=> ["scores"]# 插入记录hbase(main):005:0> put 'scores','jie','grade:','146cloud'0 row(s) in 0.1000 secondshbase(main):006:0> put 'scores','jie','course:math','86'0 row(s) in 0.0160 secondshbase(main):007:0> put 'scores','jie','course:cloud','92'0 row(s) in 0.0120 secondshbase(main):008:0> put 'scores','shi','grade:','133soft'0 row(s) in 0.0120 secondshbase(main):009:0> put 'scores','shi','course:math','87'0 row(s) in 0.0080 secondshbase(main):010:0> put 'scores','shi','course:cloud','96'0 row(s) in 0.0080 seconds# 读取的记录hbase(main):011:0> get 'scores','jie'COLUMN                    CELL                                                                    course:cloud             timestamp=1650090459825, value=92                                       course:math              timestamp=1650090453152, value=86                                       grade:                   timestamp=1650090446128, value=146cloud                                3 row(s) in 0.0190 secondshbase(main):012:0> get 'scores','jie','grade'COLUMN                    CELL                                                                    grade:                   timestamp=1650090446128, value=146cloud                                1 row(s) in 0.0080 seconds# 查看整个表记录hbase(main):013:0> scan 'scores'ROW                       COLUMN+CELL                                                             jie                      column=course:cloud, timestamp=1650090459825, value=92                  jie                      column=course:math, timestamp=1650090453152, value=86                   jie                      column=grade:, timestamp=1650090446128, value=146cloud                  shi                      column=course:cloud, timestamp=1650090479946, value=96                  shi                      column=course:math, timestamp=1650090475684, value=87                   shi                      column=grade:, timestamp=1650090464698, value=133soft                  2 row(s) in 0.0200 seconds# 按例查看表记录hbase(main):014:0> scan 'scores',{COLUMNS=>'course'}ROW                       COLUMN+CELL                                                             jie                      column=course:cloud, timestamp=1650090459825, value=92                  jie                      column=course:math, timestamp=1650090453152, value=86                   shi                      column=course:cloud, timestamp=1650090479946, value=96                  shi                      column=course:math, timestamp=1650090475684, value=87                  2 row(s) in 0.0140 seconds# 删除指定记录hbase(main):015:0> delete 'scores','shi','grade'0 row(s) in 0.0190 seconds# 增加新的名为age的列簇hbase(main):016:0> alter 'scores',NAME=>'age'Updating all regions with the new schema...1/1 regions updated.Done.0 row(s) in 1.9080 seconds# 查看表结构hbase(main):017:0> describe 'scores'Table scores is ENABLED                                                                          scores                                                                                           COLUMN FAMILIES DESCRIPTION                                                                      {NAME => 'age', BLOOMFILTER => 'ROW', VERSIONS => '1', IN_MEMORY => 'false', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', COMPRESSION => 'NONE', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}                     {NAME => 'course', BLOOMFILTER => 'ROW', VERSIONS => '1', IN_MEMORY => 'false', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', COMPRESSION => 'NONE', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}                  {NAME => 'grade', BLOOMFILTER => 'ROW', VERSIONS => '1', IN_MEMORY => 'false', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', COMPRESSION => 'NONE', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}                   3 row(s) in 0.0230 seconds# 删除名为age的列簇hbase(main):018:0> alter 'scores',NAME=>'age',METHOD=>'delete'Updating all regions with the new schema...1/1 regions updated.Done.0 row(s) in 1.8940 seconds# 删除表hbase(main):019:0> disable 'scores'0 row(s) in 2.2400 seconds# 退出hbasehbase(main):020:0> drop 'scores'0 row(s) in 1.2450 secondshbase(main):021:0> listTABLE                                                                                            0 row(s) in 0.0040 seconds=> []# 退出hbasehbase(main):022:0> quit

10、关闭hbase（master节点）

# 关闭hbase[hadoop@master ~]$ stop-hbase.shstopping hbase...............[hadoop@master ~]$ jps44952 NameNode45306 ResourceManager46988 Jps45150 SecondaryNameNode# 关闭hadoop[hadoop@master ~]$ stop-all.shThis script is Deprecated. Instead use stop-dfs.sh and stop-yarn.shStopping namenodes on [master]…………[hadoop@master ~]$ jps47438 Jps

声明：未经许可，不得转载
原文地址：https://www.cnblogs.com/wzgwzg/p/16152890.html