Hive 설치(2.3.3) on CentOS with Hadoop 2.9.0 (MariaDB Metastore)

===========MariaDB 설치==============
vi /etc/yum.repos.d/MariaDB.repo

아래 내용 입력
[mariadb]
name = MariaDB
baseurl = http://yum.mariadb.org/10.1/centos7-amd64
gpgkey=https://yum.mariadb.org/RPM-GPG-KEY-MariaDB
gpgcheck=1

yum으로 MariaDB 검색 및 설치
yum list |grep -i maria

yum install MariaDB-server.x86_64
============설정=============
실행
systemctl start mariadb

root 비밀번호 설정/usr/bin/mysqladmin -u root password '비번'

접속

mysql -u root -p

hive user 생성
CREATE USER 'hive'@'%' IDENTIFIED BY '비번';
GRANT ALL ON *.* TO 'hive'@LOCALHOST IDENTIFIED BY '비번';
FLUSH PRIVILEGES;

exit

hive 유저로 접속

mysql- u hive -p

hive database 생성create database hive;


============하이브 2.3.3 다운로드=============
웹주소

https://hive.apache.org/

터미널에서 다운로드

su -  root

cd /home

wget http://mirror.navercorp.com/apache/hive/stable-2/apache-hive-2.3.3-bin.tar.gz

tar zxvf ./apa*

cd ./apache-hive-2.3.3-bin

mv ./* /home/hive

chown -R hadoop:hadoop ./hive

============환경파일 설정============

vi /etc/profile

export HIVE_HOME=/home/hive

export PATH=$PATH:$HIVE_HOME/bin

============jdbc mariadb 커넥터 다운로드============

웹주소 : https://downloads.mariadb.org/connector-java/2.2.3/

터미널 다운로드

su -hadoop

cd /home/hive/lib

wget https://downloads.mariadb.com/Connectors/java/connector-java-2.2.3/mariadb-java-client-2.2.3.jar

===========하이브설정==============

cd /home/hive/conf

cp -rp ./hive-env.sh.template ./hive-env.sh

vi hive-env.sh

아래내용 추가

export HADOOP_HOME=/home/hadoop

vi hive-site.xml

아래 내용 추가 (비번은 MariaDB에 hive user 비번)
<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
    <property>
        <name>hive.metastore.local</name>
        <value>false</value>
    </property>
    <property>
        <name>javax.jdo.option.ConnectionURL</name>
        <value>jdbc:mariadb://localhost:3306/hive?createDatabaseIfNotExist=true</value>
    </property>
    <property>
        <name>javax.jdo.option.ConnectionDriverName</name>
        <value>org.mariadb.jdbc.Driver</value>
    </property>
    <property>
        <name>javax.jdo.option.ConnectionUserName</name>
        <value>hive</value>
    </property>
    <property>
        <name>javax.jdo.option.ConnectionPassword</name>
        <value>비번</value>  
    </property>
</configuration>


=========MariaDB 연결 초기화 (mysql로 써야함..)============

bin/schematool -initSchema -dbType mysql

============테스트를 위한 공간 마련==========


hdfs dfs -mkdir /tmp
hdfs dfs -mkdir -p /user/hive/warehouse
hdfs dfs -chmod g+w /user/hive/warehousehdfs dfs -ls -R /

==========기동========

nohup ./hive --service hiveserver2 > /dev/null 2> /dev/null &

#nohup ./hive --service hwi > /dev/null 2> /dev/null &