greenplum 5.7 + centos 7.4 + make

os: centos 7.4gp: gpdb-5.7.0greenplum 简称gp，是由postgresql演变而来，感兴趣的哥们可以baidu一下三台机器node1 为master hostnode2、node3为segment hostos设置# cat /etc/centos-releaseCentOS Linux release 7.4.1708 (...

数据库人生

3314人浏览 · 2018-04-17 18:03:36

数据库人生 · 2018-04-17 18:03:36 发布

os: centos 7.4
db: greenplum-5.7.0

greenplum 简称gp，是对 postgresql 做了很多变更，是典型的mpp架构。

ip 规划如下：

192.168.0.99    mas
192.168.0.100   sla

192.168.0.101   seg1
192.168.0.102   seg2

os设置

参考<<centos 7.x 安装 greenplum 的优化设置>>

源码编译安装

github 上社区版 greenplum 页面
https://github.com/greenplum-db/gpdb/releases
https://github.com/greenplum-db/gpdb/tree/5.7.0

安装 gporca

gporca是 greenplum 新一代的优化器，在性能上有很大提升
legacy是早期针对单节点 greenplum 而构建的，主要应用于OLTP场景，greenplum在不安装orca的情况下使用的是legacy优化器。
为什么要有两个优化器，其实都是有历史原因的，现在的greenplum使用MPP，主要应用场景变为OLAP场景，legacy对此虽然进行了修改，但是从架构设计上，使得其维护和添加新的功能越来越困难，所以有了GPORCA优化器。

greenplum 5.7 的 gporca 安装可以参考如下:
https://github.com/greenplum-db/gpdb/tree/5.7.0#build-the-optimizer

gporca 需要在每个节点都需要安装,后面使用批量方式安装 greenplum 软件是仍需额外安装 gporca.

1、自动安装 gporca（所有节点）
Automatically with Conan dependency manager
参考
https://github.com/greenplum-db/gpdb/tree/5.7.0#automatically-with-conan-dependency-manager

# su - gpadmin
$ cd /tmp
$ unzip ./gpdb-5.7.0.zip
$ cd gpdb-5.7.0/depends
$ ./configure

执行 configure 时会提示如下错误

configure: error: CMake 3.1 or later is needed to build ORCA
configure: error: Library xerces-c 3.1.x or later is required to build ORCA

需要手动安装一些依赖
安装 cmake3 （所有节点）

# yum install -y cmake3

# which cmake cmake3
/usr/bin/cmake
/usr/bin/cmake3

# mv /usr/bin/cmake /usr/bin/cmake.bak;
ln -s /usr/bin/cmake3 /usr/bin/cmake;
ls -l /usr/bin/cmake;

lrwxrwxrwx 1 root root 15 Aug 30 08:33 /usr/bin/cmake -> /usr/bin/cmake3

安装gp-xerces （所有节点）
参考
https://github.com/greenplum-db/gp-xerces
https://github.com/greenplum-db/gp-xerces.git

# su - gpadmin
$ cd /tmp
$ git clone https://github.com/greenplum-db/gp-xerces.git
$ cd gp-xerces
$ mkdir build
$ cd build
$ ../configure
$ make

$ exit
# cd /tmp/gp-xerces/build
# make install

再次 gporca （所有节点）

# su - gpadmin
$ echo 'source scl_source enable devtoolset-6' >> ~/.bashrc
$ cd /tmp
$ rz gpdb-5.7.0.zip
$ unzip ./gpdb-5.7.0.zip
$ cd gpdb-5.7.0/depends
$ ./configure
$ make
===================================================================
Orca can now be installed on the local system using "make install"
and be used as any normal system library

If you'd rather compile GPDB using ORCA in it's current location and then
install ORCA into the gpdb installation location then first run the top
level configure as follows:
LD_LIBRARY_PATH=/tmp/gpdb-5.7.0/depends/build/lib ./configure \ 
    --with-libraries=/tmp/gpdb-5.7.0/depends/build/lib \ 
    --with-includes=/tmp/gpdb-5.7.0/depends/build/include 

Then run "make".
Then run "LD_LIBRARY_PATH=/tmp/gpdb-5.7.0/depends/build/lib make install"

These steps should work on both MacOS and Linux

$ exit
# cd /tmp/gpdb-5.7.0/depends
# make install_local
===================================================================
Orca can now be installed on the local system using "make install"
and be used as any normal system library

If you'd rather compile GPDB using ORCA in it's current location and then
install ORCA into the gpdb installation location then first run the top
level configure as follows:
LD_LIBRARY_PATH=/tmp/gpdb-5.7.0/depends/build/lib ./configure \ 
    --with-libraries=/tmp/gpdb-5.7.0/depends/build/lib \ 
    --with-includes=/tmp/gpdb-5.7.0/depends/build/include 

Then run "make".
Then run "LD_LIBRARY_PATH=/tmp/gpdb-5.7.0/depends/build/lib make install"

These steps should work on both MacOS and Linux
/bin/mkdir -p /usr/local
cp -R build/* /usr/local

最后两条命令就是拷贝到系统路径里

# /bin/mkdir -p /usr/local ;
\cp -Rf build/* /usr/local ;

重装gporca前清空

# rm -rf /usr/local/include/naucrates
rm -rf /usr/local/include/gpdbcost
rm -rf /usr/local/include/gpopt
rm -rf /usr/local/include/gpos

rm -rf /usr/local/lib/libnaucrates.so*
rm -rf /usr/local/lib/libgpdbcost.so*
rm -rf /usr/local/lib/libgpopt.so*
rm -rf /usr/local/lib/libgpos.so*

2、手动安装 gporca （所有节点）
参考
https://github.com/greenplum-db/gpdb/tree/5.7.0#manually

安装 cmake3 （所有节点），如果已经 yum install cmake3,则跳过这一步
参考
https://cmake.org/download/

# yum install -y cmake3

# which cmake cmake3
/usr/bin/cmake
/usr/bin/cmake3

# mv /usr/bin/cmake /usr/bin/cmake.bak
# ln -s /usr/bin/cmake3 /usr/bin/cmake
# ls -l /usr/bin/cmake
lrwxrwxrwx 1 root root 15 Aug 30 08:33 /usr/bin/cmake -> /usr/bin/cmake3

安装gp-xerces （所有节点）
参考
https://github.com/greenplum-db/gp-xerces
https://github.com/greenplum-db/gp-xerces.git

# su - gpadmin
$ git clone https://github.com/greenplum-db/gp-xerces.git
$ cd gp-xerces
$ mkdir build
$ cd build
$ ../configure
$ make

$ exit
# cd /home/gpadmin/gp-xerces/build
# make install

安装re2c （所有节点）
参考
http://re2c.org/install/install.html
https://github.com/skvadrik/re2c
https://github.com/skvadrik/re2c.git

# cd /root
# git clone https://github.com/skvadrik/re2c.git
# cd ./re2c/re2c
# ./autogen.sh
# ./configure
# make
# make install

安装ninja （所有节点）
参考
https://ninja-build.org/
https://github.com/ninja-build/ninja
https://github.com/ninja-build/ninja.git

# cd /root
# git clone https://github.com/ninja-build/ninja.git
# cd ninja
# ./configure.py --bootstrap
# ln -s /root/ninja/ninja /usr/bin/ninja

安装 ORCA （所有节点）
the query optimizer:

# cd /root
# git clone https://github.com/greenplum-db/gporca.git
# cd gporca
# cmake -GNinja -H. -Bbuild
# ninja install -C build

--
--
-- Installing: /usr/local/include/gpopt/version.h

待安装完成后，进入/gporca/build目录，执行ctest命令进行检查,确保100% tests passed
# cd /root/gporca/build/
# /root/cmake/bin/ctest
100% tests passed, 0 tests failed out of 157

Total Test time (real) = 194.05 sec

后来在 gpdb configure 的时候报了如下错误

checking Checking ORCA version... configure: error: Your ORCA version is expected to be 2.55.XXX

通常情况下这个错误就是 orca的版本太低,获取更高版本就不会再报错.

Using conan dependency manager

cd gpdb/depends
conan remote add conan-gpdb https://api.bintray.com/conan/greenplum-db/gpdb-oss
conan install --build
- This command will fetch the orca and xerces artifacts from bintray repository, build and install them.
- The header and library files will be copied to the location specified by imports section of conanfile.txt in depends directory.
  In case, the files should be copied elsewhere, please change the location.

第一个节点 mas 上构建 greenplum

参考:
https://github.com/greenplum-db/gpdb/tree/5.7.0#build-the-database

# su - gpadmin
$ cd /tmp
$ unzip ./gpdb-5.7.0.zip
finishing deferred symbolic links:
  gpdb-5.7.0/concourse/tasks/compile_gpdb_open_source.yml -> compile_gpdb_open_source_centos.yml

$ cd /tmp/gpdb-5.7.0

$ ./configure --prefix=/usr/local/greenplum-db --with-perl --with-python --with-libxml --with-gssapi \
--enable-orca --enable-mapreduce --enable-gpperfmon --enable-pxf \
--with-includes=/usr/local/include/ --with-libraries=/usr/local/lib/

configure 的选项科技参考<<greeenplum 软件安装时的 configure,make>>

如果没有编译gporca优化器，则需要添加 --disable-orca 参数，如下

$ --disable-orca

中间有如下报错

./configure: line 11922: #include: command not found

需要多次make时，可以执行 autoreconf

$ cd /tmp/gpdb-5.7.0
$ autoreconf -ivf

$ make distclean

make , make install

$ make -j4
$ make install

$ cd /usr/local/greenplum-db
$ ls -l
total 24
drwxrwxr-x 7 gpadmin gpadmin 4096 Apr 17 13:54 bin
drwxrwxr-x 3 gpadmin gpadmin   24 Apr 17 13:54 doc
drwxrwxr-x 3 gpadmin gpadmin   22 Apr 17 13:54 docs
drwxrwxr-x 2 gpadmin gpadmin   25 Apr 17 13:54 etc
-rw-rw-r-- 1 gpadmin gpadmin  698 Apr 17 13:54 greenplum_path.sh
drwxrwxr-x 4 gpadmin gpadmin 4096 Apr 17 13:54 include
drwxrwxr-x 5 gpadmin gpadmin 4096 Apr 17 13:54 lib
drwxrwxr-x 2 gpadmin gpadmin 4096 Apr 17 13:54 sbin
drwxrwxr-x 4 gpadmin gpadmin   41 Apr 17 13:54 share

查看 /usr/local/greenplum-db/greenplum_path.sh

$ cat /usr/local/greenplum-db/greenplum_path.sh 
GPHOME=/usr/local/greenplum-db

# Replace with symlink path if it is present and correct
if [ -h ${GPHOME}/../greenplum-db ]; then
    GPHOME_BY_SYMLINK=`(cd ${GPHOME}/../greenplum-db/ && pwd -P)`
    if [ x"${GPHOME_BY_SYMLINK}" = x"${GPHOME}" ]; then
        GPHOME=`(cd ${GPHOME}/../greenplum-db/ && pwd -L)`/.
    fi
    unset GPHOME_BY_SYMLINK
fi
#setup PYTHONHOME
if [ -x $GPHOME/ext/python/bin/python ]; then
    PYTHONHOME="$GPHOME/ext/python"
fi
PYTHONPATH=$GPHOME/lib/python
PATH=$GPHOME/bin:$PATH
LD_LIBRARY_PATH=$GPHOME/lib:${LD_LIBRARY_PATH-}
export LD_LIBRARY_PATH
OPENSSL_CONF=$GPHOME/etc/openssl.cnf
export GPHOME
export PATH
export PYTHONPATH
export PYTHONHOME
export OPENSSL_CONF

设置 mas 用户环境变量

$ vi /home/gpadmin/.bashrc
source /usr/local/greenplum-db/greenplum_path.sh

$ vi /home/gpadmin/.bash_profile
source /usr/local/greenplum-db/greenplum_path.sh

设置完后记得 source 一下使其立即生效。

$ source /home/gpadmin/.bashrc
$ source /home/gpadmin/.bash_profile
$ echo $PATH

至此 mas 节点上的 greenplum 及 gporca 已经安装完毕。

余下节点 sla,seg1,seg2 安装 greenplum

至此,仅有 mas 节点安装了 greenplum 软件,其余节点没有 greenplum 软件，怎么办了？
greenplum 集群正常运行的结果是所有节点上都必须安装 greenplum 软件.

1）将 mas 节点 greenplum 软件复制到剩余所有节点
这种情况，其余节点仍需安装额外安装 gporca

2）剩余每个节点上都重新安装 gporca,编译 greenplum。

本次采用的是第一种方法。
在 mas 上 touch all_host all_segment

# su - gpadmin
$ cd $GPHOME
$ echo "mas" >> all_host ;
echo "sla" >> all_host ;
echo "seg1" >> all_host ;
echo "seg2" >> all_host ;

$ echo "seg1" >> all_segment ;
echo "seg2" >> all_segment ;

在mas上建立节点信任(os设置时已经创建的,会快速显示ok)
因为greenplum安装在 /usr/local下,后面需要使用 root 权限复制软件
需要事先配置下 root 的多机信任(事实上配置了集群的 root 之间 ssh信任，gpadmin 之间 ssh信任)

# source /usr/local/greenplum-db/greenplum_path.sh
# $GPHOME/bin/gpssh-exkeys -f $GPHOME/all_host

# su - gpadmin
$ source /usr/local/greenplum-db/greenplum_path.sh
$ $GPHOME/bin/gpssh-exkeys -f $GPHOME/all_host

在mas上操作批量复制到其余节点
使用 root 批量安装剩余节点的 greenplum 软件
这里由于会在 /usr/local 下生成 greenplum-db.tar 文件,gpadmin执行会报错,需要用root权限.
all_segment 应该包含余下所有节点(如果master节点有slave节点的话,也应该包含,后面再在 all_segment 移除slave ,确保只有 segment 节点)

# source /usr/local/greenplum-db/greenplum_path.sh
# $GPHOME/bin/gpseginstall -f $GPHOME/all_segment -u gpadmin -p rootroot

20190830:14:44:29:015352 gpseginstall:mas:root-[INFO]:-Installation Info:
link_name None
binary_path /usr/local/greenplum-db
binary_dir_location /usr/local
binary_dir_name greenplum-db
20190830:14:44:29:015352 gpseginstall:mas:root-[INFO]:-check cluster password access
20190830:14:44:29:015352 gpseginstall:mas:root-[INFO]:-de-duplicate hostnames
20190830:14:44:30:015352 gpseginstall:mas:root-[INFO]:-master hostname: mas
20190830:14:44:30:015352 gpseginstall:mas:root-[INFO]:-check for user gpadmin on cluster
20190830:14:44:30:015352 gpseginstall:mas:root-[INFO]:-add user gpadmin on master
20190830:14:44:31:015352 gpseginstall:mas:root-[INFO]:-add user gpadmin on cluster
20190830:14:44:31:015352 gpseginstall:mas:root-[INFO]:-chown -R gpadmin:gpadmin /usr/local/greenplum-db
20190830:14:44:31:015352 gpseginstall:mas:root-[INFO]:-rm -f /usr/local/greenplum-db.tar; rm -f /usr/local/greenplum-db.tar.gz
20190830:14:44:31:015352 gpseginstall:mas:root-[INFO]:-cd /usr/local; tar cf greenplum-db.tar greenplum-db
20190830:14:44:31:015352 gpseginstall:mas:root-[INFO]:-gzip /usr/local/greenplum-db.tar

20190830:14:44:34:015352 gpseginstall:mas:root-[INFO]:-remote command: mkdir -p /usr/local
20190830:14:44:34:015352 gpseginstall:mas:root-[INFO]:-remote command: rm -rf /usr/local/greenplum-db
20190830:14:44:34:015352 gpseginstall:mas:root-[INFO]:-scp software to remote location
20190830:14:44:36:015352 gpseginstall:mas:root-[INFO]:-remote command: gzip -f -d /usr/local/greenplum-db.tar.gz
20190830:14:44:37:015352 gpseginstall:mas:root-[INFO]:-md5 check on remote location
20190830:14:44:37:015352 gpseginstall:mas:root-[INFO]:-remote command: cd /usr/local; tar xf greenplum-db.tar
20190830:14:44:37:015352 gpseginstall:mas:root-[INFO]:-remote command: rm -f /usr/local/greenplum-db.tar
20190830:14:44:38:015352 gpseginstall:mas:root-[INFO]:-remote command: chown -R gpadmin:gpadmin /usr/local/greenplum-db

20190830:14:44:38:015352 gpseginstall:mas:root-[INFO]:-rm -f /usr/local/greenplum-db.tar.gz
20190830:14:44:38:015352 gpseginstall:mas:root-[INFO]:-Changing system passwords ...
20190830:14:44:39:015352 gpseginstall:mas:root-[INFO]:-exchange ssh keys for user root
20190830:14:44:42:015352 gpseginstall:mas:root-[INFO]:-exchange ssh keys for user gpadmin
20190830:14:44:45:015352 gpseginstall:mas:root-[INFO]:-/usr/local/greenplum-db/sbin/gpfixuserlimts -f /etc/security/limits.conf -u gpadmin
20190830:14:44:45:015352 gpseginstall:mas:root-[INFO]:-remote command: . /usr/local/greenplum-db/greenplum_path.sh; /usr/local/greenplum-db/sbin/gpfixuserlimts -f /etc/security/limits.conf -u gpadmin
20190830:14:44:46:015352 gpseginstall:mas:root-[INFO]:-version string on master: gpssh version 5.0.0 build dev
20190830:14:44:46:015352 gpseginstall:mas:root-[INFO]:-remote command: . /usr/local/greenplum-db/greenplum_path.sh; /usr/local/greenplum-db/bin/gpssh --version
20190830:14:44:47:015352 gpseginstall:mas:root-[INFO]:-SUCCESS -- Requested commands completed

在mas上检查批量安装情况

# source /usr/local/greenplum-db/greenplum_path.sh
# $GPHOME/bin/gpssh -f $GPHOME/all_segment -e ls -l $GPHOME
# $GPHOME/bin/gpssh -f $GPHOME/all_host -e ls -l $GPHOME

在 mas、seg1、seg2 上分别检查数据目录

# ls -l / |grep -i u01 ;
ls -l /u01/ ;

在 mas、seg1、seg2 上分别设置 gpadmin 用户环境变量

$ vi /home/gpadmin/.bashrc
source /usr/local/greenplum-db/greenplum_path.sh

$ vi /home/gpadmin/.bash_profile
source /usr/local/greenplum-db/greenplum_path.sh

时间同步,各个节点要和 master 的时间保持一致(集群的时间要保持一致)
使用 ntp 和标准时间、内部时间同步

# yum -y install ntp;
systemctl start ntpd;
systemctl enable ntpd;

或者使用 gpssh 来相互同步时钟

# $GPHOME/bin/gpssh -f $GPHOME/all_host -v date
# $GPHOME/bin/gpssh -f $GPHOME/all_host -v ntpd

运行 gpcheck 来检查刚配的所有机器的操作系统情况

# $GPHOME/bin/gpcheck -f $GPHOME/all_host

运行 gpcheckperf 来进行硬件性能效验

# $GPHOME/bin/gpcheckperf -f $GPHOME/all_host -d /tmp -d /home/gpadmin/ -v -r ds

运行 gpchecknet 来进行网络性能效验

# $GPHOME/bin/gpchecknet -f $GPHOME/all_host -d /tmp
# $GPHOME/bin/gpchecknet -f $GPHOME/all_host -r N -d /tmp

初始化集群

gp初始化文件，使用 gpadmin 用户操作

$ cp /usr/local/greenplum-db/docs/cli_help/gpconfigs/gpinitsystem_config /usr/local/greenplum-db/
$ chmod 775 ./gpinitsystem_config
$ vi /usr/local/greenplum-db/gpinitsystem_config
$ egrep -v "(^$|^#)" ./gpinitsystem_config

ARRAY_NAME="Greenplum Data Platform"
SEG_PREFIX=gpseg
PORT_BASE=40000
MASTER_HOSTNAME=mas
MASTER_DIRECTORY=/u01/greenplum-data
MASTER_PORT=5432
TRUSTED_SHELL=ssh
CHECK_POINT_SEGMENTS=20
ENCODING=UNICODE
MIRROR_PORT_BASE=50000
REPLICATION_PORT_BASE=41000
MIRROR_REPLICATION_PORT_BASE=51000
DATABASE_NAME=peiybdb
MACHINE_LIST_FILE=/usr/local/greenplum-db/all_segment

简单说明下
ARRAY_NAME：设置阵列名称，默认Greenplum Data Platform。
SEG_PREFIX：设置segment的前缀，默认gpseg。
PORT_BASE：设置segment的起始端口，会从此端口往上增加，默认从40000开始。
DATA_DIRECTORY：设置segment primary的数据存储目录，有几个segment节点就需要设置几个数据存储目录。
MASTER_HOSTNAME：设置master的主机名。
MASTER_DIRECTORY：设置master的存储目录。
MASTER_PORT：设置master的端口，默认5432。
TRUSTED_SHELL：设置节点之间的信任方式，默认SSH。
CHECK_POINT_SEGMENTS：预写日志文件（WAL）数量，默认为8，这意味着为主机上的每个Segment或Master实例分配1088MB的WAL空间。
ENCODING=UNICODE：设置初始字符集，默认UNICODE（UTF-8）。
MACHINE_LIST_FILE：仅包含segment主机地址

注意，其中所有需要的目录都是在创建数据存储区域时做好的。

尤其需要注意的是 MACHINE_LIST_FILE，指的是 仅包含segment主机地址

gp初始化工具

$ cd $GPHOME/bin
$ gpinitsystem -c /usr/local/greenplum-db/gpinitsystem_config -s sla

20180417:17:41:25:005291 gpinitsystem:mas:gpadmin-[INFO]:-Checking configuration parameters, please wait...
20180417:17:41:25:005291 gpinitsystem:mas:gpadmin-[INFO]:-Reading Greenplum configuration file /usr/local/greenplum-db/gpinitsystem_config
20180417:17:41:25:005291 gpinitsystem:mas:gpadmin-[INFO]:-Locale has not been set in /usr/local/greenplum-db/gpinitsystem_config, will set to default value
20180417:17:41:25:005291 gpinitsystem:mas:gpadmin-[INFO]:-Locale set to en_US.utf8
20180417:17:41:25:005291 gpinitsystem:mas:gpadmin-[INFO]:-MASTER_MAX_CONNECT not set, will set to default value 250
20180417:17:41:25:005291 gpinitsystem:mas:gpadmin-[INFO]:-Checking configuration parameters, Completed
20180417:17:41:25:005291 gpinitsystem:mas:gpadmin-[INFO]:-Commencing multi-home checks, please wait...
...
20180417:17:41:27:005291 gpinitsystem:mas:gpadmin-[INFO]:-Configuring build for standard array
20180417:17:41:27:005291 gpinitsystem:mas:gpadmin-[INFO]:-Commencing multi-home checks, Completed
20180417:17:41:27:005291 gpinitsystem:mas:gpadmin-[INFO]:-Building primary segment instance array, please wait...
...
20180417:17:41:29:005291 gpinitsystem:mas:gpadmin-[INFO]:-Checking Master host
20180417:17:41:29:005291 gpinitsystem:mas:gpadmin-[INFO]:-Checking new segment hosts, please wait...
...
20180417:17:41:39:005291 gpinitsystem:mas:gpadmin-[INFO]:-Checking new segment hosts, Completed

20180417:17:41:39:005291 gpinitsystem:mas:gpadmin-[INFO]:-Greenplum Database Creation Parameters
20180417:17:41:39:005291 gpinitsystem:mas:gpadmin-[INFO]:---------------------------------------
20180417:17:41:39:005291 gpinitsystem:mas:gpadmin-[INFO]:-Master Configuration
20180417:17:41:39:005291 gpinitsystem:mas:gpadmin-[INFO]:---------------------------------------
20180417:17:41:39:005291 gpinitsystem:mas:gpadmin-[INFO]:-Master instance name       = test Greenplum Data Platform
20180417:17:41:39:005291 gpinitsystem:mas:gpadmin-[INFO]:-Master hostname            = mas
20180417:17:41:39:005291 gpinitsystem:mas:gpadmin-[INFO]:-Master port                = 5432
20180417:17:41:39:005291 gpinitsystem:mas:gpadmin-[INFO]:-Master instance dir        = /u01/greenplum-data/gpseg-1
20180417:17:41:39:005291 gpinitsystem:mas:gpadmin-[INFO]:-Master LOCALE              = en_US.utf8
20180417:17:41:39:005291 gpinitsystem:mas:gpadmin-[INFO]:-Greenplum segment prefix   = gpseg
20180417:17:41:39:005291 gpinitsystem:mas:gpadmin-[INFO]:-Master Database            = peiybdb
20180417:17:41:39:005291 gpinitsystem:mas:gpadmin-[INFO]:-Master connections         = 250
20180417:17:41:39:005291 gpinitsystem:mas:gpadmin-[INFO]:-Master buffers             = 128000kB
20180417:17:41:39:005291 gpinitsystem:mas:gpadmin-[INFO]:-Segment connections        = 750
20180417:17:41:39:005291 gpinitsystem:mas:gpadmin-[INFO]:-Segment buffers            = 128000kB
20180417:17:41:39:005291 gpinitsystem:mas:gpadmin-[INFO]:-Checkpoint segments        = 8
20180417:17:41:39:005291 gpinitsystem:mas:gpadmin-[INFO]:-Encoding                   = UNICODE
20180417:17:41:39:005291 gpinitsystem:mas:gpadmin-[INFO]:-Postgres param file        = Off
20180417:17:41:39:005291 gpinitsystem:mas:gpadmin-[INFO]:-Initdb to be used          = /usr/local/greenplum-db/bin/initdb
20180417:17:41:39:005291 gpinitsystem:mas:gpadmin-[INFO]:-GP_LIBRARY_PATH is         = /usr/local/greenplum-db/lib
20180417:17:41:39:005291 gpinitsystem:mas:gpadmin-[INFO]:-HEAP_CHECKSUM is           = on
20180417:17:41:39:005291 gpinitsystem:mas:gpadmin-[INFO]:-Ulimit check               = Passed
20180417:17:41:39:005291 gpinitsystem:mas:gpadmin-[INFO]:-Array host connect type    = Single hostname per node
20180417:17:41:39:005291 gpinitsystem:mas:gpadmin-[INFO]:-Master IP address [1]      = ::1
20180417:17:41:39:005291 gpinitsystem:mas:gpadmin-[INFO]:-Master IP address [2]      = 10.0.2.7
20180417:17:41:39:005291 gpinitsystem:mas:gpadmin-[INFO]:-Master IP address [3]      = 192.168.122.1
20180417:17:41:39:005291 gpinitsystem:mas:gpadmin-[INFO]:-Master IP address [4]      = 192.168.56.101
20180417:17:41:39:005291 gpinitsystem:mas:gpadmin-[INFO]:-Master IP address [5]      = fe80::a00:27ff:fe6e:8656
20180417:17:41:39:005291 gpinitsystem:mas:gpadmin-[INFO]:-Master IP address [6]      = fe80::a00:27ff:fef3:ba27
20180417:17:41:39:005291 gpinitsystem:mas:gpadmin-[INFO]:-Standby Master             = Not Configured
20180417:17:41:39:005291 gpinitsystem:mas:gpadmin-[INFO]:-Primary segment #          = 1
20180417:17:41:39:005291 gpinitsystem:mas:gpadmin-[INFO]:-Total Database segments    = 3
20180417:17:41:39:005291 gpinitsystem:mas:gpadmin-[INFO]:-Trusted shell              = ssh
20180417:17:41:39:005291 gpinitsystem:mas:gpadmin-[INFO]:-Number segment hosts       = 3
20180417:17:41:39:005291 gpinitsystem:mas:gpadmin-[INFO]:-Mirroring config           = OFF
20180417:17:41:39:005291 gpinitsystem:mas:gpadmin-[INFO]:----------------------------------------
20180417:17:41:39:005291 gpinitsystem:mas:gpadmin-[INFO]:-Greenplum Primary Segment Configuration
20180417:17:41:39:005291 gpinitsystem:mas:gpadmin-[INFO]:----------------------------------------
20180417:17:41:39:005291 gpinitsystem:mas:gpadmin-[INFO]:-mas 	/u01/greenplum-data/gpseg0 	40000 	2 0
20180417:17:41:39:005291 gpinitsystem:mas:gpadmin-[INFO]:-seg1 	/u01/greenplum-data/gpseg1 	40000 	3 1
20180417:17:41:39:005291 gpinitsystem:mas:gpadmin-[INFO]:-seg2 	/u01/greenplum-data/gpseg2 	40000 	4 2

Continue with Greenplum creation Yy|Nn (default=N):
> y
20180417:17:41:43:005291 gpinitsystem:mas:gpadmin-[INFO]:-Building the Master instance database, please wait...
20180417:17:41:46:005291 gpinitsystem:mas:gpadmin-[INFO]:-Starting the Master in admin mode
20180417:17:41:51:005291 gpinitsystem:mas:gpadmin-[INFO]:-Commencing parallel build of primary segment instances
20180417:17:41:51:005291 gpinitsystem:mas:gpadmin-[INFO]:-Spawning parallel processes    batch [1], please wait...
...
20180417:17:41:51:005291 gpinitsystem:mas:gpadmin-[INFO]:-Waiting for parallel processes batch [1], please wait...
...............................

20180417:17:42:23:005291 gpinitsystem:mas:gpadmin-[INFO]:------------------------------------------------
20180417:17:42:23:005291 gpinitsystem:mas:gpadmin-[INFO]:-Parallel process exit status
20180417:17:42:23:005291 gpinitsystem:mas:gpadmin-[INFO]:------------------------------------------------
20180417:17:42:23:005291 gpinitsystem:mas:gpadmin-[INFO]:-Total processes marked as completed           = 3
20180417:17:42:23:005291 gpinitsystem:mas:gpadmin-[INFO]:-Total processes marked as killed              = 0
20180417:17:42:23:005291 gpinitsystem:mas:gpadmin-[INFO]:-Total processes marked as failed              = 0
20180417:17:42:23:005291 gpinitsystem:mas:gpadmin-[INFO]:------------------------------------------------
20180417:17:42:23:005291 gpinitsystem:mas:gpadmin-[INFO]:-Deleting distributed backout files
20180417:17:42:23:005291 gpinitsystem:mas:gpadmin-[INFO]:-Removing back out file
20180417:17:42:23:005291 gpinitsystem:mas:gpadmin-[INFO]:-No errors generated from parallel processes
20180417:17:42:23:005291 gpinitsystem:mas:gpadmin-[INFO]:-Restarting the Greenplum instance in production mode

20180417:17:42:23:009523 gpstop:mas:gpadmin-[INFO]:-Starting gpstop with args: -a -l /home/gpadmin/gpAdminLogs -i -m -d /u01/greenplum-data/gpseg-1
20180417:17:42:23:009523 gpstop:mas:gpadmin-[INFO]:-Gathering information and validating the environment...
20180417:17:42:23:009523 gpstop:mas:gpadmin-[INFO]:-Obtaining Greenplum Master catalog information
20180417:17:42:23:009523 gpstop:mas:gpadmin-[INFO]:-Obtaining Segment details from master...
20180417:17:42:23:009523 gpstop:mas:gpadmin-[INFO]:-Greenplum Version: 'postgres (Greenplum Database) 5.0.0 build dev'
20180417:17:42:23:009523 gpstop:mas:gpadmin-[INFO]:-There are 0 connections to the database
20180417:17:42:23:009523 gpstop:mas:gpadmin-[INFO]:-Commencing Master instance shutdown with mode='immediate'
20180417:17:42:23:009523 gpstop:mas:gpadmin-[INFO]:-Master host=mas
20180417:17:42:23:009523 gpstop:mas:gpadmin-[INFO]:-Commencing Master instance shutdown with mode=immediate
20180417:17:42:23:009523 gpstop:mas:gpadmin-[INFO]:-Master segment instance directory=/u01/greenplum-data/gpseg-1
20180417:17:42:24:009523 gpstop:mas:gpadmin-[INFO]:-Attempting forceful termination of any leftover master process
20180417:17:42:24:009523 gpstop:mas:gpadmin-[INFO]:-Terminating processes for segment /u01/greenplum-data/gpseg-1

20180417:17:42:25:009553 gpstart:mas:gpadmin-[INFO]:-Starting gpstart with args: -a -l /home/gpadmin/gpAdminLogs -d /u01/greenplum-data/gpseg-1
20180417:17:42:25:009553 gpstart:mas:gpadmin-[INFO]:-Gathering information and validating the environment...
20180417:17:42:25:009553 gpstart:mas:gpadmin-[INFO]:-Greenplum Binary Version: 'postgres (Greenplum Database) 5.0.0 build dev'
20180417:17:42:25:009553 gpstart:mas:gpadmin-[INFO]:-Greenplum Catalog Version: '301705051'
20180417:17:42:25:009553 gpstart:mas:gpadmin-[INFO]:-Starting Master instance in admin mode
20180417:17:42:26:009553 gpstart:mas:gpadmin-[INFO]:-Obtaining Greenplum Master catalog information
20180417:17:42:26:009553 gpstart:mas:gpadmin-[INFO]:-Obtaining Segment details from master...
20180417:17:42:26:009553 gpstart:mas:gpadmin-[INFO]:-Setting new master era
20180417:17:42:26:009553 gpstart:mas:gpadmin-[INFO]:-Master Started...
20180417:17:42:26:009553 gpstart:mas:gpadmin-[INFO]:-Shutting down master
20180417:17:42:27:009553 gpstart:mas:gpadmin-[INFO]:-Commencing parallel segment instance startup, please wait...
........ 
20180417:17:42:35:009553 gpstart:mas:gpadmin-[INFO]:-Process results...
20180417:17:42:35:009553 gpstart:mas:gpadmin-[INFO]:-----------------------------------------------------
20180417:17:42:35:009553 gpstart:mas:gpadmin-[INFO]:-   Successful segment starts                                            = 3
20180417:17:42:35:009553 gpstart:mas:gpadmin-[INFO]:-   Failed segment starts                                                = 0
20180417:17:42:35:009553 gpstart:mas:gpadmin-[INFO]:-   Skipped segment starts (segments are marked down in configuration)   = 0
20180417:17:42:35:009553 gpstart:mas:gpadmin-[INFO]:-----------------------------------------------------
20180417:17:42:35:009553 gpstart:mas:gpadmin-[INFO]:-Successfully started 3 of 3 segment instances 
20180417:17:42:35:009553 gpstart:mas:gpadmin-[INFO]:-----------------------------------------------------
20180417:17:42:35:009553 gpstart:mas:gpadmin-[INFO]:-Starting Master instance mas directory /u01/greenplum-data/gpseg-1 
20180417:17:42:36:009553 gpstart:mas:gpadmin-[INFO]:-Command pg_ctl reports Master mas instance active
20180417:17:42:36:009553 gpstart:mas:gpadmin-[INFO]:-No standby master configured.  skipping...
20180417:17:42:36:009553 gpstart:mas:gpadmin-[INFO]:-Database successfully started

20180417:17:42:36:005291 gpinitsystem:mas:gpadmin-[INFO]:-Completed restart of Greenplum instance in production mode
20180417:17:42:42:005291 gpinitsystem:mas:gpadmin-[INFO]:-Scanning utility log file for any warning messages
20180417:17:42:42:005291 gpinitsystem:mas:gpadmin-[INFO]:-Log file scan check passed
20180417:17:42:42:005291 gpinitsystem:mas:gpadmin-[INFO]:-Greenplum Database instance successfully created
20180417:17:42:42:005291 gpinitsystem:mas:gpadmin-[INFO]:-------------------------------------------------------
20180417:17:42:42:005291 gpinitsystem:mas:gpadmin-[INFO]:-To complete the environment configuration, please 
20180417:17:42:42:005291 gpinitsystem:mas:gpadmin-[INFO]:-update gpadmin .bashrc file with the following
20180417:17:42:42:005291 gpinitsystem:mas:gpadmin-[INFO]:-1. Ensure that the greenplum_path.sh file is sourced
20180417:17:42:42:005291 gpinitsystem:mas:gpadmin-[INFO]:-2. Add "export MASTER_DATA_DIRECTORY=/u01/greenplum-data/gpseg-1"
20180417:17:42:42:005291 gpinitsystem:mas:gpadmin-[INFO]:-   to access the Greenplum scripts for this instance:
20180417:17:42:42:005291 gpinitsystem:mas:gpadmin-[INFO]:-   or, use -d /u01/greenplum-data/gpseg-1 option for the Greenplum scripts
20180417:17:42:42:005291 gpinitsystem:mas:gpadmin-[INFO]:-   Example gpstate -d /u01/greenplum-data/gpseg-1
20180417:17:42:42:005291 gpinitsystem:mas:gpadmin-[INFO]:-Script log file = /home/gpadmin/gpAdminLogs/gpinitsystem_20180417.log
20180417:17:42:42:005291 gpinitsystem:mas:gpadmin-[INFO]:-To remove instance, run gpdeletesystem utility
20180417:17:42:42:005291 gpinitsystem:mas:gpadmin-[INFO]:-To initialize a Standby Master Segment for this Greenplum instance
20180417:17:42:42:005291 gpinitsystem:mas:gpadmin-[INFO]:-Review options for gpinitstandby
20180417:17:42:42:005291 gpinitsystem:mas:gpadmin-[INFO]:-------------------------------------------------------
20180417:17:42:42:005291 gpinitsystem:mas:gpadmin-[INFO]:-The Master /u01/greenplum-data/gpseg-1/pg_hba.conf post gpinitsystem
20180417:17:42:42:005291 gpinitsystem:mas:gpadmin-[INFO]:-has been configured to allow all hosts within this new
20180417:17:42:42:005291 gpinitsystem:mas:gpadmin-[INFO]:-array to intercommunicate. Any hosts external to this
20180417:17:42:42:005291 gpinitsystem:mas:gpadmin-[INFO]:-new array must be explicitly added to this file
20180417:17:42:42:005291 gpinitsystem:mas:gpadmin-[INFO]:-Refer to the Greenplum Admin support guide which is
20180417:17:42:42:005291 gpinitsystem:mas:gpadmin-[INFO]:-located in the /usr/local/greenplum-db/docs directory
20180417:17:42:42:005291 gpinitsystem:mas:gpadmin-[INFO]:-------------------------------------------------------

mas、sla 上增加 MASTER_DATA_DIRECTORY 变量，最终的修改如下:

$ vi /home/gpadmin/.bashrc
source /usr/local/greenplum-db/greenplum_path.sh
export MASTER_DATA_DIRECTORY=/u01/greenplum-data/gpseg-1

$ vi /home/gpadmin/.bash_profile
source /usr/local/greenplum-db/greenplum_path.sh
export MASTER_DATA_DIRECTORY=/u01/greenplum-data/gpseg-1

seg1、seg2 作为segment，最终的修改如下:

$ vi /home/gpadmin/.bashrc
source /usr/local/greenplum-db/greenplum_path.sh

$ vi /home/gpadmin/.bash_profile
source /usr/local/greenplum-db/greenplum_path.sh

设置访问权限

$ cd /u01/greenplum-data/gpseg-1
$ ls -l
total 60
drwx------ 6 gpadmin gpadmin    54 Apr 17 17:42 base
drwx------ 2 gpadmin gpadmin  4096 Apr 17 17:42 global
-r-------- 1 gpadmin gpadmin   109 Apr 17 17:41 gp_dbid
drwxrwxr-x 5 gpadmin gpadmin    42 Apr 17 17:41 gpperfmon
-rw-rw-r-- 1 gpadmin gpadmin   860 Apr 17 17:41 gpssh.conf
drwx------ 2 gpadmin gpadmin     6 Apr 17 17:41 pg_changetracking
drwx------ 2 gpadmin gpadmin    18 Apr 17 17:41 pg_clog
drwx------ 2 gpadmin gpadmin    18 Apr 17 17:41 pg_distributedlog
drwx------ 2 gpadmin gpadmin     6 Apr 17 17:41 pg_distributedxidmap
-rw-rw-r-- 1 gpadmin gpadmin  4307 Apr 17 17:41 pg_hba.conf
-rw------- 1 gpadmin gpadmin  1636 Apr 17 17:41 pg_ident.conf
drwx------ 2 gpadmin gpadmin   141 Apr 17 17:42 pg_log
drwx------ 4 gpadmin gpadmin    36 Apr 17 17:41 pg_multixact
drwx------ 2 gpadmin gpadmin    25 Apr 17 17:42 pg_stat_tmp
drwx------ 2 gpadmin gpadmin    18 Apr 17 17:41 pg_subtrans
drwx------ 2 gpadmin gpadmin     6 Apr 17 17:41 pg_tblspc
drwx------ 2 gpadmin gpadmin     6 Apr 17 17:41 pg_twophase
drwx------ 2 gpadmin gpadmin     6 Apr 17 17:42 pg_utilitymodedtmredo
-rw------- 1 gpadmin gpadmin     4 Apr 17 17:41 PG_VERSION
drwx------ 3 gpadmin gpadmin    60 Apr 17 17:42 pg_xlog
-rw------- 1 gpadmin gpadmin 21250 Apr 17 17:41 postgresql.conf
-rw------- 1 gpadmin gpadmin   205 Apr 17 17:42 postmaster.opts
-rw------- 1 gpadmin gpadmin    53 Apr 17 17:42 postmaster.pid

熟悉吧，和 postgresql 的目录基本是一致的。

$ vi pg_hba.conf
$ psql -d postgres -c "select pg_reload_conf();"
$ psql -d postgres
psql (8.3.23)
Type "help" for help.

postgres=# select gp_opt_version();
                gp_opt_version                 
-----------------------------------------------
 GPOPT version: 2.55.13, Xerces version: 3.1.2
(1 row)

ok，安装完毕

Linux

更多推荐

Linux虚拟文件系统之文件系统卸载（sys_umount())

Linux中卸载文件系统由umount系统调用实现，入口函数为sys_umount()。较于文件系统的安装较为简单，下面是具体的实现。1. /*sys_umont系统调用*/2. SYSCALL_DEFINE2(umount, char __user *, name, int, flags)3. {4.struct path path;

Linux

网卡速率和双工模式的配置

http://linux.chinaitlab.com/system/792187.html1、mii-tool 配置网络设备协商方式的工具； 1.1 mii-tool 介绍； mii-tool - view, manipulate media-independent interface status （mii-tool 是查看，管理介质的网络接口的状态）

Linux

Linux系统下超级终端Minicom的使用方法（例如：连接交换机，路由器等）转http://baike.baidu.com/view/2911642.htm?fr=ala0_1

Linux系统下超级终端Minicom的使用方法 　　Linux下的Minicom的功能与下的超级终端功能相似，适于在通过超级终端对设备的管理以及对嵌入操作系统的升级，现写出Minicom的使用手册： 　　1．启动minicom 　　以root权限登录系统 　　使用命令 　　minicom –s 则minicom启动，屏