一、Greenplum简介Greenplum数据库系统体系结构的概述。
Greenplum数据库通过在多个服务器或主机之间分配负载来存储和处理大量数据。Greenplum中的逻辑数据库是一组单独的PostgreSQL数据库,这些数据库协同工作以呈现单个数据库映像。该主是入口点,Greenplum的数据库系统。它是用户连接并提交SQL语句的数据库实例。主服务器协调系统中其他数据库实例(称为segment)的工作负载,这些实例处理数据处理和存储。这些段通过互连(Greenplum数据库的网络层)相互之间和主机进行通信 。当前安装的测试环境如下所示:主机名 ip 配置 系统版本 用途 数据库安装位置 数据安装目录mdwh1 172.16.101.112 6c,16G CentOS Linux release 7.5.1804 (Core) master主节点 /usr/local/greenplum-db /data/mastersdwh1 172.16.101.113 6c,16G CentOS Linux release 7.5.1804 (Core) segment节点,mirro节点 /usr/local/greenplum-db /data/primary,/data/mirrosdwh1 172.16.101.114 6c,16G CentOS Linux release 7.5.1804 (Core) segment节点,mirro节点 /usr/local/greenplum-db /data/primary,/data/mirro注意
二、配置系统(所有服务器都需要配置)1. 确保您的主机系统满足平台要求中所述的要求。2. 禁用SELinux和防火墙软件。禁用SELinux
1.以root用户身份检查SELinux的状态:
[root@mdwh ~]# sestatus
SELinux status: disabled
2.如果未禁用SELinux,请通过编辑/etc/selinux/config文件:
SELINUX=disabled
禁用防火墙
systemctl stop firewalld && systemctl disable firewalld.service3. 设置所需的操作系统参数。vi /etc/sysctl.conf参考参数如下:
kernel.shmall = 4000000000kernel.shmmax = 500000000kernel.shmmni = 4096vm.overcommit_memory = 2vm.overcommit_ratio = 95 net.ipv4.ip_local_port_range = 10000 65535kernel.sem = 500 2048000 200 40960kernel.sysrq = 1kernel.core_uses_pid = 1kernel.msgmnb = 65536kernel.msgmax = 65536kernel.msgmni = 2048net.ipv4.tcp_syncookies = 1net.ipv4.conf.default.accept_source_route = 0net.ipv4.tcp_max_syn_backlog = 4096net.ipv4.conf.all.arp_filter = 1net.core.netdev_max_backlog = 10000net.core.rmem_max = 2097152net.core.wmem_max = 2097152vm.swappiness = 10vm.zone_reclaim_mode = 0vm.dirty_expire_centisecs = 500vm.dirty_writeback_centisecs = 100vm.dirty_background_ratio = 0 # See Note 5vm.dirty_ratio = 0vm.dirty_background_bytes = 1610612736vm.dirty_bytes = 4294967296修改立即生效sysctl -p1修改文件数,进程数的限制vi /etc/security/limits.conf,在文件末尾新增以下内容* soft nofile 524288* hard nofile 524288* soft nproc 131072* hard nproc 1310724. 创建ip和主机名映射:vi /etc/hosts172.16.101.112 mdwh 172.16.101.113 sdwh1172.16.101.114 sdwh25. 创建gpadmin帐户。groupadd -g 530 gpadmin
useradd -g 530 -u 530 -m -d /home/gpadmin -s /bin/bash gpadmin
chown -R gpadmin:gpadmin /home/gpadmin
echo "gpadmin" | passwd --stdin gpadmin6. 配置root和gpadmin用户SSH免密登录root用户登录主节点:
1. ssh-keygen 生成公钥和私钥2. 用ssh-copy-id将公钥复制到远程机器中 ssh-copy-id sdwh1 ssh-copy-id sdwh2
gpadmin用户登录主节点:
1. ssh-keygen 生成公钥和私钥2. 用ssh-copy-id将公钥复制到远程机器中 ssh-copy-id sdwh1 ssh-copy-id sdwh2三、安装Greenplum数据库下载安装包,放到master节点服务器上1.下载greenplum-db-6.0.0-rhel7-x86_64.rpm文件,下载地址https://github.com/greenplum-db/gpdb/releases/tag/6.0.0
2.yum install greenplum-db-6.0.0-rhel7-x86_64.rpm或者 rpm -ivh greenplum-db-6.0.0-rhel7-x86_64.rpmmaster节点开始安装rpm包[root@mdwh ~]# rpm -ivh greenplum-db-6.0.0-rhel7-x86_64.rpm 准备中... ################################# [] 正在升级/安装... 1:greenplum-db-6.0.0-1.el7 ################################# []
设置环境变量source /usr/local/greenplum-db/greenplum_path.sh1新建gpconfigs文件夹,存放gp安装过程中所使用到的配置文件[root@mdwh ~]# mkdir /usr/local/greenplum-db-6.0.0/gpconfigs
[root@mdwh gpadmin]# cd /usr/local/greenplum-db-6.0.0/gpconfigs
allhosts: 所有服务器的主机名seghosts: 所有Segment节点的主机名
[root@mdwh gpconfigs]# vi allhosts 写入 mdwh sdwh1 sdwh2
[root@mdwh gpconfigs]# vi seghosts 写入 sdwh1 sdwh2
通过gpssh在所有的segment节点进行安装rpm包以下命令以重做ssh密钥交换[root@mdwh gpconfigs]# gpssh-exkeys -f seghosts [STEP 1 of 5] create local ID and authorize on local host ... /root/.ssh/id_rsa file exists ... key generation skipped
[STEP 2 of 5] keyscan all hosts and update known_hosts file
[STEP 3 of 5] retrieving credentials from remote hosts ... send to sdwh1 ... send to sdwh2
[STEP 4 of 5] determine common authentication file content
[STEP 5 of 5] copy authentication files to all remote hosts ... finished key exchange with sdwh1 ... finished key exchange with sdwh2
[INFO] completed successfully
执行具体的安装操作1. 通过gpssh -f seghosts连接上所有的segment节点
[root@mdwh gpconfigs]# gpssh -f seghosts => pwd [sdwh1] /root [sdwh2] /root => pwd [sdwh1] /root [sdwh2] /root
2. 从主机复制rpm包
=> scp mdwh:/root/greenplum-db-6.0.0-rhel7-x86_64.rpm ./ greenplum-db-6.0.0-rhel7-x86_64.rpm 0% 0 0.0KB/s --:-- greenplum-db-6.0.0-rhel7-x86_64.rpm 1% 2000KB 1.9MB/s 01:31 greenplum-db-6.0.0-rhel7-x86_64.rpm 6% 11MB 2.4MB/s 01:08 greenplum-db-6.0.0-rhel7-x86_64.rpm 91% 157MB 16.7MB/s 00:00 greenplum-db-6.0.0-rhel7-x86_64.rpm 172MB 49.2MB/s 00:03 greenplum-db-6.0.0-rhel7-x86_64.rpm 0% 0 0.0KB/s --:-- greenplum-db-6.0.0-rhel7-x86_64.rpm 30% 53MB 53.1MB/s 00:02 greenplum-db-6.0.0-rhel7-x86_64.rpm 44% 76MB 49.6MB/s 00:01 greenplum-db-6.0.0-rhel7-x86_64.rpm 54% 94MB 46.3MB/s 00:01 greenplum-db-6.0.0-rhel7-x86_64.rpm 75% 130MB 45.0MB/s 00:00 greenplum-db-6.0.0-rhel7-x86_64.rpm 172MB 31.9MB/s 00:05 => ll
3. 安装rpm包
=> rpm -ivh /root/greenplum-db-6.0.0-rhel7-x86_64.rpm [sdwh1] 准备中... ################################# [] [sdwh1] 正在升级/安装... [sdwh1] 1:greenplum-db-6.0.0-1.el7 ################################# [] [sdwh2] 准备中... ################################# [] [sdwh2] 正在升级/安装... [sdwh2] 1:greenplum-db-6.0.0-1.el7 ################################# [] => => chown -R gpadmin:gpadmin /usr/local/greenplum* [sdwh1] [sdwh2] =>
在segment节点创建primary、mirro存储目录=> mkdir /data/primary && chown -R gpadmin:gpadmin /data/primary[sdwh1][sdwh2]=> mkdir /data/mirror && chown -R gpadmin:gpadmin /data/mirror[sdwh1][sdwh2]=> exit
修改master节点的greenplum安装目录权限[root@mdwh gpconfigs]# chown -R gpadmin:gpadmin /usr/local/greenplum*1切换gpadmin用户,进行greenplum数据初始化操作1. 切换用户
[root@mdwh gpconfigs]# su gpadmin
2. 从greenplum安装目录copy初始化文件
[gpadmin@mdwh gpconfigs]$ cp /usr/local/greenplum-db/docs/cli_help/gpconfigs/gpinitsystem_config /usr/local/greenplum-db/gpconfigs/
3. 编辑gpinitsystem_config配置文件
vim /usr/local/greenplum-db/gpconfigs/gpinitsystem_config
--- 本例配置文件如下:
# FILE NAME: gpinitsystem_config
# Configuration file needed by the gpinitsystem
################################################ #### REQUIRED PARAMETERS ################################################
#### Name of this Greenplum system enclosed in quotes. ARRAY_NAME="Greenplum Data Platform"
#### Naming convention for utility-generated data directories. SEG_PREFIX=gpseg
#### Base number by which primary segment port numbers #### are calculated. PORT_BASE=6000
#### File system location(s) where primary segment data directories #### will be created. The number of locations in the list dictate #### the number of primary segments that will get created per #### physical host (if multiple addresses for a host are listed in #### the hostfile, the number of segments will be spread evenly across #### the specified interface addresses). declare -a DATA_DIRECTORY=(/data/primary)
#### OS-configured hostname or IP address of the master host. MASTER_HOSTNAME=mdwh
#### File system location where the master data directory #### will be created. MASTER_DIRECTORY=/data/master
#### Port number for the master instance. MASTER_PORT=5432
#### Shell utility used to connect to remote hosts. TRUSTED_SHELL=ssh
#### Maximum log file segments between automatic WAL checkpoints. CHECK_POINT_SEGMENTS=8
#### Default server-side character set encoding. ENCODING=UNICODE
################################################ #### OPTIONAL MIRROR PARAMETERS ################################################
#### Base number by which mirror segment port numbers #### are calculated. MIRROR_PORT_BASE=7000
#### File system location(s) where mirror segment data directories #### will be created. The number of mirror locations must equal the #### number of primary locations as specified in the #### DATA_DIRECTORY parameter. declare -a MIRROR_DATA_DIRECTORY=(/data/mirror)
################################################ #### OTHER OPTIONAL PARAMETERS ################################################
#### Create a database of this name after initialization. #DATABASE_NAME=name_of_database
#### Specify the location of the host address file here instead of #### with the the -h option of gpinitsystem. #MACHINE_LIST_FILE=/home/gpadmin/gpconfigs/hostfile_gpinitsystem---
配置文件详解:
###必需的参数 # 系统名称 ARRAY_NAME="Greenplum Data Platform" # 生成的数据目录的命名约定 SEG_PREFIX=gpseg # segment所使用的端口 PORT_BASE=6000 # segment数据目录所在的文件系统位置。列表中的位置数量表示将创建几个segment实例 declare -a DATA_DIRECTORY=(/data1/primary /data1/primary /data1/primary /data2/primary /data2/primary /data2/primary) # master节点的主机名或IP地址 MASTER_HOSTNAME=mdw # master节点数据目录所在的文件系统位置 MASTER_DIRECTORY=/data/master # 主实例的端口号。 MASTER_PORT=5432 # Shell utility used to connect to remote hosts. TRUSTED SHELL=ssh # Maximum log file segments between automatic WAL checkpoints. CHECK_POINT_SEGMENTS=8 # 默认的服务器端字符集编码 ENCODING=UNICODE
### 可选MIRROR参数 # 镜像段端口号得到的基号 MIRROR_PORT_BASE=7000 # 镜像段数据目录所在的文件系统位置 列表中的位置数量表示将创建几个镜像实例 declare -a MIRROR_DATA_DIRECTORY=(/data1/mirror /data1/mirror /data1/mirror /data2/mirror /data2/mirror /data2/mirror)
### 其他可选参数 # 初始化后创建此名称的数据库 # DATABASE_NAME=name_of_database
# 在这里指定主机地址文件的位置,而不是使用gpinitsystem的-h选项 #MACHINE_LIST_FILE=/home/gpadmin/gpconfigs/hostfile_gpinitsystem
4. 主节点环境变量设置
[gpadmin@mdwh gpconfigs]$ vi ~/.bashrc
export MASTER_DATA_DIRECTORY=/data/master/gpseg-1 export PGPORT=5432 export PGUSER=gpadmin export LD_PRELOAD=/lib64/libz.so.1 ps
[gpadmin@mdwh gpconfigs]$ source ~/.bashrc
5. 执行初始化
初始化命令:gpinitsystem -c gpinitsystem_config -h seghosts / -s sdwh2 -S
安装过程日志记录: [gpadmin@mdwh gpconfigs]$ gpinitsystem -c gpinitsystem_config -h seghosts / -s sdwh2 -S 20191016:18:41:09:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Checking configuration parameters, please wait... 20191016:18:41:09:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Reading Greenplum configuration file gpinitsystem_config 20191016:18:41:09:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Locale has not been set in gpinitsystem_config, will set to default value 20191016:18:41:09:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Locale set to en_US.utf8 20191016:18:41:09:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-No DATABASE_NAME set, will exit following template1 updates 20191016:18:41:09:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-MASTER_MAX_CONNECT not set, will set to default value 250 20191016:18:41:09:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Checking configuration parameters, Completed 20191016:18:41:09:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Commencing multi-home checks, please wait... .. 20191016:18:41:10:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Configuring build for standard array 20191016:18:41:10:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Commencing multi-home checks, Completed 20191016:18:41:10:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Building primary segment instance array, please wait... .. 20191016:18:41:10:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Building group mirror array type , please wait... .. 20191016:18:41:11:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Checking Master host 20191016:18:41:11:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Checking new segment hosts, please wait... .... 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Checking new segment hosts, Completed 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Greenplum Database Creation Parameters 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:--------------------------------------- 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Master Configuration 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:--------------------------------------- 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Master instance name = Greenplum Data Platform 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Master hostname = mdwh 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Master port = 5432 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Master instance dir = /data/master/gpseg-1 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Master LOCALE = en_US.utf8 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Greenplum segment prefix = gpseg 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Master Database = 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Master connections = 250 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Master buffers = 128000kB 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Segment connections = 750 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Segment buffers = 128000kB 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Checkpoint segments = 8 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Encoding = UNICODE 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Postgres param file = Off 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Initdb to be used = /usr/local/greenplum-db/./bin/initdb 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-GP_LIBRARY_PATH is = /usr/local/greenplum-db/./lib 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-HEAP_CHECKSUM is = on 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-HBA_HOSTNAMES is = 0 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Ulimit check = Passed 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Array host connect type = Single hostname per node 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Master IP address [1] = ::1 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Master IP address [2] = 172.16.101.112 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Master IP address [3] = fe80::20c:29ff:fed3:e7a7 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Standby Master = Not Configured 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Number of primary segments = 1 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Total Database segments = 2 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Trusted shell = ssh 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Number segment hosts = 2 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Mirror port base = 7000 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Number of mirror segments = 1 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Mirroring config = ON 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Mirroring type = Group 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:---------------------------------------- 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Greenplum Primary Segment Configuration 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:---------------------------------------- 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-sdwh1 /data/primary/gpseg0 6000 2 0 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-sdwh2 /data/primary/gpseg1 6000 3 1 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:--------------------------------------- 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Greenplum Mirror Segment Configuration 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:--------------------------------------- 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-sdwh2 /data/mirror/gpseg0 7000 4 0 20191016:18:41:14:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-sdwh1 /data/mirror/gpseg1 7000 5 1
Continue with Greenplum creation Yy|Nn (default=N): > y 20191016:18:41:18:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Building the Master instance database, please wait... 20191016:18:41:25:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Starting the Master in admin mode 20191016:18:41:26:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Commencing parallel build of primary segment instances 20191016:18:41:26:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Spawning parallel processes batch [1], please wait... .. 20191016:18:41:26:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Waiting for parallel processes batch [1], please wait... ............ 20191016:18:41:38:001574 gpinitsystem:mdwh:gpadmin-[INFO]:------------------------------------------------ 20191016:18:41:38:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Parallel process exit status 20191016:18:41:38:001574 gpinitsystem:mdwh:gpadmin-[INFO]:------------------------------------------------ 20191016:18:41:38:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Total processes marked as completed = 2 20191016:18:41:38:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Total processes marked as killed = 0 20191016:18:41:38:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Total processes marked as failed = 0 20191016:18:41:38:001574 gpinitsystem:mdwh:gpadmin-[INFO]:------------------------------------------------ 20191016:18:41:38:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Deleting distributed backout files 20191016:18:41:38:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Removing back out file 20191016:18:41:38:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-No errors generated from parallel processes 20191016:18:41:38:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Restarting the Greenplum instance in production mode 20191016:18:41:38:003860 gpstop:mdwh:gpadmin-[INFO]:-Starting gpstop with args: -a -l /home/gpadmin/gpAdminLogs -m -d /data/master/gpseg-1 20191016:18:41:38:003860 gpstop:mdwh:gpadmin-[INFO]:-Gathering information and validating the environment... 20191016:18:41:38:003860 gpstop:mdwh:gpadmin-[INFO]:-Obtaining Greenplum Master catalog information 20191016:18:41:38:003860 gpstop:mdwh:gpadmin-[INFO]:-Obtaining Segment details from master... 20191016:18:41:38:003860 gpstop:mdwh:gpadmin-[INFO]:-Greenplum Version: 'postgres (Greenplum Database) 6.0.0 build commit:a2ff2fc318c327d702e66ab58ae4aff34c42296c' 20191016:18:41:38:003860 gpstop:mdwh:gpadmin-[INFO]:-Commencing Master instance shutdown with mode='smart' 20191016:18:41:38:003860 gpstop:mdwh:gpadmin-[INFO]:-Master segment instance directory=/data/master/gpseg-1 20191016:18:41:38:003860 gpstop:mdwh:gpadmin-[INFO]:-Stopping master segment and waiting for user connections to finish ... server shutting down 20191016:18:41:39:003860 gpstop:mdwh:gpadmin-[INFO]:-Attempting forceful termination of any leftover master process 20191016:18:41:39:003860 gpstop:mdwh:gpadmin-[INFO]:-Terminating processes for segment /data/master/gpseg-1 20191016:18:41:39:003860 gpstop:mdwh:gpadmin-[ERROR]:-Failed to kill processes for segment /data/master/gpseg-1: ([Errno 3] No such process) 20191016:18:41:40:003884 gpstart:mdwh:gpadmin-[INFO]:-Starting gpstart with args: -a -l /home/gpadmin/gpAdminLogs -d /data/master/gpseg-1 20191016:18:41:40:003884 gpstart:mdwh:gpadmin-[INFO]:-Gathering information and validating the environment... 20191016:18:41:40:003884 gpstart:mdwh:gpadmin-[INFO]:-Greenplum Binary Version: 'postgres (Greenplum Database) 6.0.0 build commit:a2ff2fc318c327d702e66ab58ae4aff34c42296c' 20191016:18:41:40:003884 gpstart:mdwh:gpadmin-[INFO]:-Greenplum Catalog Version: '301908232' 20191016:18:41:40:003884 gpstart:mdwh:gpadmin-[INFO]:-Starting Master instance in admin mode 20191016:18:41:41:003884 gpstart:mdwh:gpadmin-[INFO]:-Obtaining Greenplum Master catalog information 20191016:18:41:41:003884 gpstart:mdwh:gpadmin-[INFO]:-Obtaining Segment details from master... 20191016:18:41:41:003884 gpstart:mdwh:gpadmin-[INFO]:-Setting new master era 20191016:18:41:41:003884 gpstart:mdwh:gpadmin-[INFO]:-Master Started... 20191016:18:41:41:003884 gpstart:mdwh:gpadmin-[INFO]:-Shutting down master 20191016:18:41:42:003884 gpstart:mdwh:gpadmin-[INFO]:-Commencing parallel segment instance startup, please wait... . 20191016:18:41:43:003884 gpstart:mdwh:gpadmin-[INFO]:-Process results... 20191016:18:41:43:003884 gpstart:mdwh:gpadmin-[INFO]:----------------------------------------------------- 20191016:18:41:43:003884 gpstart:mdwh:gpadmin-[INFO]:- Successful segment starts = 2 20191016:18:41:43:003884 gpstart:mdwh:gpadmin-[INFO]:- Failed segment starts = 0 20191016:18:41:43:003884 gpstart:mdwh:gpadmin-[INFO]:- Skipped segment starts (segments are marked down in configuration) = 0 20191016:18:41:43:003884 gpstart:mdwh:gpadmin-[INFO]:----------------------------------------------------- 20191016:18:41:43:003884 gpstart:mdwh:gpadmin-[INFO]:-Successfully started 2 of 2 segment instances 20191016:18:41:43:003884 gpstart:mdwh:gpadmin-[INFO]:----------------------------------------------------- 20191016:18:41:43:003884 gpstart:mdwh:gpadmin-[INFO]:-Starting Master instance mdwh directory /data/master/gpseg-1 20191016:18:41:54:003884 gpstart:mdwh:gpadmin-[INFO]:-Command pg_ctl reports Master mdwh instance active 20191016:18:41:54:003884 gpstart:mdwh:gpadmin-[INFO]:-Connecting to dbname='template1' connect_timeout=15 20191016:18:41:57:003884 gpstart:mdwh:gpadmin-[INFO]:-No standby master configured. skipping... 20191016:18:41:57:003884 gpstart:mdwh:gpadmin-[INFO]:-Database successfully started 20191016:18:41:57:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Completed restart of Greenplum instance in production mode 20191016:18:41:57:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Commencing parallel build of mirror segment instances 20191016:18:41:57:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Spawning parallel processes batch [1], please wait... .. 20191016:18:41:57:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Waiting for parallel processes batch [1], please wait... ........ 20191016:18:42:05:001574 gpinitsystem:mdwh:gpadmin-[INFO]:------------------------------------------------ 20191016:18:42:05:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Parallel process exit status 20191016:18:42:05:001574 gpinitsystem:mdwh:gpadmin-[INFO]:------------------------------------------------ 20191016:18:42:05:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Total processes marked as completed = 2 20191016:18:42:05:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Total processes marked as killed = 0 20191016:18:42:05:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Total processes marked as failed = 0 20191016:18:42:05:001574 gpinitsystem:mdwh:gpadmin-[INFO]:------------------------------------------------ 20191016:18:42:06:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Scanning utility log file for any warning messages 20191016:18:42:06:001574 gpinitsystem:mdwh:gpadmin-[WARN]:-******************************************************* 20191016:18:42:06:001574 gpinitsystem:mdwh:gpadmin-[WARN]:-Scan of log file indicates that some warnings or errors 20191016:18:42:06:001574 gpinitsystem:mdwh:gpadmin-[WARN]:-were generated during the array creation 20191016:18:42:06:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Please review contents of log file 20191016:18:42:06:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-/home/gpadmin/gpAdminLogs/gpinitsystem_20191016.log 20191016:18:42:06:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-To determine level of criticality 20191016:18:42:06:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-These messages could be from a previous run of the utility 20191016:18:42:06:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-that was called today! 20191016:18:42:06:001574 gpinitsystem:mdwh:gpadmin-[WARN]:-******************************************************* 20191016:18:42:06:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Greenplum Database instance successfully created 20191016:18:42:06:001574 gpinitsystem:mdwh:gpadmin-[INFO]:------------------------------------------------------- 20191016:18:42:06:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-To complete the environment configuration, please 20191016:18:42:06:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-update gpadmin .bashrc file with the following 20191016:18:42:06:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-1. Ensure that the greenplum_path.sh file is sourced 20191016:18:42:06:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-2. Add "export MASTER_DATA_DIRECTORY=/data/master/gpseg-1" 20191016:18:42:06:001574 gpinitsystem:mdwh:gpadmin-[INFO]:- to access the Greenplum scripts for this instance: 20191016:18:42:06:001574 gpinitsystem:mdwh:gpadmin-[INFO]:- or, use -d /data/master/gpseg-1 option for the Greenplum scripts 20191016:18:42:06:001574 gpinitsystem:mdwh:gpadmin-[INFO]:- Example gpstate -d /data/master/gpseg-1 20191016:18:42:06:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Script log file = /home/gpadmin/gpAdminLogs/gpinitsystem_20191016.log 20191016:18:42:06:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-To remove instance, run gpdeletesystem utility 20191016:18:42:06:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-To initialize a Standby Master Segment for this Greenplum instance 20191016:18:42:06:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Review options for gpinitstandby 20191016:18:42:06:001574 gpinitsystem:mdwh:gpadmin-[INFO]:------------------------------------------------------- 20191016:18:42:06:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-The Master /data/master/gpseg-1/pg_hba.conf post gpinitsystem 20191016:18:42:06:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-has been configured to allow all hosts within this new 20191016:18:42:06:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-array to intercommunicate. Any hosts external to this 20191016:18:42:06:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-new array must be explicitly added to this file 20191016:18:42:06:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-Refer to the Greenplum Admin support guide which is 20191016:18:42:06:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-located in the /usr/local/greenplum-db/./docs directory 20191016:18:42:06:001574 gpinitsystem:mdwh:gpadmin-[INFO]:-------------------------------------------------------
日志中出现:"Greenplum Database instance successfully created"的信息输出,说明初始化成功~
9.激活standbygpinitstandby -s sdwh2
[gpadmin@mdwh gpseg-1]$ gpinitstandby -s sdwh220191020:21:45:10:030881 gpinitstandby:mdwh:gpadmin-[INFO]:-Validating environment and parameters for standby initialization...20191020:21:45:11:030881 gpinitstandby:mdwh:gpadmin-[INFO]:-Checking for data directory /data/master/gpseg-1 on sdwh220191020:21:45:11:030881 gpinitstandby:mdwh:gpadmin-[INFO]:------------------------------------------------------20191020:21:45:11:030881 gpinitstandby:mdwh:gpadmin-[INFO]:-Greenplum standby master initialization parameters20191020:21:45:11:030881 gpinitstandby:mdwh:gpadmin-[INFO]:------------------------------------------------------20191020:21:45:11:030881 gpinitstandby:mdwh:gpadmin-[INFO]:-Greenplum master hostname = mdwh20191020:21:45:11:030881 gpinitstandby:mdwh:gpadmin-[INFO]:-Greenplum master data directory = /data/master/gpseg-120191020:21:45:11:030881 gpinitstandby:mdwh:gpadmin-[INFO]:-Greenplum master port = 543220191020:21:45:11:030881 gpinitstandby:mdwh:gpadmin-[INFO]:-Greenplum standby master hostname = sdwh220191020:21:45:11:030881 gpinitstandby:mdwh:gpadmin-[INFO]:-Greenplum standby master port = 543220191020:21:45:11:030881 gpinitstandby:mdwh:gpadmin-[INFO]:-Greenplum standby master data directory = /data/master/gpseg-120191020:21:45:11:030881 gpinitstandby:mdwh:gpadmin-[INFO]:-Greenplum update system catalog = OnDo you want to continue with standby master initialization? Yy|Nn (default=N):y20191020:21:45:33:030881 gpinitstandby:mdwh:gpadmin-[INFO]:-Syncing Greenplum Database extensions to standby20191020:21:45:34:030881 gpinitstandby:mdwh:gpadmin-[WARNING]:-Syncing of Greenplum Database extensions has failed.20191020:21:45:34:030881 gpinitstandby:mdwh:gpadmin-[WARNING]:-Please run gppkg --clean after successful standby initialization.20191020:21:45:34:030881 gpinitstandby:mdwh:gpadmin-[INFO]:-Adding standby master to catalog...20191020:21:45:34:030881 gpinitstandby:mdwh:gpadmin-[INFO]:-Database catalog updated successfully.20191020:21:45:35:030881 gpinitstandby:mdwh:gpadmin-[INFO]:-Updating pg_hba.conf file...20191020:21:45:37:030881 gpinitstandby:mdwh:gpadmin-[INFO]:-pg_hba.conf files updated successfully.20191020:21:46:01:030881 gpinitstandby:mdwh:gpadmin-[INFO]:-Starting standby master20191020:21:46:01:030881 gpinitstandby:mdwh:gpadmin-[INFO]:-Checking if standby master is running on host: sdwh2 in directory: /data/master/gpseg-120191020:21:46:04:030881 gpinitstandby:mdwh:gpadmin-[INFO]:-Cleaning up pg_hba.conf backup files...20191020:21:46:08:030881 gpinitstandby:mdwh:gpadmin-[INFO]:-Backup files of pg_hba.conf cleaned up successfully.20191020:21:46:08:030881 gpinitstandby:mdwh:gpadmin-[INFO]:-Successfully created standby master on sdwh2
10.执行 gppkg --clean
20191021:08:54:43:006109 gppkg:mdwh:root-[INFO]:-Starting gppkg with args: --clean20191021:08:54:44:006109 gppkg:mdwh:root-[INFO]:-The packages on sdwh2 are consistent.20191021:08:54:44:006109 gppkg:mdwh:root-[INFO]:-The packages on sdwh1 are consistent.20191021:08:54:44:006109 gppkg:mdwh:root-[INFO]:-Successfully cleaned the cluster
查看greenplum进程[gpadmin@mdwh gpconfigs]$ ps aux | grep greengpadmin 3928 7.3 1.3 483048 222600 ? Ss 18:41 0:06 /usr/local/greenplum-db-6.0.0/bin/postgres -D /data/master/gpseg-1 -p 5432 -Egpadmin 4684 0.0 0.0 114860 996 pts/0 S+ 18:43 0:00 grep --color=auto green
12.查看standby状态 gpstate -f
[gpadmin@mdwh gpseg-1]$ gpstate -f
20191020:21:46:22:031017 gpstate:mdwh:gpadmin-[INFO]:-Starting gpstate with args: -f20191020:21:46:25:031017 gpstate:mdwh:gpadmin-[INFO]:-local Greenplum Version: 'postgres (Greenplum Database) 6.0.0 build commit:a2ff2fc318c327d702e66ab58ae4aff34c42296c'20191020:21:46:25:031017 gpstate:mdwh:gpadmin-[INFO]:-master Greenplum Version: 'PostgreSQL 9.4.24 (Greenplum Database 6.0.0 build commit:a2ff2fc318c327d702e66ab58ae4aff34c42296c) on x86_64-unknown-linux-gnu, compiled by gcc (GCC) 6.4.0, 64-bit compiled on Aug 28 2019 21:29:36'20191020:21:46:25:031017 gpstate:mdwh:gpadmin-[INFO]:-Obtaining Segment details from master...^[[A20191020:21:46:26:031017 gpstate:mdwh:gpadmin-[INFO]:-Standby master details20191020:21:46:26:031017 gpstate:mdwh:gpadmin-[INFO]:-----------------------20191020:21:46:26:031017 gpstate:mdwh:gpadmin-[INFO]:- Standby address = sdwh220191020:21:46:26:031017 gpstate:mdwh:gpadmin-[INFO]:- Standby data directory = /data/master/gpseg-120191020:21:46:26:031017 gpstate:mdwh:gpadmin-[INFO]:- Standby port = 543220191020:21:46:26:031017 gpstate:mdwh:gpadmin-[INFO]:- Standby PID = 2031720191020:21:46:26:031017 gpstate:mdwh:gpadmin-[INFO]:- Standby status = Standby host passive20191020:21:46:26:031017 gpstate:mdwh:gpadmin-[INFO]:--------------------------------------------------------------20191020:21:46:26:031017 gpstate:mdwh:gpadmin-[INFO]:--pg_stat_replication20191020:21:46:26:031017 gpstate:mdwh:gpadmin-[INFO]:--------------------------------------------------------------20191020:21:46:26:031017 gpstate:mdwh:gpadmin-[INFO]:--WAL Sender State: streaming20191020:21:46:26:031017 gpstate:mdwh:gpadmin-[INFO]:--Sync state: sync20191020:21:46:26:031017 gpstate:mdwh:gpadmin-[INFO]:--Sent Location: 0/C00000020191020:21:46:26:031017 gpstate:mdwh:gpadmin-[INFO]:--Flush Location: 0/C00000020191020:21:46:26:031017 gpstate:mdwh:gpadmin-[INFO]:--Replay Location: 0/C00000020191020:21:46:26:031017 gpstate:mdwh:gpadmin-[INFO]:--------------------------------------------------------------
gpstate:mdwh:gpadmin-[INFO]:- Standby status = Standby host passive 表示激活成功
13.查看segment状态 gpstate -m
设置任何ip都可访问greenplum1. 进入master节点服务器
2. 编辑pg_hba.conf
[gpadmin@mdwh gpconfigs]$ vim /data/master/gpseg-1/pg_hba.conf 尾行加入:host all all 0.0.0.0/0 trust3. 使用仅重新加载配置文件更改的greenplum重启命令
[gpadmin@mdwh gpconfigs]$ gpstop -u 20191016:20:35:51:005963 gpstop:mdwh:gpadmin-[INFO]:-Starting gpstop with args: -u 20191016:20:35:51:005963 gpstop:mdwh:gpadmin-[INFO]:-Gathering information and validating the environment... 20191016:20:35:51:005963 gpstop:mdwh:gpadmin-[INFO]:-Obtaining Greenplum Master catalog information 20191016:20:35:51:005963 gpstop:mdwh:gpadmin-[INFO]:-Obtaining Segment details from master... 20191016:20:35:52:005963 gpstop:mdwh:gpadmin-[INFO]:-Greenplum Version: 'postgres (Greenplum Database) 6.0.0 build commit:a2ff2fc318c327d702e66ab58ae4aff34c42296c' 20191016:20:35:52:005963 gpstop:mdwh:gpadmin-[INFO]:-Signalling all postmaster processes to reload
4. 使用数据库连接工具连接greenplum数据库 host:172.16.101.112 port:5432 initail Database:postgres username:gpadmin password:gpadmin
四、启动和停止Greenplum数据库启动Greenplum数据库gpstart1重新启动Greenplum数据库,停止Greenplum数据库系统,然后重新启动它。gpstop -r1仅重新加载配置文件更改,将更改重新加载到Greenplum数据库配置文件,而不会中断系统。gpstop -u1在维护模式下启动主机,仅启动主服务器以执行维护或管理任务,而不会影响段上的数据。gpstart -m1停止Greenplum数据库gpstop1要以快速模式停止Greenplum数据库gpstop -M fast
相关文章
SQL数据库触发器语法详解 (sql数据库触发器语法)
2023-08-06
数据库
语法
触发器
快速简单的删除Oracle数据库字段方法 (删除oracl数据库字段)
2023-08-06
数据库
字段
删除
如何打开社工数据库bak文件 (社工数据库bak怎么打开)
2023-08-06
数据库
打开
社工
实现数据库按拼音排序的方法和技巧 (数据库按拼音排序)
2023-08-06
数据库
排序
按拼音
探究Sybase数据库的性能和功能特点 (sybase数据库怎么样)
2023-08-06
数据库
性能
探究
SQL Server 如何成功建立自己的数据库? (sql server 建立数据库)
2023-08-06
数据库
自己的
建立
如何在Oracle中查看数据库触发器? (oracle查看数据库触发器)
2023-08-06
数据库
查看
触发器
数据库表数据量千万级,对性能影响有多大? (数据库表千万级数据量多吗)
2023-08-06
数据库
级数
有多大
2023服务器遇到数据库安装失败问题 (2023服务器安装数据库失败)
2023-08-06
服务器
安装
失败
如何使用Oracle按时间导出表数据库? (oracle按时间导出表数据库)
2023-08-06
数据库
导出
如何使用
数据库存储:帖子长期保存,信息永不丢失 (帖子存数据库)
2023-08-06
数据库
丢失
帖子
小米六数据库:全方位数据保障和优化方案 (小米六数据库)
2023-08-05
数据库
优化
小米
简易教程:使用dbe数据库实现数据连接 (dbe数据库 数据连接)
2023-08-05
数据
数据库
连接
Oracle实现多个数据库链接的简便方法 (oracle链接多个数据库)
2023-08-05
数据库
多个
链接
数据库索引:用哪种方法建立? (数据库索引用什么建的)
2023-08-05
索引
数据库
哪种
实现高效缓存同步:Redis数据库技巧大全 (redis 数据库缓存同步)
2023-08-05
数据库
缓存
同步
如何利用数据库实现高效的模糊匹配查询? (数据库实现模糊查询)
2023-08-05
查询
数据库
模糊
数据库有哪些安装方式和位置? (数据库是装在什么上)
2023-08-05
数据库
位置
装在
Lactmed数据库:妈妈们必备的喂养指南 (lactmed 数据库)
2023-08-05
数据库
必备
喂养
数据库设计中的主属性定义及作用 (数据库主属性是什么)
2023-08-05
数据库
定义
属性