深入淺析Docker容器中的Patroni
上一篇文章向大家介紹了Repmgr的搭建過(guò)程，實(shí)現(xiàn)了自動(dòng)切換，今天將向大家介紹，如何搭建容器下的Patroni集群環(huán)境，Patroni作為開(kāi)箱即用PG高可用工具，越來(lái)越多的被各個(gè)廠商用于云環(huán)境下使用。
patroni基本架構(gòu)如圖所示：
etcd作為分布式注冊(cè)中心、進(jìn)行集群選主工作；vip-manager為主節(jié)點(diǎn)設(shè)置漂移IP；patroni負(fù)責(zé)引導(dǎo)集群的創(chuàng)建、運(yùn)行和管理工作，并可以使用patronictl來(lái)進(jìn)行終端訪問(wèn)。
具體流程：
1、首先啟動(dòng)etcd集群，本例中etcd數(shù)量為3個(gè)。
2、檢測(cè)etcd集群狀態(tài)健康后，啟動(dòng)patroni并競(jìng)爭(zhēng)選主，其他跟隨節(jié)點(diǎn)進(jìn)行數(shù)據(jù)同步過(guò)程。
3、啟動(dòng)vip-manager，通過(guò)訪問(wèn)etcd集群中/ S E R V I C E N A M E / {SERVICE_NAME}/ SERVICENAME/{CLUSTER_NAME}/leader鍵中的具體值，判斷當(dāng)前節(jié)點(diǎn)是否為主節(jié)點(diǎn)ip，如果是則為該節(jié)點(diǎn)設(shè)置vip，提供對(duì)外讀寫(xiě)服務(wù)。
注：建議真實(shí)環(huán)境下將etcd部署到獨(dú)立容器上，對(duì)外提供服務(wù)。
創(chuàng)建鏡像
文件結(jié)構(gòu)
其中Dockerfile為鏡像主文件，docker服務(wù)通過(guò)該文件在本地倉(cāng)庫(kù)創(chuàng)建鏡像；entrypoint.sh為容器入口文件，負(fù)責(zé)業(yè)務(wù)邏輯的處理；function為執(zhí)行業(yè)務(wù)方法的入口文件，負(fù)責(zé)啟動(dòng)etcd，監(jiān)控etcd集群狀態(tài)、啟動(dòng)patroni和vip-manager；generatefile為整個(gè)容器生成對(duì)應(yīng)的配置文件，包括etcd、patroni及vip-mananger。
目錄結(jié)構(gòu)大致如圖所示：
注：數(shù)據(jù)庫(kù)安裝包和patroni安裝包請(qǐng)自行構(gòu)建。
DockerFile
FROM centos:7
MAINTAINER wangzhibin <wangzhibin>
ENV USER="postgresql" \
PASSWORD=123456 \
GROUP=postgresql
RUN useradd ${USER} \
&& chown -R ${USER}:${GROUP} /home/${USER} \
&& yum -y update && yum install -y iptables sudo net-tools iproute openssh-server openssh-clients which vim sudo crontabs
#安裝etcd
COPY etcd/etcd /usr/sbin
COPY etcd/etcdctl /usr/sbin
#安裝database
COPY lib/ /home/${USER}/lib
COPY include/ /home/${USER}/include
COPY share/ /home/${USER}/share
COPY bin/ /home/${USER}/bin/
COPY patroni/ /home/${USER}/patroni
#安裝vip-manager
COPY vip-manager/vip-manager /usr/sbin
#安裝執(zhí)行腳本
COPY runtime/ /home/${USER}/runtime
COPY entrypoint.sh /sbin/entrypoint.sh
#設(shè)置環(huán)境變量
ENV LD_LIBRARY_PATH /home/${USER}/lib
ENV PATH /home/${USER}/bin:$PATH
ENV ETCDCTL_API=3
#安裝Patroni
RUN yum -y install epel-release python-devel && yum -y install python-pip \
&& pip install /home/${USER}/patroni/1/pip-20.3.3.tar.gz \
&& pip install /home/${USER}/patroni/1/psycopg2-2.8.6-cp27-cp27mu-linux_x86_64.whl \
&& pip install --no-index --find-links=/home/${USER}/patroni/2/ -r /home/${USER}/patroni/2/requirements.txt \
&& pip install /home/${USER}/patroni/3/patroni-2.0.1-py2-none-any.whl
#修改執(zhí)行權(quán)限
RUN chmod 755 /sbin/entrypoint.sh \
&& mkdir /home/${USER}/etcddata \
&& chown -R ${USER}:${GROUP} /home/${USER} \
&& echo 'root:root123456' | chpasswd \
&& chmod 755 /sbin/etcd \
&& chmod 755 /sbin/etcdctl \
&& chmod 755 /sbin/vip-manager
#設(shè)置Sudo
RUN chmod 777 /etc/sudoers \
&& sed -i '/## Allow root to run any commands anywhere/a '${USER}' ALL=(ALL) NOPASSWD:ALL' /etc/sudoers \
&& chmod 440 /etc/sudoers
#切換用戶
USER ${USER}
#切換工作目錄
WORKDIR /home/${USER}
#啟動(dòng)入口程序
CMD ["/bin/bash", "/sbin/entrypoint.sh"]
entrypoint.sh
#!/bin/bash
set -e
# shellcheck source=runtime/functions
source "/home/${USER}/runtime/function"
configure_patroni
function
#!/bin/bash
set -e
source /home/${USER}/runtime/env-defaults
source /home/${USER}/runtime/generatefile
PG_DATADIR=/home/${USER}/pgdata
PG_BINDIR=/home/${USER}/bin
configure_patroni()
{
#生成配置文件
generate_etcd_conf
generate_patroni_conf
generate_vip_conf
#啟動(dòng)etcd
etcdcount=${ETCD_COUNT}
count=0
ip_temp=""
array=(${HOSTLIST//,/ })
for host in ${array[@]}
do
ip_temp+="http://${host}:2380,"
done
etcd --config-file=/home/${USER}/etcd.yml >/home/${USER}/etcddata/etcd.log 2>&1 &
while [ $count -lt $etcdcount ]
do
line=(`etcdctl --endpoints=${ip_temp%?} endpoint health -w json`)
count=`echo $line | awk -F"\"health\":true" '{print NF-1}'`
echo "waiting etcd cluster"
sleep 5
done
#啟動(dòng)patroni
patroni /home/${USER}/postgresql.yml > /home/${USER}/patroni/patroni.log 2>&1 &
#啟動(dòng)vip-manager
sudo vip-manager --config /home/${USER}/vip.yml
}
generatefile
#!/bin/bash
set -e
HOSTNAME="`hostname`"
hostip=`ping ${HOSTNAME} -c 1 -w 1 | sed '1{s/[^(]*(//;s/).*//;q}'`
#generate etcd
generate_etcd_conf()
{
echo "name : ${HOSTNAME}" >> /home/${USER}/etcd.yml
echo "data-dir: /home/${USER}/etcddata" >> /home/${USER}/etcd.yml
echo "listen-client-urls: http://0.0.0.0:2379" >> /home/${USER}/etcd.yml
echo "advertise-client-urls: http://${hostip}:2379" >> /home/${USER}/etcd.yml
echo "listen-peer-urls: http://0.0.0.0:2380" >> /home/${USER}/etcd.yml
echo "initial-advertise-peer-urls: http://${hostip}:2380" >> /home/${USER}/etcd.yml
ip_temp="initial-cluster: "
array=(${HOSTLIST//,/ })
for host in ${array[@]}
do
ip_temp+="${host}=http://${host}:2380,"
done
echo ${ip_temp%?} >> /home/${USER}/etcd.yml
echo "initial-cluster-token: etcd-cluster-token" >> /home/${USER}/etcd.yml
echo "initial-cluster-state: new" >> /home/${USER}/etcd.yml
}
#generate patroni
generate_patroni_conf()
{
echo "scope: ${CLUSTER_NAME}" >> /home/${USER}/postgresql.yml
echo "namespace: /${SERVICE_NAME}/ " >> /home/${USER}/postgresql.yml
echo "name: ${HOSTNAME} " >> /home/${USER}/postgresql.yml
echo "restapi: " >> /home/${USER}/postgresql.yml
echo " listen: ${hostip}:8008 " >> /home/${USER}/postgresql.yml
echo " connect_address: ${hostip}:8008 " >> /home/${USER}/postgresql.yml
echo "etcd: " >> /home/${USER}/postgresql.yml
echo " host: ${hostip}:2379 " >> /home/${USER}/postgresql.yml
echo " username: ${ETCD_USER} " >> /home/${USER}/postgresql.yml
echo " password: ${ETCD_PASSWD} " >> /home/${USER}/postgresql.yml
echo "bootstrap: " >> /home/${USER}/postgresql.yml
echo " dcs: " >> /home/${USER}/postgresql.yml
echo " ttl: 30 " >> /home/${USER}/postgresql.yml
echo " loop_wait: 10 " >> /home/${USER}/postgresql.yml
echo " retry_timeout: 10 " >> /home/${USER}/postgresql.yml
echo " maximum_lag_on_failover: 1048576 " >> /home/${USER}/postgresql.yml
echo " postgresql: " >> /home/${USER}/postgresql.yml
echo " use_pg_rewind: true " >> /home/${USER}/postgresql.yml
echo " use_slots: true " >> /home/${USER}/postgresql.yml
echo " parameters: " >> /home/${USER}/postgresql.yml
echo " initdb: " >> /home/${USER}/postgresql.yml
echo " - encoding: UTF8 " >> /home/${USER}/postgresql.yml
echo " - data-checksums " >> /home/${USER}/postgresql.yml
echo " pg_hba: " >> /home/${USER}/postgresql.yml
echo " - host replication ${USER} 0.0.0.0/0 md5 " >> /home/${USER}/postgresql.yml
echo " - host all all 0.0.0.0/0 md5 " >> /home/${USER}/postgresql.yml
echo "postgresql: " >> /home/${USER}/postgresql.yml
echo " listen: 0.0.0.0:5432 " >> /home/${USER}/postgresql.yml
echo " connect_address: ${hostip}:5432 " >> /home/${USER}/postgresql.yml
echo " data_dir: ${PG_DATADIR} " >> /home/${USER}/postgresql.yml
echo " bin_dir: ${PG_BINDIR} " >> /home/${USER}/postgresql.yml
echo " pgpass: /tmp/pgpass " >> /home/${USER}/postgresql.yml
echo " authentication: " >> /home/${USER}/postgresql.yml
echo " replication: " >> /home/${USER}/postgresql.yml
echo " username: ${USER} " >> /home/${USER}/postgresql.yml
echo " password: ${PASSWD} " >> /home/${USER}/postgresql.yml
echo " superuser: " >> /home/${USER}/postgresql.yml
echo " username: ${USER} " >> /home/${USER}/postgresql.yml
echo " password: ${PASSWD} " >> /home/${USER}/postgresql.yml
echo " rewind: " >> /home/${USER}/postgresql.yml
echo " username: ${USER} " >> /home/${USER}/postgresql.yml
echo " password: ${PASSWD} " >> /home/${USER}/postgresql.yml
echo " parameters: " >> /home/${USER}/postgresql.yml
echo " unix_socket_directories: '.' " >> /home/${USER}/postgresql.yml
echo " wal_level: hot_standby " >> /home/${USER}/postgresql.yml
echo " max_wal_senders: 10 " >> /home/${USER}/postgresql.yml
echo " max_replication_slots: 10 " >> /home/${USER}/postgresql.yml
echo "tags: " >> /home/${USER}/postgresql.yml
echo " nofailover: false " >> /home/${USER}/postgresql.yml
echo " noloadbalance: false " >> /home/${USER}/postgresql.yml
echo " clonefrom: false " >> /home/${USER}/postgresql.yml
echo " nosync: false " >> /home/${USER}/postgresql.yml
}
#........ 省略部分內(nèi)容
構(gòu)建鏡像
docker build -t patroni .
運(yùn)行鏡像
運(yùn)行容器節(jié)點(diǎn)1：
docker run --privileged --name patroni1 -itd --hostname patroni1 --net my_net3 --restart always --env ‘CLUSTER_NAME=patronicluster' --env ‘SERVICE_NAME=service' --env ‘ETCD_USER=etcduser' --env ‘ETCD_PASSWD=etcdpasswd' --env ‘PASSWD=zalando' --env ‘HOSTLIST=patroni1,patroni2,patroni3' --env ‘VIP=172.22.1.88' --env ‘NET_DEVICE=eth0' --env ‘ETCD_COUNT=3' patroni
運(yùn)行容器節(jié)點(diǎn)2：
docker run --privileged --name patroni2 -itd --hostname patroni2 --net my_net3 --restart always --env ‘CLUSTER_NAME=patronicluster' --env ‘SERVICE_NAME=service' --env ‘ETCD_USER=etcduser' --env ‘ETCD_PASSWD=etcdpasswd' --env ‘PASSWD=zalando' --env ‘HOSTLIST=patroni1,patroni2,patroni3' --env ‘VIP=172.22.1.88' --env ‘NET_DEVICE=eth0' --env ‘ETCD_COUNT=3' patroni
運(yùn)行容器節(jié)點(diǎn)3：
docker run --privileged --name patroni3 -itd --hostname patroni3 --net my_net3 --restart always --env ‘CLUSTER_NAME=patronicluster' --env ‘SERVICE_NAME=service' --env ‘ETCD_USER=etcduser' --env ‘ETCD_PASSWD=etcdpasswd' --env ‘PASSWD=zalando' --env ‘HOSTLIST=patroni1,patroni2,patroni3' --env ‘VIP=172.22.1.88' --env ‘NET_DEVICE=eth0' --env ‘ETCD_COUNT=3' patroni
總結(jié)
本操作過(guò)程僅限于試驗(yàn)環(huán)境，為了演示etcd+patroni+vipmanager整體的容器化搭建。在真實(shí)環(huán)境下，etcd應(yīng)該部署在不同容器下，形成獨(dú)立的分布式集群，并且PG的存儲(chǔ)應(yīng)該映射到本地磁盤(pán)或網(wǎng)絡(luò)磁盤(pán)，另外容器集群的搭建盡量使用編排工具，例如docker-compose、docker-warm或者Kubernetes等。
附圖
etcd集群狀態(tài)如圖：
patroni集群狀態(tài)如圖：
vip-manager狀態(tài)如圖：
到此這篇關(guān)于深入淺析Docker容器中的Patroni的文章就介紹到這了,更多相關(guān)Docker容器Patroni內(nèi)容請(qǐng)搜索本站以前的文章或繼續(xù)瀏覽下面的相關(guān)文章希望大家以后多多支持本站！
版權(quán)聲明：本站文章來(lái)源標(biāo)注為YINGSOO的內(nèi)容版權(quán)均為本站所有，歡迎引用、轉(zhuǎn)載，請(qǐng)保持原文完整并注明來(lái)源及原文鏈接。禁止復(fù)制或仿造本網(wǎng)站，禁止在非www.sddonglingsh.com所屬的服務(wù)器上建立鏡像，否則將依法追究法律責(zé)任。本站部分內(nèi)容來(lái)源于網(wǎng)友推薦、互聯(lián)網(wǎng)收集整理而來(lái)，僅供學(xué)習(xí)參考，不代表本站立場(chǎng)，如有內(nèi)容涉嫌侵權(quán)，請(qǐng)聯(lián)系alex-e#qq.com處理。
關(guān)注官方微信