1.容器被驱逐，首先比较直观的是查看EventThe node was low on resource: ephemeral-storage.Container zk was using 910316Ki, which exceeds its request of 0.2.原因cat /etc/docker/daemon.json{"exec-opts": ["native.cgroupdrive

1、环境单台虚拟机centos7、docker1.82、结构&组件3、安装反向代理：nginx(可以不用，本身它有代理服务)验证服务：启动一个容器centos:latest安装ldap做验证服务器元数据库：这里用mariadbhub服务：启动一个容器centos:latest 用pip安装jupyterhub...

json日志使用拦截器，字段取出放到header里a1.sources.r1.interceptors = i1a1.sources.r1.interceptors.i1.type = regex_extractora1.sources.r1.interceptors.i1.regex = "自定义字段":"(\\w+)"a1.sources.r1.interceptors

1.生产集群若是是Spark/Yarn，方便集成(docker内部链接到现有spark on yarn集群)2.自定义镜像2.1 work机上安装python3.7 link到/opt/conda/bin/pythonFROM jupyter/all-spark-notebook:2ce7c06a61a1ENV HADOOP_HOME /usr/local/hadoop...

airflow流程中断1.概要在airflow流程中，有时候需要按条件中断，这里借助分支实现2.示例zk和kafka部署(下图只部署kafka)。3种情况 1-只部署zk | 2-只部署kafka |3-同时部署3.BranchPythonOperator# !/usr/bin/python#-*- coding: utf-8 -*-import jsonfrom airflow import D

#!/usr/bin/python# -*- coding: UTF-8 -*-import jsonimport requestshost='自己域名'login_url =host+"/hub/login"r = requests.post(login_url, data={'username': 'tom', 'password': '123456'}, allow_re...