一.pom.xml<dependencies><dependency><groupId>org.apache.spark</groupId><artifactId>spark-core_2.12</artifactId><version>2.4.3</version></dependenc

前述:由于自己搜索了网上的所有单机部署,没有一个是可靠,于是研究了下,成功了自己记录方便以后使用. 版本是hbase-2.0.5-bin.tar.gzhbase-env.shexport JAVA_HOME=/opt/soft/jdk1.8.0_141export HBASE_MANAGES_ZK=falsehbase-site.xml<configuration><proper

一.编写 MqttClient类class MqttClient {var url:String="tcp://192.168.174.206:1883"var flag:Boolean=trueprivate val topicArr: Array[Topic] = List(new Topic("topic_test",QoS.AT_LEAST_ONCE),new Topic("topic_t

org.apache.rocketmq.remoting.exception.RemotingConnectException: connect to <rocketmq-nameserver2:9876> failedat org.apache.rocketmq.remoting.netty.NettyRemotingClient.invokeSync(NettyRemotingCl

1.路径报错org.apache.spark.sql.AnalysisException: Unable to infer schema for Parquet. It must be specified manually.;org.apache.hudi.exception.HoodieException: 'path' must be specified.org.apache.hudi.exc

查看nn1的状态hdfs haadmin -getServiceState nn1将nn1强制转换为Activehdfs haadmin -transitionToActive --forcemanual nn1将nn2强制转换为standbyhdfs haadmin -transitionToStandby --forcemanual nn2

flinkelasticsearch sink 目前我这边电脑资源不够耍,写入虚拟机很慢数据有差异.1.data 数据sensor_1,1547718199,35.8sensor_6,1547718201,15.4sensor_7,1547718202,6.7sensor_10,1547718205,38.1sensor_1,1547718207,36.3sensor_1,1547718209,3

1.安装依赖软件(依赖软件根据centos7 自带的情况 可能会有补充)yum -y install policycoreutils openssh-server openssh-clients postfixyum install policycoreutils-python2.设置postfix开机自启动,postfix支持gitlab发信功能.systemctl enable postfix