logo
publist
写文章

简介

该用户还未填写简介

擅长的技术栈

可提供的服务

暂无可提供的服务

hadoop3.2.2集群搭建

说明:本文以HDFS High Availability Using the Quorum Journal Manager模式搭建hadoop3.2.0集群。环境CentOS7、jdk1.8.0_181、zookeeper3.4.13、hadoop3.2.0虚拟机安装CentOS7三台,如下:hostnameIPstorm192.168.56.200st...

#zookeeper#hadoop#hdfs
flink on yarn集群搭建

环境需求CentOS7.5.1804、jdk1.8.0_181、zookeeper3.6.2、hadoop3.2.2、flink1.12.2关于hadoop的安装细节请查看《hadoop3.2.2集群搭建》集群部署下载flink-1.12.2的安装包,下载地址:https://archive.apache.org/dist/flink/flink-1.12.2/,如下图下载scala-2.12.1

#flink
hadoop3.2.2集群搭建

说明:本文以HDFS High Availability Using the Quorum Journal Manager模式搭建hadoop3.2.0集群。环境CentOS7、jdk1.8.0_181、zookeeper3.4.13、hadoop3.2.0虚拟机安装CentOS7三台,如下:hostnameIPstorm192.168.56.200st...

#zookeeper#hadoop#hdfs
Spark Streaming整合Kafka

Spark Streaming整合Kafka开发:Spark Streaming从Kafka中接收数据,这里将会介绍两种方法:(1)、使用Receivers和Kafka高层次的API;(2)、使用DirectAPI,这是使用低层次的KafkaAPI,并没有使用到Receivers,是Spark 1.3.0中开始引入的。这两种方法有不同的编程模型。一、基于Receivers的方法这

#spark
Recurrent Neural Networks Tutorial, Part 2 – Implementing a RNN with Python, Numpy and Theano

 Code to follow along is on Github.In this part we will implement a full Recurrent Neural Network from scratch using Python and optimize our implementation using Theano, a library to perform operati..

到底了