ZooKeeper安装运行
ZooKeeper介绍 ZooKeeper是Hadoop的正式子项目,它是一个针对大型分布式系统的可靠协调系统,提供的功能包括:配置维护、名字服务、分布式同步、组服务等。ZooKeeper的目标就是封装好复杂易出错的关键服务,将简单易用的接口和性能高效、功能稳定的系统提供给用户。Zookeeper是Google的Chubby一个开源的实现.是高有效和可靠的协同工作系统.Zookeeper能够用
ZooKeeper介绍
ZooKeeper是Hadoop的正式子项目,它是一个针对大型分布式系统的可靠协调系统,提供的功能包括:配置维护、名字服务、分布式同步、组服务等。ZooKeeper的目标就是封装好复杂易出错的关键服务,将简单易用的接口和性能高效、功能稳定的系统提供给用户。
Zookeeper是Google的Chubby一个开源的实现.是高有效和可靠的协同工作系统.Zookeeper能够用来leader选举,配置信息维护等.在一个分布式的环境中,我们需要一个Master实例或存储一些配置信息,确保文件写入的一致性等.Zookeeper能够保证如下3点:
- Watches are ordered with respect to other events, other watches, and
asynchronous replies. The ZooKeeper client libraries ensures that
everything is dispatched in order. - A client will see a watch event for a znode it is watching before seeing the new data that corresponds to that znode.
- The order of watch events from ZooKeeper corresponds to the order of the updates as seen by the ZooKeeper service.
在Zookeeper中,znode是一个跟Unix文件系统路径相似的节点,可以往这个节点存储或获取数据.如果在创建znode时Flag设置 为EPHEMERAL,那么当这个创建这个znode的节点和Zookeeper失去连接后,这个znode将不再存在在Zookeeper 里.Zookeeper使用Watcher察觉事件信息,当客户端接收到事件信息,比如连接超时,节点数据改变,子节点改变,可以调用相应的行为来处理数 据.Zookeeper的Wiki页面展示了如何使用Zookeeper来处理事件通知,队列,优先队列,锁,共享锁,可撤销的共享锁,两阶段提交.
ZooKeeper官网
ZooKeeper安装
首先下载最新版 zookeeper-3.4.5.tar.gz
然后解压
tar zxvf zookeeper-3.4.5.tar.gz
然后进入conf目录修改zoo_sample.cfg为zoo.cfg
然后vi zoo.cfg
更改为:
# The number of milliseconds of each tick
tickTime=2000
# The number of ticks that the initial
# synchronization phase can take
initLimit=10
# The number of ticks that can pass between
# sending a request and getting an acknowledgement
syncLimit=5
# the directory where the snapshot is stored.
# do not use /tmp for storage, /tmp here is just
# example sakes.
dataDir=/tmp/zookeeper
# the port at which the clients will connect
clientPort=2181
#
# Be sure to read the maintenance section of the
# administrator guide before turning on autopurge.
#
# http://zookeeper.apache.org/doc/current/zookeeperAdmin.html#sc_maintenance
#
# The number of snapshots to retain in dataDir
#autopurge.snapRetainCount=3
# Purge task interval in hours
# Set to "0" to disable auto purge feature
#autopurge.purgeInterval=1
编辑保存后进入bin目录执行
./zkServer.sh start
ZooKeeper测试
[root@localhost bin]# ./zkCli.sh
Connecting to localhost:2181
2013-01-16 14:36:22,484 [myid:] - INFO [main:Environment@100] - Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
2013-01-16 14:36:22,488 [myid:] - INFO [main:Environment@100] - Client environment:host.name=localhost.localdomain
2013-01-16 14:36:22,489 [myid:] - INFO [main:Environment@100] - Client environment:java.version=1.6.0_29
2013-01-16 14:36:22,489 [myid:] - INFO [main:Environment@100] - Client environment:java.vendor=Sun Microsystems Inc.
2013-01-16 14:36:22,490 [myid:] - INFO [main:Environment@100] - Client environment:java.home=/usr/java/jdk1.6.0_29/jre
2013-01-16 14:36:22,490 [myid:] - INFO [main:Environment@100] - Client environment:java.class.path=/usr/local/zookeeper-3.4.5/bin/../build/classes:/usr/local/zookeeper-3.4.5/bin/../build/lib/*.jar:/usr/local/zookeeper-3.4.5/bin/../lib/slf4j-log4j12-1.6.1.jar:/usr/local/zookeeper-3.4.5/bin/../lib/slf4j-api-1.6.1.jar:/usr/local/zookeeper-3.4.5/bin/../lib/netty-3.2.2.Final.jar:/usr/local/zookeeper-3.4.5/bin/../lib/log4j-1.2.15.jar:/usr/local/zookeeper-3.4.5/bin/../lib/jline-0.9.94.jar:/usr/local/zookeeper-3.4.5/bin/../zookeeper-3.4.5.jar:/usr/local/zookeeper-3.4.5/bin/../src/java/lib/*.jar:/usr/local/zookeeper-3.4.5/bin/../conf:./:/usr/java/jdk1.6.0_29/lib:/usr/java/jdk1.6.0_29/jre/lib
2013-01-16 14:36:22,491 [myid:] - INFO [main:Environment@100] - Client environment:java.library.path=/usr/java/jdk1.6.0_29/jre/lib/i386/client:/usr/java/jdk1.6.0_29/jre/lib/i386:/usr/java/jdk1.6.0_29/jre/../lib/i386:/usr/java/packages/lib/i386:/lib:/usr/lib
2013-01-16 14:36:22,491 [myid:] - INFO [main:Environment@100] - Client environment:java.io.tmpdir=/tmp
2013-01-16 14:36:22,491 [myid:] - INFO [main:Environment@100] - Client environment:java.compiler=<NA>
2013-01-16 14:36:22,492 [myid:] - INFO [main:Environment@100] - Client environment:os.name=Linux
2013-01-16 14:36:22,492 [myid:] - INFO [main:Environment@100] - Client environment:os.arch=i386
2013-01-16 14:36:22,493 [myid:] - INFO [main:Environment@100] - Client environment:os.version=2.6.18-308.24.1.el5
2013-01-16 14:36:22,493 [myid:] - INFO [main:Environment@100] - Client environment:user.name=root
2013-01-16 14:36:22,493 [myid:] - INFO [main:Environment@100] - Client environment:user.home=/root
2013-01-16 14:36:22,494 [myid:] - INFO [main:Environment@100] - Client environment:user.dir=/usr/local/zookeeper-3.4.5/bin
2013-01-16 14:36:22,496 [myid:] - INFO [main:ZooKeeper@438] - Initiating client connection, connectString=localhost:2181 sessionTimeout=30000 watcher=org.apache.zookeeper.ZooKeeperMain$MyWatcher@5ffb18
Welcome to ZooKeeper!
2013-01-16 14:36:22,592 [myid:] - INFO [main-SendThread(localhost.localdomain:2181):ClientCnxn$SendThread@966] - Opening socket connection to server localhost.localdomain/127.0.0.1:2181. Will not attempt to authenticate using SASL (无法定位登录配置)
2013-01-16 14:36:22,601 [myid:] - INFO [main-SendThread(localhost.localdomain:2181):ClientCnxn$SendThread@849] - Socket connection established to localhost.localdomain/127.0.0.1:2181, initiating session
JLine support is enabled
2013-01-16 14:36:22,693 [myid:] - INFO [main-SendThread(localhost.localdomain:2181):ClientCnxn$SendThread@1207] - Session establishment complete on server localhost.localdomain/127.0.0.1:2181, sessionid = 0x13c3c5224cc0000, negotiated timeout = 30000
WATCHER::
WatchedEvent state:SyncConnected type:None path:null
[zk: localhost:2181(CONNECTED) 0] help
ZooKeeper -server host:port cmd args
connect host:port
get path [watch]
ls path [watch]
set path data [version]
rmr path
delquota [-n|-b] path
quit
printwatches on|off
create [-s] [-e] path data acl
stat path [watch]
close
ls2 path [watch]
history
listquota path
setAcl path acl
getAcl path
sync path
redo cmdno
addauth scheme auth
delete path [version]
setquota -n|-b val path
[zk: localhost:2181(CONNECTED) 1] create /my_data "data.ch.com"
Created /my_data
[zk: localhost:2181(CONNECTED) 2] get /my_data
"data.ch.com"
cZxid = 0x2
ctime = Wed Jan 16 14:38:20 CST 2013
mZxid = 0x2
mtime = Wed Jan 16 14:38:20 CST 2013
pZxid = 0x2
cversion = 0
dataVersion = 0
aclVersion = 0
ephemeralOwner = 0x0
dataLength = 13
numChildren = 0
[zk: localhost:2181(CONNECTED) 3] set /my_date "123456.com"
Node does not exist: /my_date
[zk: localhost:2181(CONNECTED) 4] set /my_data "123456.com"
cZxid = 0x2
ctime = Wed Jan 16 14:38:20 CST 2013
mZxid = 0x4
mtime = Wed Jan 16 14:38:58 CST 2013
pZxid = 0x2
cversion = 0
dataVersion = 1
aclVersion = 0
ephemeralOwner = 0x0
dataLength = 12
numChildren = 0
[zk: localhost:2181(CONNECTED) 5] get /my_data
"123456.com"
cZxid = 0x2
ctime = Wed Jan 16 14:38:20 CST 2013
mZxid = 0x4
mtime = Wed Jan 16 14:38:58 CST 2013
pZxid = 0x2
cversion = 0
dataVersion = 1
aclVersion = 0
ephemeralOwner = 0x0
dataLength = 12
numChildren = 0
[zk: localhost:2181(CONNECTED) 6] create /mytemp "你好吗"
Created /mytemp
[zk: localhost:2181(CONNECTED) 7] get /myt
Node does not exist: /myt
[zk: localhost:2181(CONNECTED) 8] get /mytemp
"你好吗"
cZxid = 0x5
ctime = Wed Jan 16 14:40:44 CST 2013
mZxid = 0x5
mtime = Wed Jan 16 14:40:44 CST 2013
pZxid = 0x5
cversion = 0
dataVersion = 0
aclVersion = 0
ephemeralOwner = 0x0
dataLength = 11
numChildren = 0
[zk: localhost:2181(CONNECTED) 9] get /mytemp
"你好吗"
cZxid = 0x5
ctime = Wed Jan 16 14:40:44 CST 2013
mZxid = 0x5
mtime = Wed Jan 16 14:40:44 CST 2013
pZxid = 0x5
cversion = 0
dataVersion = 0
aclVersion = 0
ephemeralOwner = 0x0
dataLength = 11
numChildren = 0
[zk: localhost:2181(CONNECTED) 10] get /my_data
"123456.com"
cZxid = 0x2
ctime = Wed Jan 16 14:38:20 CST 2013
mZxid = 0x4
mtime = Wed Jan 16 14:38:58 CST 2013
pZxid = 0x2
cversion = 0
dataVersion = 1
aclVersion = 0
ephemeralOwner = 0x0
dataLength = 12
numChildren = 0
[zk: localhost:2181(CONNECTED) 11] ls
ZooKeeper -server host:port cmd args
connect host:port
get path [watch]
ls path [watch]
set path data [version]
rmr path
delquota [-n|-b] path
quit
printwatches on|off
create [-s] [-e] path data acl
stat path [watch]
close
ls2 path [watch]
history
listquota path
setAcl path acl
getAcl path
sync path
redo cmdno
addauth scheme auth
delete path [version]
setquota -n|-b val path
[zk: localhost:2181(CONNECTED) 12]
更多推荐
所有评论(0)