Package org.apache.zookeeper.server
Class NIOServerCnxnFactory
- java.lang.Object
-
- org.apache.zookeeper.server.ServerCnxnFactory
-
- org.apache.zookeeper.server.NIOServerCnxnFactory
-
- Direct Known Subclasses:
ControllableConnectionFactory
public class NIOServerCnxnFactory extends ServerCnxnFactory
NIOServerCnxnFactory implements a multi-threaded ServerCnxnFactory using NIO non-blocking socket calls. Communication between threads is handled via queues. - 1 accept thread, which accepts new connections and assigns to a selector thread - 1-N selector threads, each of which selects on 1/N of the connections. The reason the factory supports more than one selector thread is that with large numbers of connections, select() itself can become a performance bottleneck. - 0-M socket I/O worker threads, which perform basic socket reads and writes. If configured with 0 worker threads, the selector threads do the socket I/O directly. - 1 connection expiration thread, which closes idle connections; this is necessary to expire connections on which no session is established. Typical (default) thread counts are: on a 32 core machine, 1 accept thread, 1 connection expiration thread, 4 selector threads, and 64 worker threads.
-
-
Nested Class Summary
Nested Classes Modifier and Type Class Description classNIOServerCnxnFactory.SelectorThreadThe SelectorThread receives newly accepted connections from the AcceptThread and is responsible for selecting for I/O readiness across the connections.
-
Field Summary
Fields Modifier and Type Field Description protected intmaxClientCnxnsprotected WorkerServiceworkerPoolstatic StringZOOKEEPER_NIO_DIRECT_BUFFER_BYTESDefault: 64kBstatic StringZOOKEEPER_NIO_NUM_SELECTOR_THREADSWith 500 connections to an observer with watchers firing on each, is unable to exceed 1GigE rates with only 1 selector.static StringZOOKEEPER_NIO_NUM_WORKER_THREADSDefault: 2 * numCoresstatic StringZOOKEEPER_NIO_SESSIONLESS_CNXN_TIMEOUTDefault sessionless connection timeout in ms: 10000 (10s)static StringZOOKEEPER_NIO_SHUTDOWN_TIMEOUTDefault worker pool shutdown timeout in ms: 5000 (5s)-
Fields inherited from class org.apache.zookeeper.server.ServerCnxnFactory
cnxns, login, maxCnxns, saslServerCallbackHandler, secure, zkServer, ZOOKEEPER_MAX_CONNECTION_DEFAULT, ZOOKEEPER_SERVER_CNXN_FACTORY
-
-
Constructor Summary
Constructors Constructor Description NIOServerCnxnFactory()Construct a new server connection factory which will accept an unlimited number of concurrent connections from each client (up to the file descriptor limits of the operating system).
-
Method Summary
All Methods Static Methods Instance Methods Concrete Methods Modifier and Type Method Description voidcloseAll(ServerCnxn.DisconnectReason reason)clear all the connections in the selectorvoidconfigure(InetSocketAddress addr, int maxcc, int backlog, boolean secure)protected NIOServerCnxncreateConnection(SocketChannel sock, SelectionKey sk, NIOServerCnxnFactory.SelectorThread selectorThread)voiddumpConnections(PrintWriter pwriter)Iterable<Map<String,Object>>getAllConnectionInfo(boolean brief)Iterable<ServerCnxn>getConnections()static ByteBuffergetDirectBuffer()InetSocketAddressgetLocalAddress()intgetLocalPort()intgetMaxClientCnxnsPerHost()Maximum number of connections allowed from particular host (ip)intgetSocketListenBacklog()The maximum queue length of the ZooKeeper server's socketvoidjoin()voidreconfigure(InetSocketAddress addr)booleanremoveCnxn(NIOServerCnxn cnxn)De-registers the connection from the various mappings maintained by the factory.voidresetAllConnectionStats()voidsetMaxClientCnxnsPerHost(int max)Maximum number of connections allowed from particular host (ip)voidshutdown()voidstart()voidstartup(ZooKeeperServer zks, boolean startServer)voidstop()voidtouchCnxn(NIOServerCnxn cnxn)Add or update cnxn in our cnxnExpiryQueue-
Methods inherited from class org.apache.zookeeper.server.ServerCnxnFactory
addSession, closeSession, configure, configure, configureSaslLogin, createFactory, createFactory, createFactory, createFactory, createFactory, getMaxCnxns, getNumAliveConnections, getUserName, getZooKeeperServer, initMaxCnxns, isSecure, limitTotalNumberOfCnxns, registerConnection, removeCnxnFromSessionMap, setZooKeeperServer, startup, unregisterConnection
-
-
-
-
Field Detail
-
ZOOKEEPER_NIO_SESSIONLESS_CNXN_TIMEOUT
public static final String ZOOKEEPER_NIO_SESSIONLESS_CNXN_TIMEOUT
Default sessionless connection timeout in ms: 10000 (10s)- See Also:
- Constant Field Values
-
ZOOKEEPER_NIO_NUM_SELECTOR_THREADS
public static final String ZOOKEEPER_NIO_NUM_SELECTOR_THREADS
With 500 connections to an observer with watchers firing on each, is unable to exceed 1GigE rates with only 1 selector. Defaults to using 2 selector threads with 8 cores and 4 with 32 cores. Expressed as sqrt(numCores/2). Must have at least 1 selector thread.- See Also:
- Constant Field Values
-
ZOOKEEPER_NIO_NUM_WORKER_THREADS
public static final String ZOOKEEPER_NIO_NUM_WORKER_THREADS
Default: 2 * numCores- See Also:
- Constant Field Values
-
ZOOKEEPER_NIO_DIRECT_BUFFER_BYTES
public static final String ZOOKEEPER_NIO_DIRECT_BUFFER_BYTES
Default: 64kB- See Also:
- Constant Field Values
-
ZOOKEEPER_NIO_SHUTDOWN_TIMEOUT
public static final String ZOOKEEPER_NIO_SHUTDOWN_TIMEOUT
Default worker pool shutdown timeout in ms: 5000 (5s)- See Also:
- Constant Field Values
-
maxClientCnxns
protected int maxClientCnxns
-
workerPool
protected WorkerService workerPool
-
-
Method Detail
-
getDirectBuffer
public static ByteBuffer getDirectBuffer()
-
configure
public void configure(InetSocketAddress addr, int maxcc, int backlog, boolean secure) throws IOException
- Specified by:
configurein classServerCnxnFactory- Throws:
IOException
-
reconfigure
public void reconfigure(InetSocketAddress addr)
- Specified by:
reconfigurein classServerCnxnFactory
-
getMaxClientCnxnsPerHost
public int getMaxClientCnxnsPerHost()
Maximum number of connections allowed from particular host (ip)- Specified by:
getMaxClientCnxnsPerHostin classServerCnxnFactory
-
setMaxClientCnxnsPerHost
public void setMaxClientCnxnsPerHost(int max)
Maximum number of connections allowed from particular host (ip)- Specified by:
setMaxClientCnxnsPerHostin classServerCnxnFactory
-
getSocketListenBacklog
public int getSocketListenBacklog()
The maximum queue length of the ZooKeeper server's socket- Specified by:
getSocketListenBacklogin classServerCnxnFactory
-
start
public void start()
- Specified by:
startin classServerCnxnFactory
-
startup
public void startup(ZooKeeperServer zks, boolean startServer) throws IOException, InterruptedException
- Specified by:
startupin classServerCnxnFactory- Throws:
IOExceptionInterruptedException
-
getLocalAddress
public InetSocketAddress getLocalAddress()
- Specified by:
getLocalAddressin classServerCnxnFactory
-
getLocalPort
public int getLocalPort()
- Specified by:
getLocalPortin classServerCnxnFactory
-
removeCnxn
public boolean removeCnxn(NIOServerCnxn cnxn)
De-registers the connection from the various mappings maintained by the factory.
-
touchCnxn
public void touchCnxn(NIOServerCnxn cnxn)
Add or update cnxn in our cnxnExpiryQueue- Parameters:
cnxn-
-
createConnection
protected NIOServerCnxn createConnection(SocketChannel sock, SelectionKey sk, NIOServerCnxnFactory.SelectorThread selectorThread) throws IOException
- Throws:
IOException
-
closeAll
public void closeAll(ServerCnxn.DisconnectReason reason)
clear all the connections in the selector- Specified by:
closeAllin classServerCnxnFactory
-
stop
public void stop()
-
shutdown
public void shutdown()
- Specified by:
shutdownin classServerCnxnFactory
-
join
public void join() throws InterruptedException- Specified by:
joinin classServerCnxnFactory- Throws:
InterruptedException
-
getConnections
public Iterable<ServerCnxn> getConnections()
- Specified by:
getConnectionsin classServerCnxnFactory
-
dumpConnections
public void dumpConnections(PrintWriter pwriter)
-
resetAllConnectionStats
public void resetAllConnectionStats()
- Specified by:
resetAllConnectionStatsin classServerCnxnFactory
-
getAllConnectionInfo
public Iterable<Map<String,Object>> getAllConnectionInfo(boolean brief)
- Specified by:
getAllConnectionInfoin classServerCnxnFactory
-
-