Your IP : 216.73.216.213
�D�ZG � @ s� d d l Z d d l Z d d l m Z d d l m Z d d l m Z d d l m Z d d l
m Z m Z d d l
m Z m Z m Z m Z m Z m Z e � Z e j d � Z d
d d d d d d
d d d d d d d d d d d d d � Z Gd d � d � Z Gd d � d e � Z d d � Z Gd d � d e � Z Gd d! � d! e � Z Gd" d# � d# e � Z Gd$ d% � d% e � Z d S)&� N)�
ALL_COMPLETED)�timeout� )�sentinel_logger)�Receiver)� create_pool�ConnectionsPool)�MasterNotFoundError�SlaveNotFoundError�PoolClosedError�
RedisError�MasterReplyError�SlaveReplyError�monitor�db�password�encoding�minsize� �maxsize�
�ssl�parserr g�������?�loopc � s� t | t t f � s! t | � � | d k r9 t j � } t | d | d | d | d | d | d | d | d | d
| � }
|
j � Id H|
S) zCreate SentinelPool.Nr r r r r r r r r )�
isinstance�list�tuple�AssertionError�asyncio�get_event_loop� SentinelPool�discover) � sentinelsr r r r r r r r r �pool� r$ �G/opt/alt/python35/lib/python3.5/site-packages/aioredis/sentinel/pool.py�create_sentinel_pool s ! r& c @ s e Z d Z d Z d d d d d d d d d d d d d d
� Z e d d � � Z d
d � Z d d � Z d d � Z e d d � � Z
d d � Z d d � Z d d � Z
d d d � Z d d � Z d d � Z d! d" � Z d# d$ � Z d% d& � Z d' d( � Z d) d* � Z d S)+r z�Sentinel connections pool.
Holds connection pools to known and discovered (TBD) Sentinels
as well as services' connections.
r Nr r r r r c s� |
d k r t j � }
t | � � _ |
� _ | � _ g � _ i � _ i � _ | � _ | � _
| � _ | � _ | � _
| � _ | � _ t j d |
� � _ d � _ t d |
� � _ � � � f d d � } t j | � d |
�� _ d S)Nr c � s� y� x� � j � Id Hr� � j d d � Id H\ } \ } } | j d � } t j d | | � | d k r | j d � ^ } } } | d k r � j | � q WWn t j k
r� Yn Xd S)Nr zutf-8z%s: %s�+odown� �master)r' ) Z wait_message�get�decode�_logger�debug�split�_need_rediscoverr �CancelledError)�chZev�data�typ�name�tail)r �selfr$ r% � echo_eventsR s # z*SentinelPool.__init__.<locals>.echo_events)r r �set�
_sentinels�_loop�_timeout�_pools�_masters�_slaves�
_parser_class� _redis_db�_redis_password�
_redis_ssl�_redis_encoding�_redis_minsize�_redis_maxsize�Event� _close_state�
_close_waiterr �_monitor�
ensure_future�
_monitor_task) r6 r" r r r r r r r r r r7 r$ )r r6 r% �__init__7 s( zSentinelPool.__init__c C s | j S)zjTimeout (seconds) for Redis/Sentinel command calls during
master/slave address discovery.
)r; )r6 r$ r$ r% �discover_timeoutk s z SentinelPool.discover_timeoutc C s~ | | j k rs t | | d d d | j d | j d | j d | j d | j d | j d | j d
| j � | j | <| j | S) z7Returns wrapper to master's pool for requested service.� is_masterTr r r r r r r r )
r= � ManagedPoolr@ rA rC rD rE rB r? r: )r6 �servicer$ r$ r% �
master_forr s zSentinelPool.master_forc C s~ | | j k rs t | | d d d | j d | j d | j d | j d | j d | j d | j d
| j � | j | <| j | S) z6Returns wrapper to slave's pool for requested service.rN Fr r r r r r r r )
r> rO r@ rA rC rD rE rB r? r: )r6 rP r$ r$ r% � slave_for� s zSentinelPool.slave_forc O s= | j r t d � � x! | j D] } | j | | | � SWd S)zExecute sentinel command.zSentinel pool is closedN)�closedr r< �execute)r6 �command�args�kwargsr# r$ r$ r% rT � s zSentinelPool.executec C s
| j j � S)z"True if pool is closed or closing.)rG �is_set)r6 r$ r$ r% rS � s zSentinelPool.closedc C sA | j j � s= t j | j � d | j �| _ | j j � d S)z;Close all controlled connections (both sentinel and redis).r N)rG rX r rJ � _do_closer: rH r8 )r6 r$ r$ r% �close� s zSentinelPool.closec � s$ | j j � Id Hg } | j d } | _ | j � | j | � x< | j r� | j j d � } | j � | j | j � � qE Wx? | j r� | j j
� \ } } | j � | j | j � � q� Wx? | j r| j j
� \ } } | j � | j | j � � q� Wt j
| d | j � Id Hd S)Nr r )rG �waitrK �cancel�appendr< �poprZ � wait_closedr= �popitemr> r Zgatherr: )r6 �tasks�taskr# �_r$ r$ r% rY � s$
zSentinelPool._do_closec � sI | j j � Id H| j d k s' t � t j | j d | j �Id Hd S)z Wait until pool gets closed.Nr )rG r[ rH r r Zshieldr: )r6 r$ r$ r% r_ � s zSentinelPool.wait_closedc
� sa | d k r | j } g } g } x- | j D]" } | j | j | | | � � q+ Wt j | d | j d t �Id H\ } } | s� t d | | f � � x, | D]$ } | j � } t
| t � r� q� q� W| s� t d � � | j d d � | } | j d d � <x' | D] } | j
� | j � Id HqWx2 | j D]' } | j d | j j d � � Id Hq2Wd S)u� Discover sentinels and all monitored services within given timeout.
If no sentinels discovered within timeout: TimeoutError is raised.
If some sentinels were discovered but not all — it is ok.
If not all monitored services (masters/slaves) discovered
(or connections established) — it is ok.
TBD: what if some sentinels/services unreachable;
Nr Z return_whenz Expected all tasks to completez!Could not connect to any sentinels
psubscribe�*)rM r9 r] �_connect_sentinelr r[ r: r r �resultr � Exceptionr< rZ r_ Zexecute_pubsubrI �pattern)
r6 r ra �pools�addr�done�pendingrb rf r# r$ r$ r% r! � s,
'
zSentinelPool.discoverc � s� ya t | d | j ��4 t | d d d d d | j d | j �Id H} Wd QRX| j | � | SWnz t j k
r� } z t j d | | � | SWYd d } ~ Xn< t k
r� } z t j d | | � | SWYd d } ~ Xn Xd S)
zeTry to connect to specified Sentinel returning either
connections pool or exception.
r r r r r r Nz4Failed to connect to Sentinel(%r) within %ss timeoutz$Error connecting to Sentinel(%r): %r)
�
async_timeoutr: r r? r] r � TimeoutErrorr r- rg )r6 �addressr ri r# �errr$ r$ r% re � s"
z SentinelPool._connect_sentinelc � s� | } | j d d � } x�| D]�} y� t | d | j �� | j | | � Id H} Wd QRX| j | } t | d | j ��^ t j � �J } | j | � Id H} | j | j � | j
| d � Id H| j � Wd QRXWd QRX| SWq t j
k
r� � Yq t j k
rw Yq t k
rn}
z9 t j d | | |
� t j | d | j �Id Hw WYd d }
~
Xq t k
r�}
z t d j | � |
� � WYd d }
~
Xq t k
r�t j | d | j �Id Hw Yq Xq Wt d j | � � � d S)z/Perform Master discovery for specified service.Nr r) zDiscoverError(%r, %s): %rzService {} errorzNo master found for {})r< rm r: �_get_masters_addressr= �
contextlib� ExitStack�_create_new_connection�callbackrZ �_verify_service_role�pop_allr r0 rn �
DiscoverErrorr r- �sleepr r
�formatrg r ) r6 rP r � idle_timeoutri �sentinelro r# �stack�connrp r$ r$ r% �discover_master s<
*
z SentinelPool.discover_masterc � s� | } | j d d � } x�| D]�} y� t | d | j �� | j | | � Id H} Wd QRX| j | } t | d | j ��^ t j � �J } | j | � Id H}
| j |
j � | j
|
d � Id H| j � Wd QRXWd QRX|
SWq t j
k
r� � Yq t j k
rw Yq t k
rEt j | d | j �Id Hw Yq t k
r�} z t d j | � | � � WYd d } ~ Xq t k
r�t j | d | j �Id Hw Yq Xq Wt d j | � � � d S)z.Perform Slave discovery for specified service.Nr ZslavezService {} errorzNo slave found for {})r< rm r: �_get_slave_addressr> rr rs rt ru rZ rv rw r r0 rn rx ry r r rz rg r
) r6 rP r rW r{ ri r| ro r# r} r~ rp r$ r$ r% �discover_slave1 s8
*
zSentinelPool.discover_slavec � s� | j d d | d d �Id H} | s/ t � � t | � } | d t | d � f } t | d j d � � } d d
d h | @r� t | � � | S) Ns sentinels masterr zutf-8�ip�port�flags�,�s_down�o_down� disconnected)rT �UnknownService� make_dict�intr8 r. �BadState)r6 r| rP �statero r� r$ r$ r% rq R s z!SentinelPool._get_masters_addressc � s� | j d d | d d �Id H} | s/ t � � xm t t | � D]P } | d t | d � f } t | d j d � � } d d
d h | @r� q? | SWt | � � d S) Ns sentinels slavesr zutf-8r� r� r� r� r� r� r� )rT r� �mapr� r� r8 r. r� )r6 r| rP Zslavesr� ro r� r$ r$ r% r� a s z SentinelPool._get_slave_addressc � s: | j d d d �Id H} | d | k r6 t | � � d S)Ns roler zutf-8r )rT � RoleMismatch)r6 r~ Zrole�resr$ r$ r% rv p s z!SentinelPool._verify_service_rolec C sh t j d | � x' | j j � D] \ } } | j � q Wx' | j j � D] \ } } | j � qJ Wd S)NzMust redisover service %s)r r- r= �items�need_rediscoverr> )r6 rP r# r$ r$ r% r/ u s
z SentinelPool._need_rediscover)�__name__�
__module__� __qualname__�__doc__rL �propertyrM rQ rR rT rS rZ rY r_ r! re r r� rq r� rv r/ r$ r$ r$ r% r 0 s( 2 & 1 ! r c s� e Z d Z d d d d d d d d � f d d �Z e d d � � Z f � f d d � Z � f d
d � Z � f d d
� Z d f � f d d � Z � f d d � Z
d d � Z � S)rO Nr r c s} t � j t d | d | d | d | d | d |
d | d | �| j t k sU t � | | _ | | _ | | _ d | _ d S)
Nr r r r r r r r g�������?) �superrL �_NON_DISCOVERED�_addressr � _sentinel�_service�
_is_masterZ_discover_timeout) r6 r| rP rN r r r r r r r r )� __class__r$ r% rL s
zManagedPool.__init__c C s | j t k r d S| j S)N)r� r� )r6 r$ r$ r% ro � s zManagedPool.addressc s, | j t k r d t f St � j | | � S)N)r� r� r� �get_connection)r6 rU rV )r� r$ r% r� � s
zManagedPool.get_connectionc � s� | t k r� | j � Id H| j rM | j j | j d | j j �Id H} n& | j j | j d | j j �Id H} | j | _ t
j d | j | j � | St � j
| � Id HS)Nr z!Discoverred new address %r for %s)r� Z _do_clearr� r� r r� rM r� ro r� r r- r� rt )r6 ro r~ )r� r$ r% rt � s z"ManagedPool._create_new_connectionc s\ t | j � } t � j � | t | j � 8} | rX t j d | � | j j | j � d S)Nz1Dropped %d closed connnection(s); must rediscover) �lenZ_poolr� � _drop_closedr r- r� r/ r� )r6 Zdiff)r� r$ r% r� � s
zManagedPool._drop_closedc � s6 | j t k r | j � Id Ht � j | | � Id HS)N)r� r� �clearr� �acquire)r6 rU rV )r� r$ r% r� � s zManagedPool.acquirec sC | j } t � j | � | r? t j d � | j j | j � d S)Nz+Released closed connection; must rediscover)rS r� �releaser r- r� r/ r� )r6 r~ Z
was_closed)r� r$ r% r� � s zManagedPool.releasec C s
t | _ d S)N)r� r� )r6 r$ r$ r% r� � s zManagedPool.need_rediscover) r� r� r� rL r� ro r� rt r� r� r� r� r$ r$ )r� r% rO } s rO c C s t | � } t t | | � � S)N)�iter�dict�zip)Z
plain_list�itr$ r$ r% r� � s r� c @ s e Z d Z d Z d S)rx z-Internal errors for masters/slaves discovery.N)r� r� r� r� r$ r$ r$ r% rx � s rx c @ s e Z d Z d Z d S)r� z0Bad master's / slave's state read from sentinel.N)r� r� r� r� r$ r$ r$ r% r� � s r� c @ s e Z d Z d Z d S)r� z.Service is not monitored by specific sentinel.N)r� r� r� r� r$ r$ r$ r% r� � s r� c @ s e Z d Z d Z d S)r� z$Service reported to have other Role.N)r� r� r� r� r$ r$ r$ r% r� � s r� )!r rr Zconcurrent.futuresr rm r �logr Zpubsubr r# r r �errorsr r
r r r
r �objectr� ZgetChildr, r& r rO r� rg rx r� r� r� r$ r$ r$ r% �<module> s( . !� NJ