Your IP : 216.73.216.213
��X�' � @ s� d Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l m Z m Z e rv e j
Z n e j Z Gd d � d e � Z
Gd d � d e � Z Gd d
� d
e � Z Gd d � d e � Z d
d d d � Z d S)zb
Fast cryptographic hash of Python objects, with a special case for fast
hashing of numpy arrays.
� N� )�_bytes_or_unicode� PY3_OR_LATERc @ s" e Z d Z d Z d d � Z d S)�_ConsistentSetza Class used to ensure the hash of Sets is preserved
whatever the order of its items.
c C sH y t | � | _ Wn. t k
rC t d d � | D� � | _ Yn Xd S)Nc s s | ] } t | � Vq d S)N)�hash)�.0�e� r �?/opt/alt/python35/lib/python3.5/site-packages/joblib/hashing.py� <genexpr>) s z*_ConsistentSet.__init__.<locals>.<genexpr>)�sorted� _sequence� TypeError)�self� set_sequencer r r
�__init__ s
z_ConsistentSet.__init__N)�__name__�
__module__� __qualname__�__doc__r r r r r
r s r c @ s" e Z d Z d Z d d � Z d S)�_MyHashz7 Class used to hash objects that won't normally pickle c G s
| | _ d S)N)�args)r r r r r
r / s z_MyHash.__init__N)r r r r r r r r r
r , s r c @ s� e Z d Z d Z d d d � Z d d d � Z d d � Z d
d � Z d e j d
d � Z
e j j
� Z e
e e e � <e
e e e � <e
e e e � <e
e e e j � <d d � Z d d � Z e e e e � � <d S)�HasherzW A subclass of pickler, to do cryptographic hashing, rather than
pickling.
�md5c C sV t j � | _ t r t j n t j } t j | | j d | �t j
| � | _ d S)N�protocol) �io�BytesIO�streamr �pickle�DEFAULT_PROTOCOL�HIGHEST_PROTOCOL�Picklerr �hashlib�new�_hash)r � hash_namer r r r
r 8 s
zHasher.__init__Tc C s� y | j | � WnG t j k
rZ } z$ | j d | | f f 7_ � WYd d } ~ Xn X| j j � } | j j | � | r� | j j � Sd S)Nz"PicklingError while hashing %r: %r) �dumpr �
PicklingErrorr r �getvaluer$ �update� hexdigest)r �obj�
return_digestr �dumpsr r r
r B s z Hasher.hashc C s� t | t j t i j � f � r� t | d � r? | j j } n | j } | j } t | � t t � k r~ t
| | j � } n< | d k r� t
| | � } n | j j } t
| | | � } t j
| | � d S)N�__func__)�
isinstance�types�
MethodType�type�pop�hasattrr. r �__self__r r � __class__r! �save)r r+ � func_name�inst�clsr r r
r7 M s ! z Hasher.savec C s' t | t � r d St j | | � d S)N)r/ r r! �memoize)r r+ r r r
r; ` s zHasher.memoizeNc C s� t d | d | � } t j d k r+ | d =y t j | | | � Wn� t j k
r� t j | | | � t | d d � } | d k r� | } | d k r� | j } t j | } t
| | � s� t | | | � Yn Xd S)N�name�pack� � r �__main__)r> r? ) �dict�sys� version_infor! � save_globalr r' �getattrr �modulesr4 �setattr)r r+ r< r= �kwargs�module�my_name�modr r r
rD k s
zHasher.save_globalc C sb y t j | t t | � � � Wn; t k
r] t j | t t d d � | D� � � � Yn Xd S)Nc s s' | ] \ } } t | � | f Vq d S)N)r )r �k�vr r r
r � s z)Hasher._batch_setitems.<locals>.<genexpr>)r! �_batch_setitems�iterr r )r �itemsr r r
rN � s
zHasher._batch_setitemsc C s t j | t | � � d S)N)r! r7 r )r � set_itemsr r r
�save_set� s zHasher.save_set)r r r r r r r7 r; �structr= rD r! �dispatch�copyr2 �len�objectr r& rN rR �setr r r r
r 3 s
r c @ s4 e Z d Z d Z d d d d � Z d d � Z d S) � NumpyHasherz7 Special case the hasher for when numpy is loaded.
r Fc C s\ | | _ t j | d | �d d l } | | _ t | d � rO | j | _ n t | _ d S)a
Parameters
----------
hash_name: string
The hash algorithm to be used
coerce_mmap: boolean
Make no difference between np.memmap and np.ndarray
objects.
r% r N� getbuffer) � coerce_mmapr r �numpy�npr4 rZ �
_getbuffer�
memoryview)r r% r[ r] r r r
r � s
zNumpyHasher.__init__c C sB t | | j j � r� | j j r� | j f k r@ | j � } n9 | j j rU | } n$ | j j rm | j
} n | j � } | j j | j
| j | j j � � � | j r� t | | j j � r� | j j } n | j } | d | j | j | j f f } n3 t | | j j � r.| j } | d | j f f } t j | | � d S)z� Subclass the save method, to hash ndarray subclass, rather
than pickling them. Off course, this is a total abuse of
the Pickler class.
�HASHEDN)r/ r] �ndarray�dtype� hasobject�shape�flatten�flags� c_contiguous� f_contiguous�Tr$ r) r^ �view�uint8r[ �memmapr6 �strides�descrr r7 )r r+ �obj_c_contiguous�klassr r r
r7 � s$ " $ zNumpyHasher.saveN)r r r r r r7 r r r r
rY � s rY r Fc C sC d t j k r' t d | d | � } n t d | � } | j | � S)al Quick calculation of a hash to identify uniquely Python objects
containing numpy arrays.
Parameters
-----------
hash_name: 'md5' or 'sha1'
Hashing algorithm used. sha1 is supposedly safer, but md5 is
faster.
coerce_mmap: boolean
Make no difference between np.memmap and np.ndarray
r\ r% r[ )rB rF rY r r )r+ r% r[ �hasherr r r
r � s
r )r r r" rB r0 rS r �_compatr r �_Picklerr! rW r r r rY r r r r r
�<module> s mU