Your IP : 216.73.216.213
��X�' � @ s� d Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l m Z m Z e rv e j
Z n e j Z Gd d � d e � Z
Gd d � d e � Z Gd d
� d
e � Z Gd d � d e � Z d
d d d � Z d S)zb
Fast cryptographic hash of Python objects, with a special case for fast
hashing of numpy arrays.
� N� )�_bytes_or_unicode� PY3_OR_LATERc @ s" e Z d Z d Z d d � Z d S)�_ConsistentSetza Class used to ensure the hash of Sets is preserved
whatever the order of its items.
c C sH y t | � | _ Wn. t k
rC t d d � | D� � | _ Yn Xd S)Nc s s | ] } t | � Vq d S)N)�hash)�.0�e� r �?/opt/alt/python35/lib/python3.5/site-packages/joblib/hashing.py� <genexpr>) s z*_ConsistentSet.__init__.<locals>.<genexpr>)�sortedZ _sequence� TypeError)�selfZ set_sequencer r r
�__init__ s
z_ConsistentSet.__init__N)�__name__�
__module__� __qualname__�__doc__r r r r r
r s r c @ s" e Z d Z d Z d d � Z d S)�_MyHashz7 Class used to hash objects that won't normally pickle c G s
| | _ d S)N)�args)r r r r r
r / s z_MyHash.__init__N)r r r r r r r r r
r , s r c @ s� e Z d Z d Z d d d � Z d d d � Z d d � Z d
d � Z d e j d
d � Z
e j j
� Z e
e e e � <e
e e e � <e
e e e � <e
e e e j � <d d � Z d d � Z e e e e � � <d S)�HasherzW A subclass of pickler, to do cryptographic hashing, rather than
pickling.
�md5c C sV t j � | _ t r t j n t j } t j | | j d | �t j
| � | _ d S)N�protocol) �io�BytesIO�streamr �pickleZDEFAULT_PROTOCOLZHIGHEST_PROTOCOL�Picklerr �hashlib�new�_hash)r � hash_namer r r r
r 8 s
zHasher.__init__Tc C s� y | j | � WnG t j k
rZ } z$ | j d | | f f 7_ � WYd d } ~ Xn X| j j � } | j j | � | r� | j j � Sd S)Nz"PicklingError while hashing %r: %r) �dumpr �
PicklingErrorr r �getvaluer �updateZ hexdigest)r �objZ
return_digestr �dumpsr r r
r B s z Hasher.hashc C s� t | t j t i j � f � r� t | d � r? | j j } n | j } | j } t | � t t � k r~ t
| | j � } n< | d k r� t
| | � } n | j j } t
| | | � } t j
| | � d S)N�__func__)�
isinstance�types�
MethodType�type�pop�hasattrr( r �__self__r r � __class__r �save)r r& Z func_nameZinst�clsr r r
r1 M s ! z Hasher.savec C s' t | t � r d St j | | � d S)N)r) r r �memoize)r r& r r r
r3 ` s zHasher.memoizeNc C s� t d | d | � } t j d k r+ | d =y t j | | | � Wn� t j k
r� t j | | | � t | d d � } | d k r� | } | d k r� | j } t j | } t
| | � s� t | | | � Yn Xd S)N�name�pack� � r �__main__)r6 r7 ) �dict�sys� version_infor � save_globalr r# �getattrr �modulesr. �setattr)r r& r4 r5 �kwargs�moduleZmy_name�modr r r
r< k s
zHasher.save_globalc C sb y t j | t t | � � � Wn; t k
r] t j | t t d d � | D� � � � Yn Xd S)Nc s s' | ] \ } } t | � | f Vq d S)N)r )r �k�vr r r
r � s z)Hasher._batch_setitems.<locals>.<genexpr>)r �_batch_setitems�iterr r
)r �itemsr r r
rE � s
zHasher._batch_setitemsc C s t j | t | � � d S)N)r r1 r )r Z set_itemsr r r
�save_set� s zHasher.save_set)r r r r r r r1 r3 �structr5 r< r �dispatch�copyr, �len�objectr r" rE rH �setr r r r
r 3 s
r c @ s4 e Z d Z d Z d d d d � Z d d � Z d S) � NumpyHasherz7 Special case the hasher for when numpy is loaded.
r Fc C s\ | | _ t j | d | �d d l } | | _ t | d � rO | j | _ n t | _ d S)a
Parameters
----------
hash_name: string
The hash algorithm to be used
coerce_mmap: boolean
Make no difference between np.memmap and np.ndarray
objects.
r! r N� getbuffer) � coerce_mmapr r �numpy�npr. rP �
_getbuffer�
memoryview)r r! rQ rS r r r
r � s
zNumpyHasher.__init__c C sB t | | j j � r� | j j r� | j f k r@ | j � } n9 | j j rU | } n$ | j j rm | j
} n | j � } | j j | j
| j | j j � � � | j r� t | | j j � r� | j j } n | j } | d | j | j | j f f } n3 t | | j j � r.| j } | d | j f f } t j | | � d S)z� Subclass the save method, to hash ndarray subclass, rather
than pickling them. Off course, this is a total abuse of
the Pickler class.
ZHASHEDN)r) rS ZndarrayZdtypeZ hasobject�shapeZflatten�flags� c_contiguous� f_contiguous�Tr r% rT ZviewZuint8rQ Zmemmapr0 �stridesZdescrr r1 )r r& Zobj_c_contiguous�klassr r r
r1 � s$ " $ zNumpyHasher.saveN)r r r r r r1 r r r r
rO � s rO r Fc C sC d t j k r' t d | d | � } n t d | � } | j | � S)al Quick calculation of a hash to identify uniquely Python objects
containing numpy arrays.
Parameters
-----------
hash_name: 'md5' or 'sha1'
Hashing algorithm used. sha1 is supposedly safer, but md5 is
faster.
coerce_mmap: boolean
Make no difference between np.memmap and np.ndarray
rR r! rQ )r: r> rO r r )r& r! rQ Zhasherr r r
r � s
r )r r r r: r* rI r Z_compatr r Z_Picklerr rM r r r rO r r r r r
�<module> s mU