Your IP : 216.73.216.213
��XQm � " @ s� d Z d d l Z d d l Z d d l Z d d l Z d d l m Z d d l m Z d d l m
Z
m Z d d l m Z d d l
m Z d d l m Z d d l m Z d d
l m Z y d d l Z e Z Wn d d l Z e j Z Yn Xe re j Z y e d � Wn e k
r/d d
� Z Yn Xy d d l m Z Wn" e k
rhd d l m Z Yn Xy d d l Z Wn e k
r�d Z Yn Xd d l m Z d d l m! Z! d d l m" Z" d d l m# Z# d d l m$ Z$ d d l% m& Z& m' Z' d d l% m( Z( m) Z) d d l% m* Z* m+ Z+ m, Z, m- Z- d d l. m/ Z/ d d l0 Z0 d d l1 m2 Z2 m3 Z3 m4 Z4 m5 Z5 d g e6 e, j7 � � Z8 e9 e* d � r�e8 j: e* j; d � � d d � Z< d d � Z= Gd d � d e> � Z? d! d" d# � Z@ d$ d% � ZA d d d& d' � ZB d( d) � ZC d* d+ � ZD d, d- � ZE d. d/ � ZF d0 d1 � ZG d2 d3 � ZH d4 d5 � ZI d6 d7 � ZJ d8 d9 � ZK d: d; � ZL d< d= � ZM d> d? � ZN d@ dA � ZO dB dC � ZP e dD dE � � ZQ dF dG � ZR GdH dI � dI eS � ZT dJ dK � ZU dL dM � ZV dN dO � ZW dP dQ � ZX dR dS � ZY dT dU � ZZ dV dW � Z[ dX dY � Z\ dZ d[ � Z] d\ d] � Z^ d^ d_ � Z_ Gd` da � da e � Z` db dc � Za dd de � Zb df dg � Zc dh di � Zd e dj dk � � Ze Gdl dm � dm e � Zf dn do � Zg dp dq � Zh dr ds � Zi dt du � Zj dv dw � Zk dx dy � Zl dz d{ � Zm e d| d} � � Zn e e d~ d � � � Zo d� d� � Zp d� d� � Zq d� d� � Zr e e d� d� � � � Zs e d� d� � � Zt d S)�z
Test the parallel module.
� N)�sqrt)�parallel)�np�
with_numpy)�with_multiprocessing)�check_subprocess_call)� PY3_OR_LATER)� TimeoutError)�sleep�strc C s | S)N� )�sr r �J/opt/alt/python35/lib/python3.5/site-packages/joblib/test/test_parallel.py�<lambda>' s r )�Queue)�SequentialBackend)�ThreadingBackend)�MultiprocessingBackend)� SafeFunction)�WorkerInterrupt)�Parallel�delayed)�register_parallel_backend�parallel_backend)�mp� cpu_count�BACKENDS�effective_n_jobs)�JoblibException)� assert_equal� assert_true� assert_false�
assert_raises� get_context�spawnc C s | | S)Nr )�x�yr r r �divisionK s r' c C s | d S)N� r )r% r r r �squareO s r) c @ s" e Z d Z d Z d d � Z d S)�MyExceptionWithFinickyInitz1An exception class with non trivial __init__
c C s d S)Nr )�self�a�b�c�dr r r �__init__V s z#MyExceptionWithFinickyInit.__init__N)�__name__�
__module__� __qualname__�__doc__r0 r r r r r* S s r* Fc C s1 | d k r- | r' t d d d d � n t � | S)N� r, r- r. r/ )r* �
ValueError)r% �custom_exceptionr r r �exception_raiserZ s !r8 c C s t j d � t � d S)Ng�������?)�timer
�KeyboardInterrupt)r% r r r �interrupt_raisera s
r; c C s | d | | S)zO A module-level function so that it can be spawn with
multiprocessing.
r( r )r% r& �zr r r �ff s r= c C s t t j � d � S)Nr )�typer �get_active_backendr r r r �_active_backend_typem s r@ c C s t � d k s t � d S)Nr )r �AssertionErrorr r r r �test_cpu_countr s rB c C s t � d k s t � d S)Nr )r rA r r r r �test_effective_n_jobsv s rC c C s t d � } xJ d D]B } t d d � | D� t d | d | � d d � | D� � � q Wz�y"t j } t j } t r� t j � t _ t j � t _ n t j � t _ t j � t _ x� d D]� } t d d d | d | � d
d � | D� � t d d d | d | � d d � | D� � t d d d | d d d | � d d � | D� � t d d d | d | � d d � | D� � q� WWn{ t
k
r�} z[ t j } t j } | t _ | t _ t t | j
� � � t t | j
� � � | � WYd d } ~ Xn XWd | t _ | t _ Xd S)N� � r( c S s g | ] } t | � � q Sr )r) )�.0r% r r r �
<listcomp>� s z)check_simple_parallel.<locals>.<listcomp>�n_jobs�backendc s s! | ] } t t � | � Vq d S)N)r r) )rF r% r r r � <genexpr>� s z(check_simple_parallel.<locals>.<genexpr>� �d �verbosec s s! | ] } t t � | � Vq d S)N)r r) )rF r% r r r rJ � s c s s! | ] } t t � | � Vq d S)N)r r) )rF r% r r r rJ � s � pre_dispatchc s s! | ] } t t � | � Vq d S)N)r r) )rF r% r r r rJ � s c s s! | ] } t t � | � Vq d S)N)r r) )rF r% r r r rJ � s ������)rE r( rO rP )r( rK rL rO )�ranger r �sys�stdoutr �io�StringIO�stderr�BytesIO� Exception�print�unicode�getvalue) rI �XrH Z orig_stdoutZ orig_stderrrM �eZ my_stdoutZ my_stderrr r r �check_simple_parallel| sD
r^ c c s x t D] } t | f Vq Wd S)N)�ALL_VALID_BACKENDSr^ )rI r r r �test_simple_parallel� s
r` c C s0 t d d d | � d d � t d � D� � d S)NrH r( rI c s s! | ] } t t � d � Vq d S)g{�G�z�?N)r r) )rF �_r r r rJ � s z nested_loop.<locals>.<genexpr>)r rQ )rI r r r � nested_loop� s rb c s6 t d d d | � � f d d � t d � D� � d S)NrH r( rI c 3 s! | ] } t t � � � Vq d S)N)r rb )rF ra )�
child_backendr r rJ � s z$check_nested_loop.<locals>.<genexpr>)r rQ )�parent_backendrc r )rc r �check_nested_loop� s re c c s4 x- t D]% } x t D] } t | | f Vq Wq Wd S)N)r re )rd rc r r r �test_nested_loop� s
rf c sU t d d � � t d d d d � � f d d � t d � D� � t � j � � d S)
z1Input is mutable when using the threading backend�maxsizerD rH r( rI � threadingc 3 s* | ] } t � j d d �d � Vq d S)� check_pickleFrE N)r �put)rF ra )�qr r rJ � s z1test_mutate_input_with_threads.<locals>.<genexpr>N)r r rQ r �fullr r )rk r � test_mutate_input_with_threads� s rm c c sX t d � } xE d
D]= } t d d � | D� t d | � d d � | D� � f Vq Wd S) z.Check the keyword argument processing of pmap.�
rE � c S s" g | ] } t | d d �� q S)r& rE )r= )rF r% r r r rG � s z(test_parallel_kwargs.<locals>.<listcomp>rH c s s' | ] } t t � | d d �Vq d S)r& rE N)r r= )rF r% r r r rJ � s z'test_parallel_kwargs.<locals>.<genexpr>N)rE ro )rQ r r )�lstrH r r r �test_parallel_kwargs� s
rq c C sC t d � } d d � | D� } t d d d | � �� } | j } t d k ro t | d k � t | j d k � t | | d d � | D� � � t | | d d � | D� � � t d k r� t | j | j j k � Wd QRXt d k r� t | j j d k � t | | d
d � | D� � � t d k r?t | j j d k � d S) Nrn c S s" g | ] } t | d d �� q S)r& rE )r= )rF r% r r r rG � s z5check_parallel_as_context_manager.<locals>.<listcomp>rH ro rI c s s' | ] } t t � | d d �Vq d S)r& rE N)r r= )rF r% r r r rJ � s z4check_parallel_as_context_manager.<locals>.<genexpr>c s s' | ] } t t � | d d �Vq d S)r& rE N)r r= )rF r% r r r rJ � s c s s' | ] } t t � | d d �Vq d S)r& rE N)r r= )rF r% r r r rJ � s )rQ r �_backendr r �_poolr )rI rp �expected�pZmanaged_backendr r r �!check_parallel_as_context_manager� s rv c c s& x d d g D] } t | f Vq
Wd S)N�multiprocessingrh )rv )rI r r r � test_parallel_context_manager� s rx c s~ d d � � y t j � � Wn. t k
rM } z | j } WYd d } ~ Xn Xt | t � � f d d � t d � D� � d S)ze Check that pmap captures the errors when it is passed an object
that cannot be pickled.
c S s | d S)Nr( r )r% r r r �g� s z!test_parallel_pickling.<locals>.gNc 3 s! | ] } t � � | � Vq d S)N)r )rF r% )ry r r rJ � s z)test_parallel_pickling.<locals>.<genexpr>rn )�pickle�dumpsrX � __class__r" r rQ )�exc�exception_classr )ry r �test_parallel_pickling� s r c C sb x[ d d g D]M } t j j d t t d d d | d d � d d � t d � D� � � � q
Wd S)
Nrw rh rn rH r( rI �timeoutc s s! | ] } t t � d � Vq d S)g����MbP?N)r r
)rF r% r r r rJ s z0test_parallel_timeout_success.<locals>.<genexpr>)�nose�toolsr �lenr rQ )rI r r r � test_parallel_timeout_success s
r� c
C sY xR d d g D]D } t j j t t d d d | d d � d d � t d
� D� � q
Wd S) Nrw rh rH r( rI r� g{�G�z�?c s s! | ] } t t � d � Vq d S)rn N)r r
)rF r% r r r rJ s z-test_parallel_timeout_fail.<locals>.<genexpr>rn )r� r� r" r r rQ )rI r r r �test_parallel_timeout_fail
s
r� c C s� t d k r�t t t d d � d d � t d d � D� � t t t d d � d d � d D� � t d d � �B} t | j j d k � | j j } t t | d d � t d d � D� � t | j j d k � t | j j | k � t d d � t
d
� D� | d d � t
d
� D� � � | j j } t t | d
d � d D� � t | j j d k � t | j j | k � t d d � t
d
� D� | d d � t
d
� D� � � Wd QRXt | j j d k � n& t t t d d � d d � d D� � t t t d d � d d � t d d � D� � t t
t d d d d � d d � t
d � D� � y6 t � } t d d � d d � t d d � D� � Wn8 t k
r�} z t t | t � � WYd d } ~ Xn Xd S)!NrH r( c S s+ g | ]! \ } } t t � | | � � q Sr )r r' )rF r% r& r r r rG s z&test_error_capture.<locals>.<listcomp>r rE c S s" g | ] } t t � | � � q Sr )r r; )rF r% r r r rG s c S s+ g | ]! \ } } t t � | | � � q Sr )r r' )rF r% r& r r r rG ' s c S s" g | ] } t | d d �� q S)r& rE )r= )rF r% r r r rG 1 s rn c s s' | ] } t t � | d d �Vq d S)r& rE N)r r= )rF r% r r r rJ 2 s z%test_error_capture.<locals>.<genexpr>c S s" g | ] } t t � | � � q Sr )r r; )rF r% r r r rG 6 s c S s" g | ] } t | d d �� q S)r& rE )r= )rF r% r r r rG > s c s s' | ] } t t � | d d �Vq d S)r& rE N)r r= )rF r% r r r rJ ? s c S s" g | ] } t t � | � � q Sr )r r; )rF r% r r r rG F s c S s+ g | ]! \ } } t t � | | � � q Sr )r r' )rF r% r& r r r rG K s rM c s s' | ] } t t � | d d �Vq d S)r7 TN)r r8 )rF �ir r r rJ P s � c s s* | ] \ } } t t � | | � Vq d S)N)r r' )rF r% r& r r r rJ W s )r rE )rE r )rE r )r rE )rE r )rE r )rE r )r rE )rE r )r rE )rE r )r r" r r �zipr r rr rs r rQ r: �ZeroDivisionErrorr* rX r! �
isinstance)r Z
original_pool�exr r r �test_error_capture sN ' !r� c @ s( e Z d Z d d � Z d d � Z d S)�Counterc C s | | _ | | _ d S)N)�list1�list2)r+ r� r� r r r r0 ] s zCounter.__init__c C s3 | j j | � t t | j � t | j � � d S)N)r� �appendr r� r� )r+ r� r r r �__call__a s zCounter.__call__N)r1 r2 r3 r0 r� r r r r r� \ s r� c C s | j d | � d S)Nz Consumed %s)r� )�queue�itemr r r �consumerf s r� c s! t � � � f d d � } t d d d d d | � � f d d � | � D� � t � d d
d d d
d d d d d d d g � t t � � d � g � d d � <t d d d d d | � � f d d � | � D� � t � d d d
d d
d d d d d d d g � t t � � d � d S)zC Test that with only one job, Parallel does act as a iterator.
c 3 s1 x* t d � D] } � j d | � | Vq
Wd S)N� z Produced %i)rQ r� )r� )r� r r �producero s z(check_dispatch_one_job.<locals>.producerrH rE �
batch_sizerI c 3 s$ | ] } t t � � | � Vq d S)N)r r� )rF r% )r� r r rJ v s z)check_dispatch_one_job.<locals>.<genexpr>z
Produced 0z
Consumed 0z
Produced 1z
Consumed 1z
Produced 2z
Consumed 2z
Produced 3z
Consumed 3z
Produced 4z
Consumed 4z
Produced 5z
Consumed 5� Nro c 3 s$ | ] } t t � � | � Vq d S)N)r r� )rF r% )r� r r rJ � s )�listr r r� )rI r� r )r� r �check_dispatch_one_jobj s(
r� c c s x t D] } t | f Vq Wd S)N)r r� )rI r r r �test_dispatch_one_job� s
r� c s� t d k r t j � � t j � } | j � � � f d d � } t d d d d d d d
| � � f d d � | � D� � t � � d d
� } | j d � t | d d d g � t t � � d � d S)zW Check that using pre_dispatch Parallel does indeed dispatch items
lazily.
Nc 3 s1 x* t d � D] } � j d | � | Vq
Wd S)Nr� z Produced %i)rQ r� )r� )r� r r r� � s z0check_dispatch_multiprocessing.<locals>.producerrH r( r� rE rN � rI c 3 s$ | ] } t t � � d � Vq d S)�anyN)r r� )rF ra )r� r r rJ � s z1check_dispatch_multiprocessing.<locals>.<genexpr>ro z Consumed anyz
Produced 0z
Produced 1z
Produced 2r� ) r r� �SkipTest�Managerr� r �remover r� )rI �managerr� Z
first_fourr )r� r � check_dispatch_multiprocessing� s
r� c c s, x% t D] } | d k r t | f Vq Wd S)N�
sequential)r r� )rI r r r � test_dispatch_multiprocessing� s
r� c C s\ t d d d d d d � �: } | d d � t d � D� � t | j j � d
� Wd QRXd S) NrH r( r� �autorI rh c s s! | ] } t t � | � Vq d S)N)r �id)rF r� r r r rJ � s z/test_batching_auto_threading.<locals>.<genexpr>i� rE )r rQ r rr �compute_batch_size)ru r r r � test_batching_auto_threading� s r� c C s_ t d d d d d d � �= } | d d � t d � D� � t | j j � d
k � Wd QRXd S) NrH r( r� r� rI rw c s s! | ] } t t � | � Vq d S)N)r r� )rF r� r r r rJ � s z5test_batching_auto_multiprocessing.<locals>.<genexpr>i� r )r rQ r rr r� )ru r r r �"test_batching_auto_multiprocessing� s r� c C s< t t t d d d d d d � d d � t d � D� � d
S) zCMake sure that exception raised during dispatch are indeed capturedrH r( rN � rM r c s s! | ] } t t � | � Vq d S)N)r r8 )rF r� r r r rJ � s z*test_exception_dispatch.<locals>.<genexpr>r� N)r" r6 r rQ r r r r �test_exception_dispatch� s r� c C s< t t t d d d d d d � d d � t d � D� � d S)
NrH r( rN r� rM r c s s' | ] } t t t � � | � Vq d S)N)r r r8 )rF r� r r r rJ � s z1test_nested_exception_dispatch.<locals>.<genexpr>r� )r" r r rQ r r r r � test_nested_exception_dispatch� s r� c C s[ t j j t j � } | d d � } | j d � d j | � } t | � } t | � d S)NrE z parallel.py�/) r r2 �split�os�sepr� �join�
__import__�reload)Z joblib_path�moduler r r �_reload_joblib� s
r� c C s] t t j j d d � � s' t j � � t t t d d d d � d d � t d � D� � d S)
NZJOBLIB_MULTIPROCESSINGrE rH r( rN �allc S s g | ] } t t � � � q Sr )r r� )rF r� r r r rG � s z*test_multiple_spawning.<locals>.<listcomp>rn )
�intr� �environ�getr� r� r" � ImportErrorr rQ r r r r �test_multiple_spawning� s r� c @ s7 e Z d Z d Z d d d d � Z d d d � Z d S)�FakeParallelBackendz8Pretends to run concurrently while running sequentially.rE Nc K s | j | � | _ | | _ | S)N)r rH r )r+ rH r � backend_argsr r r � configure� s z FakeParallelBackend.configurec C s- | d k r) t t j � d | d � } | S)Nr rE )�maxr r )r+ rH r r r r � s z$FakeParallelBackend.effective_n_jobs)r1 r2 r3 r4 r� r r r r r r� � s r� c C s t t t d d �d S)NrI z unit-testing)r" r6 r r r r r �test_invalid_backend s r� c C sA z2 t d t � t d t k � t t d t � Wd t d =Xd S)N� test_backend)r r� r r r r r r r � test_register_parallel_backend s
r� c C s\ t t � t � z+ t d t d d d �t t � t � Wd d t _ Xt t � t � d S)Nrh � make_defaultTrw )r r@ r r r r r �DEFAULT_BACKENDr r r r � test_overwrite_default_backend s
r� c
C s t | d d ��� t j � \ } } t | d � t t d � d � t � } t | j d � | d k r� t t | � t � t t | j � t � np | d k r� t t | � t
� t t | j � t
� n8 | j d � rt t | � t � t t | j � t � Wd QRXd S)NrH r� rw rh �test_)
r r r? r r r rH r> r rr r �
startswithr� )� backend_name�active_backend�
active_n_jobsru r r r � check_backend_context_manager s
r� c c s� d d � t d � D� } x | D] } t | t � q Wd d g | } zv t t � t � x | D] } t | f Vqa Wt t � t � t d d d d � d d
� | D� � t t � t � Wd x0 t t j
� � D] } | j d � r� t | =q� WXd S) Nc S s g | ] } d | � q S)ztest_backend_%dr )rF r� r r r rG . s z0test_backend_context_manager.<locals>.<listcomp>r� rw rh rH r( rI c s s' | ] } | s t t � | � Vq d S)N)r r� )rF r- r r r rJ > s z/test_backend_context_manager.<locals>.<genexpr>r� ) rQ r r� r r@ r r� r r� r �keysr� )Zall_test_backendsr� Z all_backendsr� r r r � test_backend_context_manager, s
r� c @ s% e Z d Z d Z d d d � Z d S)� ParameterizedParallelBackendz9Pretends to run conncurrently while running sequentially.Nc C s% | d k r t d � � | | _ d S)Nzparam should not be None)r6 �param)r+ r� r r r r0 L s z%ParameterizedParallelBackend.__init__)r1 r2 r3 r4 r0 r r r r r� I s r� c C s
t d t � z� t t � t � t d d d d d ��� t j � \ } } t t | � t � t | j d � t | d � t
� } t | j d � t | j
| k � | d d � t d � D� � } Wd QRXt | d d
� t d � D� � t t � t � Wd t d =Xd S) NZ
param_backendr� �* rH r� c s s! | ] } t t � | � Vq d S)N)r r )rF r� r r r rJ _ s z=test_parameterized_backend_context_manager.<locals>.<genexpr>rD c S s g | ] } t | � � q Sr )r )rF r� r r r rG ` s z>test_parameterized_backend_context_manager.<locals>.<listcomp>)r r� r r@ r r r r? r> r� r rH r rr rQ r )r� r� ru �resultsr r r �*test_parameterized_backend_context_managerR s
& r� c C s� t t � t � t t d d � d d ��� t j � \ } } t t | � t � t | j d � t | d � t � } t | j
d � t | j | k � | d d � t
d � D� � } Wd QRXt | d d � t
d � D� � t t � t � d S) Nr� �+ rH rD c s s! | ] } t t � | � Vq d S)N)r r )rF r� r r r rJ u s zDtest_direct_parameterized_backend_context_manager.<locals>.<genexpr>c S s g | ] } t | � � q Sr )r )rF r� r r r rG v s zEtest_direct_parameterized_backend_context_manager.<locals>.<listcomp>)r r@ r r r� r r? r> r� r rH r rr rQ )r� r� ru r� r r r �1test_direct_parameterized_backend_context_managerh s
& r� c C s' t d � } t | � t j | � d S)NZfoobar)r �reprrz r{ )r] r r r �test_joblib_exception~ s
r� c C s# t t � } t t | d d � d S)NrE r )r r' r" r )Z
safe_divisionr r r �test_safe_function� s r� c C s= t t t d d �t t t d d �t t t d d �d S)Nr� r rE g� ��Q��?rO )r" r6 r r r r r �test_invalid_batch_size� s r� c C s^ | j d � } d d � t | � D� } t | � d d � t | � D� � } t | | � d S)N�n_tasksc S s g | ] } t | � � q Sr )r) )rF r� r r r rG � s z&check_same_results.<locals>.<listcomp>c s s! | ] } t t � | � Vq d S)N)r r) )rF r� r r r rJ � s z%check_same_results.<locals>.<genexpr>)�poprQ r r )�paramsr� rt r� r r r �check_same_results� s %r� c
c sJ t t d d d d d d � f Vt t d d d d d d � f Vt t d d d d d d � f Vt t d d d d d d � f Vt t d d d d d d � f Vt t d d d d d d � f Vt t d d d d d
d � f Vt t d d d d d
d d d � f Vt t d d d d d
d � f Vt t d d d d d d
� f Vd S)Nr� r( rH rN r� rn i ro � r� rE r5 z2*n_jobs)r� �dictr r r r � test_dispatch_race_condition� s r� c C s� t d d d d � } | j j d � } t j d
k r� | j � } t j j d d � j � p` d } | d k r� t j d
k r� t
| d � q� t
| d � q� t
| | � n
t
| d � d S)NrH r( rI rw �contextr� ro ZJOBLIB_START_METHOD� �win32r$ �fork)r� ro ) r �
_backend_argsr� rR � version_info�get_start_methodr� r� �strip�platformr )ru r� Z start_methodZ
env_methodr r r �test_default_mp_context� s ! r� c s� t j d k r t j d � � t j d � } t j j d � } | j d d � � t j
� � j � t d d d | � � f d
d � t
d � D� � d S)
Nr� ro z3multiprocessing can cause BLAS freeze on old Pythonr$ r� i� rH r( rI c 3 s* | ] } t t j � � � j � Vq d S)N)r r �dot�T)rF r� )r, r r rJ � s zDtest_no_blas_crash_or_freeze_with_multiprocessing.<locals>.<genexpr>)r� ro )rR r� r� r� r r# r �random� RandomState�randnr� r� r rQ )Z
spawn_backend�rngr )r, r �1test_no_blas_crash_or_freeze_with_multiprocessing� s r� c C sS t d k r t j d � � d j d d d g � } t t j d | g d d �d S) NzNot a POSIX platformz
z$from joblib import Parallel, delayedzdef sqrt(x): return x**2z=print(Parallel(n_jobs=2)(delayed(sqrt)(i) for i in range(5)))z-cZ stdout_regexz\[0, 1, 4, 9, 16\])�posixr� r� r� r rR �
executable)�coder r r �2test_parallel_with_interactively_defined_functions� s r� c C s, t g � } t t d d � | � g � d S)NrH r( )�iterr r )Zexhausted_iteratorr r r �%test_parallel_with_exhausted_iterator� s r� c C s1 t | t j � s' t d t | � � � | j � S)Nz#Expected np.memmap instance, got %r)r� r �memmap� TypeErrorr> �copy)r, r r r � check_memmap� s r� c C s} d d � } t d d d d � d d � | d � D� � } x< t | | t | � � � D] \ } } t j j | | � qV Wd S)
Nc s s6 x/ t | � D]! } t j d d t j �| Vq
Wd S)Nrn �dtype)rQ r �ones�float32)�nr� r r r �generate_arrays� s zBtest_auto_memmap_on_arrays_from_generator.<locals>.generate_arraysrH r( �
max_nbytesrE c s s! | ] } t t � | � Vq d S)N)r r� )rF r, r r r rJ s z<test_auto_memmap_on_arrays_from_generator.<locals>.<genexpr>rL )r r� r� r �testing�assert_array_equal)r� r� �resultrt r r r �)test_auto_memmap_on_arrays_from_generator� s
(r c C s� t d k r t j d � � d } | j d d d d � } t t j d | g d d �d
} | j d d d d � } t t j d | g d | �d S) NzNot a POSIX platforma
import sys
from joblib import Parallel, delayed
def func():
return 42
def parallel_func():
res = Parallel(n_jobs={inner_n_jobs})(delayed(func)() for _ in range(3))
return res
Parallel(n_jobs={outer_n_jobs})(delayed(parallel_func)() for _ in range(5))
Z inner_n_jobsrE Z outer_n_jobsr( z-cZ stderr_regexz^$z6Multiprocessing-backed parallel loops cannot be nested)r� r� r� �formatr rR r� )Z
template_coder� �regexr r r � test_nested_parallel_warnings
s r )ur4 r9 rR rT r� �mathr �joblibr Zjoblib.test.commonr r r Zjoblib.testingr Zjoblib._compatr rw r r
�cPicklerz r� � PickleError�
PicklingErrorrZ � NameErrorr� r r� r� Zjoblib._parallel_backendsr r r r r Zjoblib.parallelr r r r r r r r Zjoblib.my_exceptionsr r� �
nose.toolsr r r! r" �sortedr� r_ �hasattrr� r# r' r) rX r* r8 r; r= r@ rB rC r^ r` rb re rf rm rq rv rx r r� r� r� �objectr� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r r r r r r �<module> s�
" " ( G
(