dlt.common.runners.pool_runner
NullExecutor Objects
class NullExecutor(Executor)
Dummy executor that runs jobs single-threaded.
Provides a uniform interface for None pool type
submit
def submit(fn: Callable[P, T], *args: P.args, **kwargs: P.kwargs) -> Future[T]
Run the job and return a Future
TimeoutThreadPoolExecutor Objects
class TimeoutThreadPoolExecutor(ThreadPoolExecutor)
__init__
def __init__(max_workers: int = None,
timeout: Optional[float] = None,
thread_name_prefix: str = "",
initializer: AnyFun = None,
initargs: Tuple[Any, ...] = ())
Initializes a new ThreadPoolExecutor instance.
Arguments:
max_workers- The maximum number of threads that can be used to execute the given calls.timeout- Waits for pool threads to complete, None to wait indefinitethread_name_prefix- An optional name prefix to give our threads.initializer- A callable used to initialize worker threads.initargs- A tuple of arguments to pass to the initializer.
get_default_start_method
def get_default_start_method(method_: str) -> str
Sets method to spawn is running in one of orchestrator tasks.
Called when explicit start method is not set on PoolRunnerConfiguration