dctools.data.connection.connection_manager

Manager for different types of data connections (Local, S3, FTP, ARGO, CMEMS).

Functions

clean_for_serialization(obj)

Cleans non-serializable objects before pickle.

create_worker_connect_config(config[, ...])

Creates connection configurations for predictive and reference sources.

get_time_bound_values(ds)

Returns the time bounds (min, max) of an xarray dataset.

prefetch_obs_files_to_local(remote_paths, ...)

Pre-download observation files to local disk before worker dispatch.

Classes

ArgoManager(connect_config[, depth_values, ...])

Specific manager for ARGO data using ArgoInterface for scalable indexing.

BaseConnectionManager(connect_config[, ...])

Abstract base connection manager.

CMEMSManager(connect_config[, ...])

Class to manage Copernicus Marine downloads.

FTPManager(connect_config[, ...])

Manager for FTP connections.

GlonetManager(connect_config[, ...])

Manager for Glonet (remote files over HTTPS).

LocalConnectionManager(connect_config[, ...])

Manager for local files.

S3Manager(connect_config[, call_list_files, ...])

Manager for S3 connections.

S3WasabiManager(connect_config[, ...])

Specific S3 Manager for Wasabi (inheriting from S3Manager).

Exceptions

RecursionExit(value)

Exception to exit recursion when listing files.