dctools.data.datasets.dataset.get_dataset_from_config

dctools.data.datasets.dataset.get_dataset_from_config(source, root_data_folder, root_catalog_folder, dataset_processor, max_samples=0, use_catalog=True, file_cache=None, filter_values=None, target_depth_values=None)

Get dataset from config.

Parameters:
  • source (dict)

  • root_data_folder (str)

  • root_catalog_folder (str)

  • dataset_processor (oceanbench.core.distributed.DatasetProcessor)

  • max_samples (int | None)

  • use_catalog (bool)

  • file_cache (FileCacheManager | None)

  • filter_values (dict | None)

  • target_depth_values (List[float] | None)

Return type:

RemoteDataset