Function create_object_store_from_path

Source
pub fn create_object_store_from_path(
    path: &str,
    storage_options: Option<HashMap<String, String>>,
) -> Result<(Arc<dyn ObjectStore>, String, String)>
Expand description

Creates an object store from a URI string with optional storage options.

Supports multiple cloud storage providers:

  • AWS S3: s3://bucket/path
  • Google Cloud Storage: gs://bucket/path or gcs://bucket/path
  • Azure Blob Storage: azure://account/container/path or abfs://container@account.dfs.core.windows.net/path
  • HTTP/WebDAV: http:// or https://
  • Local files: file://path or plain paths

§Parameters

  • path: The URI string for the storage location.
  • storage_options: Optional HashMap containing storage-specific configuration options:
    • For S3: endpoint_url, region, access_key_id, secret_access_key, session_token, etc.
    • For GCS: service_account_path, service_account_key, project_id, etc.
    • For Azure: account_name, account_key, sas_token, etc.

Returns a tuple of (ObjectStore, base_path, normalized_uri)