PyPI page
Home page
Author:
Keshav Kant Singh
Summary:
A Python package for Azure Datalake Storage adlsgen2 [abfss://] and Microsoft Fabric Lakehouse [abfss://], Google Cloud Storage [gs://bucket], AWS S3 bucket [s3://bucket] enables format detection and schema retrieval for Iceberg, Delta, and Parquet formats.It helps identify paritioned columns for parquet datasets. It also supports querying Delta, Parquet, and Iceberg formats through SQL constructs.
Latest version:
0.1.6
Required dependencies:
adlfs
|
azure-identity
|
azure-storage-file-datalake
|
cryptography
|
deltalake
|
duckdb
|
gcsfs
|
numpy
|
pandas
|
pyarrowfs-adlgen2
|
pydantic
|
pyopenssl
|
pytest
|
python-dotenv
|
s3fs
Downloads last day:
4
Downloads last week:
35
Downloads last month:
62