-
Notifications
You must be signed in to change notification settings - Fork 169
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Python: Migrate from iceberg
to iceberg-python
#3
Commits on Mar 5, 2023
-
Build: Bump duckdb from 0.7.0 to 0.7.1 in /python (#7018)
Bumps [duckdb](https://github.com/duckdb/duckdb) from 0.7.0 to 0.7.1. - [Release notes](https://github.com/duckdb/duckdb/releases) - [Changelog](https://github.com/duckdb/duckdb/blob/master/tools/release-pip.py) - [Commits](duckdb/duckdb@v0.7.0...v0.7.1) --- updated-dependencies: - dependency-name: duckdb dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for f2048e6 - Browse repository at this point
Copy the full SHA f2048e6View commit details -
Configuration menu - View commit details
-
Copy full SHA for d9bebc4 - Browse repository at this point
Copy the full SHA d9bebc4View commit details -
Configuration menu - View commit details
-
Copy full SHA for 627c82d - Browse repository at this point
Copy the full SHA 627c82dView commit details -
Build: Bump coverage from 7.2.0 to 7.2.1 in /python (#7017)
Bumps [coverage](https://github.com/nedbat/coveragepy) from 7.2.0 to 7.2.1. - [Release notes](https://github.com/nedbat/coveragepy/releases) - [Changelog](https://github.com/nedbat/coveragepy/blob/master/CHANGES.rst) - [Commits](nedbat/coveragepy@7.2.0...7.2.1) --- updated-dependencies: - dependency-name: coverage dependency-type: direct:development update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 900d5a4 - Browse repository at this point
Copy the full SHA 900d5a4View commit details
Commits on Mar 6, 2023
-
Python: Don't warn on an identifier (#6844)
When we pass in a warehouse identifier, we don't want to emit a warning. Also, the help message won't be helpful: ``` No preferred file implementation for scheme: ``` Since there is no scheme.
Configuration menu - View commit details
-
Copy full SHA for 6a42a1a - Browse repository at this point
Copy the full SHA 6a42a1aView commit details
Commits on Mar 7, 2023
-
Configuration menu - View commit details
-
Copy full SHA for c686682 - Browse repository at this point
Copy the full SHA c686682View commit details
Commits on Mar 12, 2023
-
Build: Bump moto from 4.1.3 to 4.1.4 in /python (#7082)
Bumps [moto](https://github.com/getmoto/moto) from 4.1.3 to 4.1.4. - [Release notes](https://github.com/getmoto/moto/releases) - [Changelog](https://github.com/getmoto/moto/blob/master/CHANGELOG.md) - [Commits](getmoto/moto@4.1.3...4.1.4) --- updated-dependencies: - dependency-name: moto dependency-type: direct:development update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 572921f - Browse repository at this point
Copy the full SHA 572921fView commit details -
Build: Bump pydantic from 1.10.5 to 1.10.6 in /python (#7083)
Bumps [pydantic](https://github.com/pydantic/pydantic) from 1.10.5 to 1.10.6. - [Release notes](https://github.com/pydantic/pydantic/releases) - [Changelog](https://github.com/pydantic/pydantic/blob/v1.10.6/HISTORY.md) - [Commits](pydantic/pydantic@v1.10.5...v1.10.6) --- updated-dependencies: - dependency-name: pydantic dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 133a9ef - Browse repository at this point
Copy the full SHA 133a9efView commit details -
Build: Bump fastavro from 1.7.2 to 1.7.3 in /python (#7084)
Bumps [fastavro](https://github.com/fastavro/fastavro) from 1.7.2 to 1.7.3. - [Release notes](https://github.com/fastavro/fastavro/releases) - [Changelog](https://github.com/fastavro/fastavro/blob/master/ChangeLog) - [Commits](fastavro/fastavro@1.7.2...1.7.3) --- updated-dependencies: - dependency-name: fastavro dependency-type: direct:development update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 8918bb8 - Browse repository at this point
Copy the full SHA 8918bb8View commit details
Commits on Mar 15, 2023
-
Python: Integration tests (#6398)
* Integration tests * First version * Add caching * Add caching * Restore pyproject * WIP * NaN seems to be broken * WIP * Coming along * Cleanup * Install duckdb * Cleanup * Revert changes to poetry * Make it even nicer * Revert unneeded change * Update Spark version * Make test passing * comments
Configuration menu - View commit details
-
Copy full SHA for 3d78ecb - Browse repository at this point
Copy the full SHA 3d78ecbView commit details
Commits on Mar 19, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 9546da7 - Browse repository at this point
Copy the full SHA 9546da7View commit details -
Build: Bump coverage from 7.2.1 to 7.2.2 in /python (#7142)
Bumps [coverage](https://github.com/nedbat/coveragepy) from 7.2.1 to 7.2.2. - [Release notes](https://github.com/nedbat/coveragepy/releases) - [Changelog](https://github.com/nedbat/coveragepy/blob/master/CHANGES.rst) - [Commits](nedbat/coveragepy@7.2.1...7.2.2) --- updated-dependencies: - dependency-name: coverage dependency-type: direct:development update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for dd3c6ba - Browse repository at this point
Copy the full SHA dd3c6baView commit details
Commits on Mar 21, 2023
-
Python: Make Python CI collect most of the unit tests and Fix CI name…
… conflict (#7136)
Configuration menu - View commit details
-
Copy full SHA for 7c78093 - Browse repository at this point
Copy the full SHA 7c78093View commit details
Commits on Mar 22, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 6559b8e - Browse repository at this point
Copy the full SHA 6559b8eView commit details
Commits on Mar 23, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 26f64d8 - Browse repository at this point
Copy the full SHA 26f64d8View commit details
Commits on Mar 24, 2023
-
Python: Add limit to table scan (#7163)
* Python: Add support for ORC Creates fragments based on the FileFormat. Blocked by: apache/iceberg#6997 * Revert * TableScan add limit * pyarrow limit number of rows fetched from files if limit is set * add tests for scan limit * python ci rebuild container if changes on python/dev/ * remove support for ORC * remove unused imports * increase sleep before running tests * update python docs to include limit in table query * docs fix format --------- Co-authored-by: Fokko Driesprong <[email protected]> Co-authored-by: Daniel Rückert García <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for e8e62bd - Browse repository at this point
Copy the full SHA e8e62bdView commit details
Commits on Mar 26, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 0d86db5 - Browse repository at this point
Copy the full SHA 0d86db5View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2410878 - Browse repository at this point
Copy the full SHA 2410878View commit details -
Configuration menu - View commit details
-
Copy full SHA for 52d18ab - Browse repository at this point
Copy the full SHA 52d18abView commit details -
Configuration menu - View commit details
-
Copy full SHA for bc1299b - Browse repository at this point
Copy the full SHA bc1299bView commit details
Commits on Mar 31, 2023
-
Configuration menu - View commit details
-
Copy full SHA for fafc624 - Browse repository at this point
Copy the full SHA fafc624View commit details
Commits on Apr 2, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 6f051b2 - Browse repository at this point
Copy the full SHA 6f051b2View commit details
Commits on Apr 8, 2023
-
Python: Use Prettier to format TOML (#7248)
* Python: Use Prettier to format TOML and more files * Python: Make Prettier skip the mkdocs admonoitions
Configuration menu - View commit details
-
Copy full SHA for a1c68cf - Browse repository at this point
Copy the full SHA a1c68cfView commit details
Commits on Apr 9, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 6ce27bd - Browse repository at this point
Copy the full SHA 6ce27bdView commit details -
Configuration menu - View commit details
-
Copy full SHA for 5b2a851 - Browse repository at this point
Copy the full SHA 5b2a851View commit details -
Configuration menu - View commit details
-
Copy full SHA for 127a278 - Browse repository at this point
Copy the full SHA 127a278View commit details
Commits on Apr 16, 2023
-
Build: Bump rich from 13.3.3 to 13.3.4 in /python (#7354)
Bumps [rich](https://github.com/Textualize/rich) from 13.3.3 to 13.3.4. - [Release notes](https://github.com/Textualize/rich/releases) - [Changelog](https://github.com/Textualize/rich/blob/master/CHANGELOG.md) - [Commits](Textualize/rich@v13.3.3...v13.3.4) --- updated-dependencies: - dependency-name: rich dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for ba47828 - Browse repository at this point
Copy the full SHA ba47828View commit details -
Build: Bump pytest from 7.3.0 to 7.3.1 in /python (#7355)
Bumps [pytest](https://github.com/pytest-dev/pytest) from 7.3.0 to 7.3.1. - [Release notes](https://github.com/pytest-dev/pytest/releases) - [Changelog](https://github.com/pytest-dev/pytest/blob/main/CHANGELOG.rst) - [Commits](pytest-dev/pytest@7.3.0...7.3.1) --- updated-dependencies: - dependency-name: pytest dependency-type: direct:development update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 60ce2e3 - Browse repository at this point
Copy the full SHA 60ce2e3View commit details -
Build: Bump moto from 4.1.6 to 4.1.7 in /python (#7356)
Bumps [moto](https://github.com/getmoto/moto) from 4.1.6 to 4.1.7. - [Release notes](https://github.com/getmoto/moto/releases) - [Changelog](https://github.com/getmoto/moto/blob/master/CHANGELOG.md) - [Commits](getmoto/moto@4.1.6...4.1.7) --- updated-dependencies: - dependency-name: moto dependency-type: direct:development update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 85afe6e - Browse repository at this point
Copy the full SHA 85afe6eView commit details
Commits on Apr 23, 2023
-
Build: Bump zstandard from 0.20.0 to 0.21.0 in /python (#7411)
Bumps [zstandard](https://github.com/indygreg/python-zstandard) from 0.20.0 to 0.21.0. - [Release notes](https://github.com/indygreg/python-zstandard/releases) - [Changelog](https://github.com/indygreg/python-zstandard/blob/main/docs/news.rst) - [Commits](indygreg/python-zstandard@0.20.0...0.21.0) --- updated-dependencies: - dependency-name: zstandard dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 0d15082 - Browse repository at this point
Copy the full SHA 0d15082View commit details
Commits on Apr 24, 2023
-
Python: Add mkdocstrings (#7108)
* Add mkdocstrings * Add mkdocs theme * Add theme to mkdocs and fix pages gen * Fix missing license * Fix prettier
Configuration menu - View commit details
-
Copy full SHA for 920be6c - Browse repository at this point
Copy the full SHA 920be6cView commit details
Commits on Apr 25, 2023
-
Python: Provide version ranges for each dependency (#7376)
* Python: Provide version ranges for each dependency * Python: "Fix" the range specification for `duckdb` * Python: Add support for Pandas 2 and PyArrow 7.0.0 * Python: Remove extraneous versioning justification * Python: Define explicit upper bound for Dependabot * Python: Update PyArrow lower bound from 7.0 to 9.0 Co-authored-by: Fokko Driesprong <[email protected]> --------- Co-authored-by: Fokko Driesprong <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for b2d9c14 - Browse repository at this point
Copy the full SHA b2d9c14View commit details
Commits on Apr 26, 2023
-
Python: Use fsspec implementation of LocalFileSystem (#7432)
instead of pyarrow implementation of LocalFileSystem
Configuration menu - View commit details
-
Copy full SHA for 0b39e65 - Browse repository at this point
Copy the full SHA 0b39e65View commit details
Commits on Apr 28, 2023
-
Python: fix
mkdocs
warnings fromconversions.py
(#7462)* updates to remove mkdocs warnings from_bytes() * updated comments for mkdocs WARNINGS to be removed
Configuration menu - View commit details
-
Copy full SHA for f45cfa0 - Browse repository at this point
Copy the full SHA f45cfa0View commit details -
Python: fix mkdocs warnings from visitors.py (#7464)
* updates to remove mkdocs warnings from_bytes() * updated comments for mkdocs WARNINGS to be removed * removal of warnings from mkdocs serve --strict
Configuration menu - View commit details
-
Copy full SHA for d1429b5 - Browse repository at this point
Copy the full SHA d1429b5View commit details -
Python: fix mkdocs warnings from sorting.py (#7467)
* updates to remove mkdocs warnings from_bytes() * updated comments for mkdocs WARNINGS to be removed * removal of warnings from mkdocs serve --strict * changes to SortOrder init() added order_id arg * reverted... * updated for keyword args vs args order_id * removed blank line 123 fom sorting.py * finalizing comments * Remove spaces --------- Co-authored-by: Fokko Driesprong <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 15c9a3d - Browse repository at this point
Copy the full SHA 15c9a3dView commit details
Commits on Apr 30, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 9af7c9c - Browse repository at this point
Copy the full SHA 9af7c9cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 36d098e - Browse repository at this point
Copy the full SHA 36d098eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 13f7de8 - Browse repository at this point
Copy the full SHA 13f7de8View commit details -
Build: Bump pyyaml from 5.4.1 to 6.0 in /python (#7477)
Bumps [pyyaml](https://github.com/yaml/pyyaml) from 5.4.1 to 6.0. - [Release notes](https://github.com/yaml/pyyaml/releases) - [Changelog](https://github.com/yaml/pyyaml/blob/master/CHANGES) - [Commits](yaml/pyyaml@5.4.1...6.0) --- updated-dependencies: - dependency-name: pyyaml dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for d07635d - Browse repository at this point
Copy the full SHA d07635dView commit details -
Build: Bump mkdocs-material from 9.1.5 to 9.1.8 in /python (#7476)
Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 9.1.5 to 9.1.8. - [Release notes](https://github.com/squidfunk/mkdocs-material/releases) - [Changelog](https://github.com/squidfunk/mkdocs-material/blob/master/CHANGELOG) - [Commits](squidfunk/mkdocs-material@9.1.5...9.1.8) --- updated-dependencies: - dependency-name: mkdocs-material dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 9a73cf6 - Browse repository at this point
Copy the full SHA 9a73cf6View commit details -
Python: Fix warnings in documentation (#7472)
* updates to remove mkdocs warnings from_bytes() * updated comments for mkdocs WARNINGS to be removed * removal of warnings from mkdocs serve --strict * changes to SortOrder init() added order_id arg * reverted... * updated for keyword args vs args order_id * removed blank line 123 fom sorting.py * finalizing comments * Remove spaces * fixed all mkdocs serve --strict warnings * fixed trailing whitespace * updates to comments for mkdocs serve --strict mode * updates to io/__init__.py for mkdocs warns removal * updates to remove mkdocs warns from types.py * updates for schema.py to remove mkdocs warns * updates to remove mkdoc warns from literals.py * final mkdocs fixed transforms.py * request PR changes from code review * reuest format changes for comments --------- Co-authored-by: Fokko Driesprong <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for c2b1700 - Browse repository at this point
Copy the full SHA c2b1700View commit details
Commits on May 1, 2023
-
Python: Fix code highlighting in docs (#7484)
* updates to remove mkdocs warnings from_bytes() * updated comments for mkdocs WARNINGS to be removed * removal of warnings from mkdocs serve --strict * changes to SortOrder init() added order_id arg * reverted... * updated for keyword args vs args order_id * removed blank line 123 fom sorting.py * finalizing comments * Remove spaces * fixed all mkdocs serve --strict warnings * fixed trailing whitespace * updates to comments for mkdocs serve --strict mode * updates to io/__init__.py for mkdocs warns removal * updates to remove mkdocs warns from types.py * updates for schema.py to remove mkdocs warns * updates to remove mkdoc warns from literals.py * final mkdocs fixed transforms.py * request PR changes from code review * reuest format changes for comments * fix pymdownx markdown_ext for code hihglights --------- Co-authored-by: Fokko Driesprong <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 103f007 - Browse repository at this point
Copy the full SHA 103f007View commit details -
Python: Update pre-commit to the latest version (#7436)
Removed some ignores and removed some list materialization
Configuration menu - View commit details
-
Copy full SHA for 30da936 - Browse repository at this point
Copy the full SHA 30da936View commit details
Commits on May 2, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 73a2fbe - Browse repository at this point
Copy the full SHA 73a2fbeView commit details
Commits on May 4, 2023
-
Python: Support Iceberg UUIDType from Parquet (#7523)
* add cast if needed in the visitor * Revert "add cast if needed in the visitor" This reverts commit fa86862cb68399059fb40a10f96a97745c7102a0. * add promotion from Fixed16 to UUID * add a comment explaining why the promotion is needed
Configuration menu - View commit details
-
Copy full SHA for 6bf0db8 - Browse repository at this point
Copy the full SHA 6bf0db8View commit details
Commits on May 7, 2023
-
Build: Bump mkdocstrings from 0.20.0 to 0.21.2 in /python (#7547)
Bumps [mkdocstrings](https://github.com/mkdocstrings/mkdocstrings) from 0.20.0 to 0.21.2. - [Release notes](https://github.com/mkdocstrings/mkdocstrings/releases) - [Changelog](https://github.com/mkdocstrings/mkdocstrings/blob/master/CHANGELOG.md) - [Commits](mkdocstrings/mkdocstrings@0.20.0...0.21.2) --- updated-dependencies: - dependency-name: mkdocstrings dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 5d0b4cd - Browse repository at this point
Copy the full SHA 5d0b4cdView commit details -
Build: Bump griffe from 0.26.0 to 0.27.3 in /python (#7546)
Bumps [griffe](https://github.com/mkdocstrings/griffe) from 0.26.0 to 0.27.3. - [Changelog](https://github.com/mkdocstrings/griffe/blob/master/CHANGELOG.md) - [Commits](mkdocstrings/griffe@0.26.0...0.27.3) --- updated-dependencies: - dependency-name: griffe dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 1f53261 - Browse repository at this point
Copy the full SHA 1f53261View commit details -
Build: Bump rich from 13.3.4 to 13.3.5 in /python (#7545)
Bumps [rich](https://github.com/Textualize/rich) from 13.3.4 to 13.3.5. - [Release notes](https://github.com/Textualize/rich/releases) - [Changelog](https://github.com/Textualize/rich/blob/master/CHANGELOG.md) - [Commits](Textualize/rich@v13.3.4...v13.3.5) --- updated-dependencies: - dependency-name: rich dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for f9a96d0 - Browse repository at this point
Copy the full SHA f9a96d0View commit details -
Build: Bump requests from 2.28.2 to 2.30.0 in /python (#7544)
Bumps [requests](https://github.com/psf/requests) from 2.28.2 to 2.30.0. - [Release notes](https://github.com/psf/requests/releases) - [Changelog](https://github.com/psf/requests/blob/main/HISTORY.md) - [Commits](psf/requests@v2.28.2...v2.30.0) --- updated-dependencies: - dependency-name: requests dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 4c26d4e - Browse repository at this point
Copy the full SHA 4c26d4eView commit details -
Build: Bump mkdocs-material from 9.1.8 to 9.1.9 in /python (#7542)
Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 9.1.8 to 9.1.9. - [Release notes](https://github.com/squidfunk/mkdocs-material/releases) - [Changelog](https://github.com/squidfunk/mkdocs-material/blob/master/CHANGELOG) - [Commits](squidfunk/mkdocs-material@9.1.8...9.1.9) --- updated-dependencies: - dependency-name: mkdocs-material dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for e07db79 - Browse repository at this point
Copy the full SHA e07db79View commit details -
Python: Add REST support for SigV4 (#7519)
* Add REST support for SigV4 signed requests * Add comment for second session create * lint * Address comments * Fix typing issues * Add docks * Lint * remove lint ignore
Configuration menu - View commit details
-
Copy full SHA for 8d24e01 - Browse repository at this point
Copy the full SHA 8d24e01View commit details
Commits on May 8, 2023
-
Build: Bump adlfs from 2023.1.0 to 2023.4.0 in /python (#7543)
Bumps [adlfs](https://github.com/dask/adlfs) from 2023.1.0 to 2023.4.0. - [Changelog](https://github.com/fsspec/adlfs/blob/main/CHANGELOG.md) - [Commits](fsspec/adlfs@2023.1.0...2023.4.0) --- updated-dependencies: - dependency-name: adlfs dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for fd9833e - Browse repository at this point
Copy the full SHA fd9833eView commit details
Commits on May 9, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 62b3bd7 - Browse repository at this point
Copy the full SHA 62b3bd7View commit details
Commits on May 12, 2023
-
Python: Bump PyArrow to 12.0.0 (#7588)
This includes the fix apache/arrow#34015 Now: ``` [root@fa7688db87e9 /]# mc admin trace --call s3 minio 2023-05-11T20:06:32.268 [206 Partial Content] s3.GetObject warehouse.minio:9000/nyc/taxis/metadata/00004-5eeae12f-6f3b-4c36-9413-2fbef26a94b7.metadata.json 172.22.0.2 2.791ms ↑ 148 B ↓ 9.6 KiB 2023-05-11T20:06:32.558 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/snap-3831732930279655857-1-9f7fb22f-eb4a-42d2-9657-87cc8039004d.avro 172.22.0.1 2.379ms ↑ 153 B ↓ 0 B 2023-05-11T20:06:32.566 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/snap-3831732930279655857-1-9f7fb22f-eb4a-42d2-9657-87cc8039004d.avro 172.22.0.1 1.925ms ↑ 159 B ↓ 3.9 KiB 2023-05-11T20:06:32.583 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/8e396fa9-dc45-4998-8d37-38665bf45724-m0.avro 172.22.0.1 528µs ↑ 153 B ↓ 0 B 2023-05-11T20:06:32.584 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/9f7fb22f-eb4a-42d2-9657-87cc8039004d-m0.avro 172.22.0.1 347µs ↑ 153 B ↓ 0 B 2023-05-11T20:06:32.584 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/273e2d75-5d3a-4c2c-bebd-a6ef37cadbe2-m0.avro 172.22.0.1 684µs ↑ 153 B ↓ 0 B 2023-05-11T20:06:32.584 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/5f6429bd-1ae4-4a54-820e-f53387e04e2b-m0.avro 172.22.0.1 502µs ↑ 153 B ↓ 0 B 2023-05-11T20:06:32.584 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/8f666929-42ff-4198-a203-af5c85cfb233-m0.avro 172.22.0.1 962µs ↑ 153 B ↓ 0 B 2023-05-11T20:06:32.589 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/5f6429bd-1ae4-4a54-820e-f53387e04e2b-m0.avro 172.22.0.1 1.805ms ↑ 159 B ↓ 7.1 KiB 2023-05-11T20:06:32.589 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/8e396fa9-dc45-4998-8d37-38665bf45724-m0.avro 172.22.0.1 1.54ms ↑ 159 B ↓ 7.1 KiB 2023-05-11T20:06:32.588 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/9f7fb22f-eb4a-42d2-9657-87cc8039004d-m0.avro 172.22.0.1 2.27ms ↑ 159 B ↓ 7.1 KiB 2023-05-11T20:06:32.589 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/273e2d75-5d3a-4c2c-bebd-a6ef37cadbe2-m0.avro 172.22.0.1 1.239ms ↑ 159 B ↓ 7.1 KiB 2023-05-11T20:06:32.589 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/8f666929-42ff-4198-a203-af5c85cfb233-m0.avro 172.22.0.1 2.783ms ↑ 159 B ↓ 7.1 KiB 2023-05-11T20:06:32.618 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1272-519910f9-3e1b-4a64-8745-3c34d879233d-00001.parquet 172.22.0.1 445µs ↑ 153 B ↓ 0 B 2023-05-11T20:06:32.618 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1290-df4bb385-1e5f-4841-960f-85600d3708e5-00001.parquet 172.22.0.1 319µs ↑ 153 B ↓ 0 B 2023-05-11T20:06:32.618 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1254-03dd06d8-f2da-4b9b-89ba-a2421e3f60fd-00001.parquet 172.22.0.1 263µs ↑ 153 B ↓ 0 B 2023-05-11T20:06:32.618 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1263-f568eb3b-a4d6-4a93-bcae-2b22f8baa1e7-00001.parquet 172.22.0.1 929µs ↑ 153 B ↓ 0 B 2023-05-11T20:06:32.618 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1281-d941a1d6-d041-4cf3-9e44-778191ae68fb-00001.parquet 172.22.0.1 275µs ↑ 153 B ↓ 0 B 2023-05-11T20:06:32.622 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1290-df4bb385-1e5f-4841-960f-85600d3708e5-00001.parquet 172.22.0.1 2.981ms ↑ 159 B ↓ 64 KiB 2023-05-11T20:06:32.622 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1272-519910f9-3e1b-4a64-8745-3c34d879233d-00001.parquet 172.22.0.1 6.991ms ↑ 159 B ↓ 64 KiB 2023-05-11T20:06:32.624 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1263-f568eb3b-a4d6-4a93-bcae-2b22f8baa1e7-00001.parquet 172.22.0.1 4.944ms ↑ 159 B ↓ 64 KiB 2023-05-11T20:06:32.624 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1281-d941a1d6-d041-4cf3-9e44-778191ae68fb-00001.parquet 172.22.0.1 6.287ms ↑ 159 B ↓ 64 KiB 2023-05-11T20:06:32.622 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1254-03dd06d8-f2da-4b9b-89ba-a2421e3f60fd-00001.parquet 172.22.0.1 9.967ms ↑ 159 B ↓ 64 KiB 2023-05-11T20:06:32.641 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1281-d941a1d6-d041-4cf3-9e44-778191ae68fb-00001.parquet 172.22.0.1 95.637ms ↑ 159 B ↓ 6.6 MiB 2023-05-11T20:06:32.638 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1272-519910f9-3e1b-4a64-8745-3c34d879233d-00001.parquet 172.22.0.1 711.24ms ↑ 159 B ↓ 15 MiB 2023-05-11T20:06:32.638 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1290-df4bb385-1e5f-4841-960f-85600d3708e5-00001.parquet 172.22.0.1 767.182ms ↑ 159 B ↓ 16 MiB 2023-05-11T20:06:32.640 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1263-f568eb3b-a4d6-4a93-bcae-2b22f8baa1e7-00001.parquet 172.22.0.1 1.694288s ↑ 159 B ↓ 27 MiB 2023-05-11T20:06:32.640 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1263-f568eb3b-a4d6-4a93-bcae-2b22f8baa1e7-00001.parquet 172.22.0.1 1.748438s ↑ 159 B ↓ 27 MiB 2023-05-11T20:06:32.640 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1272-519910f9-3e1b-4a64-8745-3c34d879233d-00001.parquet 172.22.0.1 1.895823s ↑ 159 B ↓ 29 MiB 2023-05-11T20:06:32.638 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1290-df4bb385-1e5f-4841-960f-85600d3708e5-00001.parquet 172.22.0.1 1.925349s ↑ 159 B ↓ 32 MiB 2023-05-11T20:06:32.644 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1281-d941a1d6-d041-4cf3-9e44-778191ae68fb-00001.parquet 172.22.0.1 1.944678s ↑ 159 B ↓ 30 MiB 2023-05-11T20:06:33.200 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1254-03dd06d8-f2da-4b9b-89ba-a2421e3f60fd-00001.parquet 172.22.0.1 1.510093s ↑ 159 B ↓ 27 MiB 2023-05-11T20:06:33.972 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1254-03dd06d8-f2da-4b9b-89ba-a2421e3f60fd-00001.parquet 172.22.0.1 1.326988s ↑ 159 B ↓ 26 MiB ``` Before: ``` ^C[root@fa7688db87e9 /]# mc admin trace --call s3 minio 2023-05-11T20:19:09.894 [206 Partial Content] s3.GetObject warehouse.minio:9000/nyc/taxis/metadata/00004-5eeae12f-6f3b-4c36-9413-2fbef26a94b7.metadata.json 172.22.0.2 897µs ↑ 148 B ↓ 9.6 KiB 2023-05-11T20:19:11.092 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/snap-3831732930279655857-1-9f7fb22f-eb4a-42d2-9657-87cc8039004d.avro 172.22.0.1 2.395ms ↑ 153 B ↓ 0 B 2023-05-11T20:19:11.113 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/snap-3831732930279655857-1-9f7fb22f-eb4a-42d2-9657-87cc8039004d.avro 172.22.0.1 1.439ms ↑ 159 B ↓ 3.9 KiB 2023-05-11T20:19:11.135 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/5f6429bd-1ae4-4a54-820e-f53387e04e2b-m0.avro 172.22.0.1 1.135ms ↑ 153 B ↓ 0 B 2023-05-11T20:19:11.136 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/273e2d75-5d3a-4c2c-bebd-a6ef37cadbe2-m0.avro 172.22.0.1 376µs ↑ 153 B ↓ 0 B 2023-05-11T20:19:11.136 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/8f666929-42ff-4198-a203-af5c85cfb233-m0.avro 172.22.0.1 465µs ↑ 153 B ↓ 0 B 2023-05-11T20:19:11.136 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/8e396fa9-dc45-4998-8d37-38665bf45724-m0.avro 172.22.0.1 841µs ↑ 153 B ↓ 0 B 2023-05-11T20:19:11.135 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/9f7fb22f-eb4a-42d2-9657-87cc8039004d-m0.avro 172.22.0.1 2.065ms ↑ 153 B ↓ 0 B 2023-05-11T20:19:11.143 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/9f7fb22f-eb4a-42d2-9657-87cc8039004d-m0.avro 172.22.0.1 1.153ms ↑ 159 B ↓ 7.1 KiB 2023-05-11T20:19:11.144 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/8e396fa9-dc45-4998-8d37-38665bf45724-m0.avro 172.22.0.1 1.105ms ↑ 159 B ↓ 7.1 KiB 2023-05-11T20:19:11.143 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/8f666929-42ff-4198-a203-af5c85cfb233-m0.avro 172.22.0.1 2.29ms ↑ 159 B ↓ 7.1 KiB 2023-05-11T20:19:11.143 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/5f6429bd-1ae4-4a54-820e-f53387e04e2b-m0.avro 172.22.0.1 2.646ms ↑ 159 B ↓ 7.1 KiB 2023-05-11T20:19:11.144 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/273e2d75-5d3a-4c2c-bebd-a6ef37cadbe2-m0.avro 172.22.0.1 1.914ms ↑ 159 B ↓ 7.1 KiB 2023-05-11T20:19:11.176 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1281-d941a1d6-d041-4cf3-9e44-778191ae68fb-00001.parquet 172.22.0.1 368µs ↑ 153 B ↓ 0 B 2023-05-11T20:19:11.176 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1290-df4bb385-1e5f-4841-960f-85600d3708e5-00001.parquet 172.22.0.1 380µs ↑ 153 B ↓ 0 B 2023-05-11T20:19:11.176 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1272-519910f9-3e1b-4a64-8745-3c34d879233d-00001.parquet 172.22.0.1 280µs ↑ 153 B ↓ 0 B 2023-05-11T20:19:11.177 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1254-03dd06d8-f2da-4b9b-89ba-a2421e3f60fd-00001.parquet 172.22.0.1 255µs ↑ 153 B ↓ 0 B 2023-05-11T20:19:11.177 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1263-f568eb3b-a4d6-4a93-bcae-2b22f8baa1e7-00001.parquet 172.22.0.1 433µs ↑ 153 B ↓ 0 B 2023-05-11T20:19:11.180 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1281-d941a1d6-d041-4cf3-9e44-778191ae68fb-00001.parquet 172.22.0.1 4.36ms ↑ 159 B ↓ 64 KiB 2023-05-11T20:19:11.182 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1263-f568eb3b-a4d6-4a93-bcae-2b22f8baa1e7-00001.parquet 172.22.0.1 3.465ms ↑ 159 B ↓ 64 KiB 2023-05-11T20:19:11.180 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1290-df4bb385-1e5f-4841-960f-85600d3708e5-00001.parquet 172.22.0.1 6.57ms ↑ 159 B ↓ 64 KiB 2023-05-11T20:19:11.180 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1272-519910f9-3e1b-4a64-8745-3c34d879233d-00001.parquet 172.22.0.1 7.434ms ↑ 159 B ↓ 64 KiB 2023-05-11T20:19:11.182 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1254-03dd06d8-f2da-4b9b-89ba-a2421e3f60fd-00001.parquet 172.22.0.1 6.438ms ↑ 159 B ↓ 64 KiB 2023-05-11T20:19:11.196 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1290-df4bb385-1e5f-4841-960f-85600d3708e5-00001.parquet 172.22.0.1 3.827ms ↑ 159 B ↓ 64 KiB 2023-05-11T20:19:11.196 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1263-f568eb3b-a4d6-4a93-bcae-2b22f8baa1e7-00001.parquet 172.22.0.1 3.971ms ↑ 159 B ↓ 64 KiB 2023-05-11T20:19:11.194 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1281-d941a1d6-d041-4cf3-9e44-778191ae68fb-00001.parquet 172.22.0.1 5.977ms ↑ 159 B ↓ 64 KiB 2023-05-11T20:19:11.198 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1254-03dd06d8-f2da-4b9b-89ba-a2421e3f60fd-00001.parquet 172.22.0.1 7.024ms ↑ 159 B ↓ 64 KiB 2023-05-11T20:19:11.196 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1272-519910f9-3e1b-4a64-8745-3c34d879233d-00001.parquet 172.22.0.1 9.302ms ↑ 159 B ↓ 64 KiB 2023-05-11T20:19:11.213 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1281-d941a1d6-d041-4cf3-9e44-778191ae68fb-00001.parquet 172.22.0.1 69.011ms ↑ 159 B ↓ 6.6 MiB 2023-05-11T20:19:11.211 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1272-519910f9-3e1b-4a64-8745-3c34d879233d-00001.parquet 172.22.0.1 685.555ms ↑ 159 B ↓ 15 MiB 2023-05-11T20:19:11.213 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1290-df4bb385-1e5f-4841-960f-85600d3708e5-00001.parquet 172.22.0.1 886.157ms ↑ 159 B ↓ 16 MiB 2023-05-11T20:19:11.211 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1263-f568eb3b-a4d6-4a93-bcae-2b22f8baa1e7-00001.parquet 172.22.0.1 1.711973s ↑ 159 B ↓ 27 MiB 2023-05-11T20:19:11.213 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1263-f568eb3b-a4d6-4a93-bcae-2b22f8baa1e7-00001.parquet 172.22.0.1 1.740533s ↑ 159 B ↓ 27 MiB 2023-05-11T20:19:11.211 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1272-519910f9-3e1b-4a64-8745-3c34d879233d-00001.parquet 172.22.0.1 1.754817s ↑ 159 B ↓ 29 MiB 2023-05-11T20:19:11.209 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1281-d941a1d6-d041-4cf3-9e44-778191ae68fb-00001.parquet 172.22.0.1 1.960224s ↑ 159 B ↓ 30 MiB 2023-05-11T20:19:11.211 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1290-df4bb385-1e5f-4841-960f-85600d3708e5-00001.parquet 172.22.0.1 2.066043s ↑ 159 B ↓ 32 MiB 2023-05-11T20:19:11.784 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1254-03dd06d8-f2da-4b9b-89ba-a2421e3f60fd-00001.parquet 172.22.0.1 1.618623s ↑ 159 B ↓ 27 MiB 2023-05-11T20:19:12.526 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1254-03dd06d8-f2da-4b9b-89ba-a2421e3f60fd-00001.parquet 172.22.0.1 1.407968s ↑ 159 B ↓ 26 MiB ```
Configuration menu - View commit details
-
Copy full SHA for 91f2634 - Browse repository at this point
Copy the full SHA 91f2634View commit details
Commits on May 14, 2023
-
Build: Bump mkdocstrings-python from 0.9.0 to 1.0.0 in /python (#7606)
Bumps [mkdocstrings-python](https://github.com/mkdocstrings/python) from 0.9.0 to 1.0.0. - [Changelog](https://github.com/mkdocstrings/python/blob/master/CHANGELOG.md) - [Commits](mkdocstrings/python@0.9.0...1.0.0) --- updated-dependencies: - dependency-name: mkdocstrings-python dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 595c15a - Browse repository at this point
Copy the full SHA 595c15aView commit details -
Build: Bump pre-commit from 3.2.2 to 3.3.1 in /python (#7605)
Bumps [pre-commit](https://github.com/pre-commit/pre-commit) from 3.2.2 to 3.3.1. - [Release notes](https://github.com/pre-commit/pre-commit/releases) - [Changelog](https://github.com/pre-commit/pre-commit/blob/main/CHANGELOG.md) - [Commits](pre-commit/pre-commit@v3.2.2...v3.3.1) --- updated-dependencies: - dependency-name: pre-commit dependency-type: direct:development update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 7a456f9 - Browse repository at this point
Copy the full SHA 7a456f9View commit details -
Build: Bump griffe from 0.27.3 to 0.27.5 in /python (#7604)
Bumps [griffe](https://github.com/mkdocstrings/griffe) from 0.27.3 to 0.27.5. - [Changelog](https://github.com/mkdocstrings/griffe/blob/master/CHANGELOG.md) - [Commits](mkdocstrings/griffe@0.27.3...0.27.5) --- updated-dependencies: - dependency-name: griffe dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for fa881ce - Browse repository at this point
Copy the full SHA fa881ceView commit details -
Build: Bump mkdocs-material from 9.1.9 to 9.1.12 in /python (#7603)
Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 9.1.9 to 9.1.12. - [Release notes](https://github.com/squidfunk/mkdocs-material/releases) - [Changelog](https://github.com/squidfunk/mkdocs-material/blob/master/CHANGELOG) - [Commits](squidfunk/mkdocs-material@9.1.9...9.1.12) --- updated-dependencies: - dependency-name: mkdocs-material dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for bed250f - Browse repository at this point
Copy the full SHA bed250fView commit details -
Build: Bump mkdocs from 1.4.2 to 1.4.3 in /python (#7602)
Bumps [mkdocs](https://github.com/mkdocs/mkdocs) from 1.4.2 to 1.4.3. - [Release notes](https://github.com/mkdocs/mkdocs/releases) - [Commits](mkdocs/mkdocs@1.4.2...1.4.3) --- updated-dependencies: - dependency-name: mkdocs dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for b5716dc - Browse repository at this point
Copy the full SHA b5716dcView commit details
Commits on May 21, 2023
-
Build: Bump mkdocs-material from 9.1.12 to 9.1.14 in /python (#7670)
Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 9.1.12 to 9.1.14. - [Release notes](https://github.com/squidfunk/mkdocs-material/releases) - [Changelog](https://github.com/squidfunk/mkdocs-material/blob/master/CHANGELOG) - [Commits](squidfunk/mkdocs-material@9.1.12...9.1.14) --- updated-dependencies: - dependency-name: mkdocs-material dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 8dfc4bc - Browse repository at this point
Copy the full SHA 8dfc4bcView commit details -
Build: Bump fastavro from 1.7.3 to 1.7.4 in /python (#7671)
Bumps [fastavro](https://github.com/fastavro/fastavro) from 1.7.3 to 1.7.4. - [Release notes](https://github.com/fastavro/fastavro/releases) - [Changelog](https://github.com/fastavro/fastavro/blob/master/ChangeLog) - [Commits](fastavro/fastavro@1.7.3...1.7.4) --- updated-dependencies: - dependency-name: fastavro dependency-type: direct:development update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for a7ba17b - Browse repository at this point
Copy the full SHA a7ba17bView commit details -
Build: Bump duckdb from 0.7.1 to 0.8.0 in /python (#7673)
Bumps [duckdb](https://github.com/duckdb/duckdb) from 0.7.1 to 0.8.0. - [Release notes](https://github.com/duckdb/duckdb/releases) - [Changelog](https://github.com/duckdb/duckdb/blob/master/tools/release-pip.py) - [Commits](duckdb/duckdb@v0.7.1...v0.8.0) --- updated-dependencies: - dependency-name: duckdb dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 3ed938b - Browse repository at this point
Copy the full SHA 3ed938bView commit details -
Build: Bump griffe from 0.27.5 to 0.28.0 in /python (#7674)
Bumps [griffe](https://github.com/mkdocstrings/griffe) from 0.27.5 to 0.28.0. - [Changelog](https://github.com/mkdocstrings/griffe/blob/master/CHANGELOG.md) - [Commits](mkdocstrings/griffe@0.27.5...0.28.0) --- updated-dependencies: - dependency-name: griffe dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 188a8b6 - Browse repository at this point
Copy the full SHA 188a8b6View commit details
Commits on May 22, 2023
-
Build: Bump pre-commit from 3.3.1 to 3.3.2 in /python (#7672)
Bumps [pre-commit](https://github.com/pre-commit/pre-commit) from 3.3.1 to 3.3.2. - [Release notes](https://github.com/pre-commit/pre-commit/releases) - [Changelog](https://github.com/pre-commit/pre-commit/blob/main/CHANGELOG.md) - [Commits](pre-commit/pre-commit@v3.3.1...v3.3.2) --- updated-dependencies: - dependency-name: pre-commit dependency-type: direct:development update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 242400d - Browse repository at this point
Copy the full SHA 242400dView commit details
Commits on May 23, 2023
-
Build: Bump requests from 2.30.0 to 2.31.0 in /python (#7689)
Bumps [requests](https://github.com/psf/requests) from 2.30.0 to 2.31.0. - [Release notes](https://github.com/psf/requests/releases) - [Changelog](https://github.com/psf/requests/blob/main/HISTORY.md) - [Commits](psf/requests@v2.30.0...v2.31.0) --- updated-dependencies: - dependency-name: requests dependency-type: direct:production ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 86975ec - Browse repository at this point
Copy the full SHA 86975ecView commit details
Commits on May 25, 2023
-
Python: Refactor integration tests (#7698)
* Python: Refactor integration tests This splits out running and building the integration tests that enables quick development iterations. I've also added ipython that will give a more meaningful error when something goes wrong with the provisioning of the tests. * Simplify SQL
Configuration menu - View commit details
-
Copy full SHA for cfc9c63 - Browse repository at this point
Copy the full SHA cfc9c63View commit details
Commits on May 30, 2023
-
Revert "Python: Refactor integration tests (#7698)" (#7729)
This reverts commit 3a584a2.
Configuration menu - View commit details
-
Copy full SHA for f44fd3a - Browse repository at this point
Copy the full SHA f44fd3aView commit details
Commits on Jun 1, 2023
-
Python: Loosen dependency on typing-extensions (#7747)
In the CI we pin the `typing-extensions` dependency on `4.5.0`, but it looks like some bug has been introduced in `4.6.1`. By loosening this requirement, we install the same version as when someone would when they don't install the dev requirements. Resolves #7746
Configuration menu - View commit details
-
Copy full SHA for d3c07fd - Browse repository at this point
Copy the full SHA d3c07fdView commit details -
Build: Bump griffe from 0.28.0 to 0.29.0 in /python (#7728)
Bumps [griffe](https://github.com/mkdocstrings/griffe) from 0.28.0 to 0.29.0. - [Changelog](https://github.com/mkdocstrings/griffe/blob/master/CHANGELOG.md) - [Commits](mkdocstrings/griffe@0.28.0...0.29.0) --- updated-dependencies: - dependency-name: griffe dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for be67d5a - Browse repository at this point
Copy the full SHA be67d5aView commit details -
Build: Bump mkdocstrings from 0.21.2 to 0.22.0 in /python (#7727)
Bumps [mkdocstrings](https://github.com/mkdocstrings/mkdocstrings) from 0.21.2 to 0.22.0. - [Release notes](https://github.com/mkdocstrings/mkdocstrings/releases) - [Changelog](https://github.com/mkdocstrings/mkdocstrings/blob/master/CHANGELOG.md) - [Commits](mkdocstrings/mkdocstrings@0.21.2...0.22.0) --- updated-dependencies: - dependency-name: mkdocstrings dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 0fbf805 - Browse repository at this point
Copy the full SHA 0fbf805View commit details -
Build: Bump mkdocstrings-python from 1.0.0 to 1.1.0 in /python (#7724)
Bumps [mkdocstrings-python](https://github.com/mkdocstrings/python) from 1.0.0 to 1.1.0. - [Changelog](https://github.com/mkdocstrings/python/blob/master/CHANGELOG.md) - [Commits](mkdocstrings/python@1.0.0...1.1.0) --- updated-dependencies: - dependency-name: mkdocstrings-python dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for a909527 - Browse repository at this point
Copy the full SHA a909527View commit details
Commits on Jun 2, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 7c15086 - Browse repository at this point
Copy the full SHA 7c15086View commit details
Commits on Jun 4, 2023
-
Build: Bump typing-extensions from 4.6.2 to 4.6.3 in /python (#7765)
Bumps [typing-extensions](https://github.com/python/typing_extensions) from 4.6.2 to 4.6.3. - [Changelog](https://github.com/python/typing_extensions/blob/main/CHANGELOG.md) - [Commits](python/typing_extensions@4.6.2...4.6.3) --- updated-dependencies: - dependency-name: typing-extensions dependency-type: direct:development update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 813d344 - Browse repository at this point
Copy the full SHA 813d344View commit details -
Build: Bump mkdocs-material from 9.1.14 to 9.1.15 in /python (#7764)
Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 9.1.14 to 9.1.15. - [Release notes](https://github.com/squidfunk/mkdocs-material/releases) - [Changelog](https://github.com/squidfunk/mkdocs-material/blob/master/CHANGELOG) - [Commits](squidfunk/mkdocs-material@9.1.14...9.1.15) --- updated-dependencies: - dependency-name: mkdocs-material dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 0adbbf3 - Browse repository at this point
Copy the full SHA 0adbbf3View commit details
Commits on Jun 5, 2023
-
Python: Refactor integration tests (#7698) (#7768)
* Python: Refactor integration tests (#7698) * Python: Refactor integration tests This splits out running and building the integration tests that enables quick development iterations. I've also added ipython that will give a more meaningful error when something goes wrong with the provisioning of the tests. * Simplify SQL * Bump to Iceberg 1.3.0
Configuration menu - View commit details
-
Copy full SHA for f44e041 - Browse repository at this point
Copy the full SHA f44e041View commit details -
Python: Add support for pydocstyle (#7772)
This will make sure that our docstrings are properly formatted. This is getting important since we also generate docs from the doc strings. This PR is about adding the framework, and then we can follow up in new PRs for each of the error codes.
Configuration menu - View commit details
-
Copy full SHA for 906e279 - Browse repository at this point
Copy the full SHA 906e279View commit details
Commits on Jun 6, 2023
-
Python: Pin
mkdocs-admon
(#7779)A new version has been released 9 hours ago, and broke the build: https://pypi.org/project/mdformat_admon/1.0.2/ Let's pin the versions.
Configuration menu - View commit details
-
Copy full SHA for 86f8a3f - Browse repository at this point
Copy the full SHA 86f8a3fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 96d2485 - Browse repository at this point
Copy the full SHA 96d2485View commit details -
Python: Add support for sequence number inheritance (#7778)
* Python: Add support for sequence number inheritance * Refactor
Configuration menu - View commit details
-
Copy full SHA for e9d4fae - Browse repository at this point
Copy the full SHA e9d4faeView commit details
Commits on Jun 7, 2023
-
Python: Fix optionality of Manifest fields (#7796)
Without these changes the Avro files that were generated couldn't be parsed by the iceberg rest catalog service.
Configuration menu - View commit details
-
Copy full SHA for b6c7a67 - Browse repository at this point
Copy the full SHA b6c7a67View commit details
Commits on Jun 9, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 95edc7f - Browse repository at this point
Copy the full SHA 95edc7fView commit details
Commits on Jun 10, 2023
-
Python: D414 and D200 docstring issues (#7806)
Co-authored-by: Michael DeRoy <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 818ebe7 - Browse repository at this point
Copy the full SHA 818ebe7View commit details -
Python: Resolve pydocstring D202 violations (#7805)
Co-authored-by: Michael DeRoy <[email protected]> Co-authored-by: Fokko Driesprong <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for ecdd235 - Browse repository at this point
Copy the full SHA ecdd235View commit details
Commits on Jun 11, 2023
-
Configuration menu - View commit details
-
Copy full SHA for cf4d5b8 - Browse repository at this point
Copy the full SHA cf4d5b8View commit details -
Configuration menu - View commit details
-
Copy full SHA for d46b7f7 - Browse repository at this point
Copy the full SHA d46b7f7View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9d15af0 - Browse repository at this point
Copy the full SHA 9d15af0View commit details -
Configuration menu - View commit details
-
Copy full SHA for a02cbb1 - Browse repository at this point
Copy the full SHA a02cbb1View commit details -
Configuration menu - View commit details
-
Copy full SHA for fafb449 - Browse repository at this point
Copy the full SHA fafb449View commit details
Commits on Jun 13, 2023
-
Python: Make Glue catalog configurable (#7781)
* Make boto3 session for Glue catalog configurable. (cherry picked from commit aecc33bda59da974f6dfaa6cba97206f320d67a9) * Fix linting issues.
Configuration menu - View commit details
-
Copy full SHA for f1df60d - Browse repository at this point
Copy the full SHA f1df60dView commit details
Commits on Jun 14, 2023
-
Python: Fix D400 Docstring voilations (#7829)
* Update decoder.py * Update file.py D400: First line should end with a period * Update reader.py D400: First line should end with a period * Update resolver.py * Update __init__.py D400: First line should end with a period * Update dynamodb.py * Update glue.py D400: First line should end with a period * Update hive.py D400: First line should end with a period * Update rest.py D400: First line should end with a period * Update console.py D400: First line should end with a period * Update output.py D400: First line should end with a period * Update output.py D400: First line should end with a period * Update __init__.py D400: First line should end with a period * Update literals.py D400: First line should end with a period * Update visitors.py D400: First line should end with a period * Update __init__.py D400: First line should end with a period * Update fsspec.py D400: First line should end with a period * Update memory.py D400: First line should end with a period * Update pyarrow.py D400: First line should end with a period * Update __init__.py D400: First line should end with a period * Update metadata.py D400: First line should end with a period * Update snapshots.py D400: First line should end with a period * Update sorting.py D400: First line should end with a period * Update config.py D400: First line should end with a period * Update datetime.py D400: First line should end with a period * Update decimal.py D400: First line should end with a period * Update parsing.py D400: First line should end with a period * Update schema_conversion.py D400: First line should end with a period * Update singleton.py D400: First line should end with a period * Update conversions.py D400: First line should end with a period * Update exceptions.py D400: First line should end with a period * Update files.py D400: First line should end with a period * Update manifest.py D400: First line should end with a period * Update partitioning.py D400: First line should end with a period * Update schema.py D400: First line should end with a period * Update serializers.py D400: First line should end with a period * Update transforms.py D400: First line should end with a period * Update typedef.py D400: First line should end with a period * Update types.py D400: First line should end with a period * Removed D400 code from .pre-commit-config.yaml * Update dynamodb.py fixed D400 compliance * Update python/pyiceberg/catalog/__init__.py Co-authored-by: Fokko Driesprong <[email protected]> * Update conversions.py D400 fix * Update metadata.py d400 fix * Update console.py d400 fix * Update visitors.py D400 fix * Update types.py D400 compliance * Update partitioning.py D400 fix * Update config.py D400 fix * Update decoder.py D400 * Update file.py D400 fix * Update schema_conversion.py D400 fixes and added small definitions for compliance purposes. * Update fsspec.py D400 fix * Update snapshots.py D400 fix * Update integration_test_glue.py D400 fix * Update integration_test_dynamodb.py D400 fix * Update conftest.py D400 fix * Update deprecated.py D400 fix * Update snappy_codec.py D400 fix * Update parser.py D400 fix * Update types.py fix D400 * Update conftest.py fix D400 * Update decoder.py fix D200 * Update snapshots.py fix D200 * Fixed trailing whitespaces * Fixed trailing whitespaces * Fixed trailing whitespaces * Fixed trailing whitespaces * Fixed trailing whitespaces * Fixed trailing whitespaces * Fixed trailing whitespaces * Fixed trailing whitespaces * Fixed trailing whitespaces * Update python/pyiceberg/catalog/__init__.py * Update python/pyiceberg/io/pyarrow.py * Update python/pyiceberg/io/pyarrow.py * Update python/pyiceberg/serializers.py --------- Co-authored-by: Fokko Driesprong <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 560d6b5 - Browse repository at this point
Copy the full SHA 560d6b5View commit details -
Python: Add pickle support (#7645)
* Python: Add pickle support * Fix test * Fix type annotation * Update python/pyiceberg/types.py * Update python/pyiceberg/types.py * Update python/pyiceberg/types.py --------- Co-authored-by: Georg Grob <[email protected]> Co-authored-by: Fokko Driesprong <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 38b6b4c - Browse repository at this point
Copy the full SHA 38b6b4cView commit details -
Python: Fixes for D205 issues (#7823)
* Fixes for D205 issues fix one comment * Update python/pyiceberg/utils/deprecated.py * Update python/pyiceberg/utils/deprecated.py --------- Co-authored-by: Michael DeRoy <[email protected]> Co-authored-by: Fokko Driesprong <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 7808b43 - Browse repository at this point
Copy the full SHA 7808b43View commit details
Commits on Jun 18, 2023
-
Configuration menu - View commit details
-
Copy full SHA for f7a4bf7 - Browse repository at this point
Copy the full SHA f7a4bf7View commit details -
Configuration menu - View commit details
-
Copy full SHA for 45aceec - Browse repository at this point
Copy the full SHA 45aceecView commit details -
Configuration menu - View commit details
-
Copy full SHA for 2192398 - Browse repository at this point
Copy the full SHA 2192398View commit details -
Configuration menu - View commit details
-
Copy full SHA for 292056c - Browse repository at this point
Copy the full SHA 292056cView commit details -
Configuration menu - View commit details
-
Copy full SHA for e69867a - Browse repository at this point
Copy the full SHA e69867aView commit details -
Configuration menu - View commit details
-
Copy full SHA for 92eb0b4 - Browse repository at this point
Copy the full SHA 92eb0b4View commit details
Commits on Jun 20, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 48267eb - Browse repository at this point
Copy the full SHA 48267ebView commit details
Commits on Jun 22, 2023
-
Python: Alter table plumbing and REST support (#6323)
* Alter table * Make the CI happy * Comments * Thanks Ryan! * Python: Bump dependencies to the latest version * Remove from docs * WIP * Comments * Make CI happy * Update docstrings * Do some renaming * Add a context manager * Rename commit to commit_transaction() * Update docs * Refresh in place * Remove redudant call * Load a fresh copy instead * Fix the docstrings * Restore CommitTableResponse * Conflicts
Configuration menu - View commit details
-
Copy full SHA for 9b915e7 - Browse repository at this point
Copy the full SHA 9b915e7View commit details -
Python: Fix D105 docstring violations (#7852)
Co-authored-by: Michael DeRoy <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 35714c6 - Browse repository at this point
Copy the full SHA 35714c6View commit details -
Configuration menu - View commit details
-
Copy full SHA for 78ee36d - Browse repository at this point
Copy the full SHA 78ee36dView commit details
Commits on Jun 23, 2023
-
Configuration menu - View commit details
-
Copy full SHA for dff1f1a - Browse repository at this point
Copy the full SHA dff1f1aView commit details -
Python: Log to logging instead of warn (#7876)
* Python: Log to logging instead of warn I was doing some final testing befor the release, and noticed that when you don't have PyArrow installed (only s3fs), and you try to describe a table, you'll get a warning: ``` root@0d64c149ba01:/vo# pyiceberg describe dbt_tabular.rides /vo/pyiceberg/io/__init__.py:283: UserWarning: Could not initialize FileIO: pyiceberg.io.pyarrow.PyArrowFileIO warnings.warn(f"Could not initialize FileIO: {io_impl}") Table format version 1 Metadata location s3://tabular-wh-us-east-1/6efbcaf4-21ae-499d-b340-3bc1a7003f52/f59f662e-878f-42e4-8b66-04b076c8ee23/metadata/00037-c9977e9d-64d7-45fc-a93a-7e10efdfecc9.gz.metadat… Table UUID f59f662e-878f-42e4-8b66-04b076c8ee23 Last Updated 1684818900590 Partition spec [] Sort order [] Current schema Schema, id=13 ├── 1: vendor: optional string (TPEP provider that provided the record) ├── 2: pickup_time: optional timestamptz (The date and time when the meter was engaged.) ├── 3: pickup_zone_name: optional string (Taxi Zone in which the taximeter was engaged.) ├── 4: pickup_borough: optional string (Borough in which the taximeter was engaged.) ├── 5: dropoff_time: optional timestamptz (The date and time when the meter was disengaged.) ├── 6: dropoff_zone_name: optional string (Taxi Zone in which the taximeter was disengaged) ├── 7: dropoff_borough: optional string (Borough in which the taximeter was disengaged) ├── 8: passenger_count: optional int (The number of passengers in the vehicle (This is a driver-entered value).) ``` I think it makes more sense to send this to logging so you don't see it in the console. * Oops
Configuration menu - View commit details
-
Copy full SHA for fcbed0d - Browse repository at this point
Copy the full SHA fcbed0dView commit details
Commits on Jun 26, 2023
-
Build: Bump pytest from 7.3.2 to 7.4.0 in /python (#7902)
Bumps [pytest](https://github.com/pytest-dev/pytest) from 7.3.2 to 7.4.0. - [Release notes](https://github.com/pytest-dev/pytest/releases) - [Changelog](https://github.com/pytest-dev/pytest/blob/main/CHANGELOG.rst) - [Commits](pytest-dev/pytest@7.3.2...7.4.0) --- updated-dependencies: - dependency-name: pytest dependency-type: direct:development update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 15032b7 - Browse repository at this point
Copy the full SHA 15032b7View commit details -
Build: Bump mkdocs-material from 9.1.16 to 9.1.17 in /python (#7903)
Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 9.1.16 to 9.1.17. - [Release notes](https://github.com/squidfunk/mkdocs-material/releases) - [Changelog](https://github.com/squidfunk/mkdocs-material/blob/master/CHANGELOG) - [Commits](squidfunk/mkdocs-material@9.1.16...9.1.17) --- updated-dependencies: - dependency-name: mkdocs-material dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 3138750 - Browse repository at this point
Copy the full SHA 3138750View commit details -
Build: Bump griffe from 0.29.0 to 0.29.1 in /python (#7904)
Bumps [griffe](https://github.com/mkdocstrings/griffe) from 0.29.0 to 0.29.1. - [Changelog](https://github.com/mkdocstrings/griffe/blob/main/CHANGELOG.md) - [Commits](mkdocstrings/griffe@0.29.0...0.29.1) --- updated-dependencies: - dependency-name: griffe dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for f1c435d - Browse repository at this point
Copy the full SHA f1c435dView commit details -
Build: Bump moto from 4.1.11 to 4.1.12 in /python (#7905)
Bumps [moto](https://github.com/getmoto/moto) from 4.1.11 to 4.1.12. - [Changelog](https://github.com/getmoto/moto/blob/master/CHANGELOG.md) - [Commits](getmoto/moto@4.1.11...4.1.12) --- updated-dependencies: - dependency-name: moto dependency-type: direct:development update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for f02325b - Browse repository at this point
Copy the full SHA f02325bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 42b43aa - Browse repository at this point
Copy the full SHA 42b43aaView commit details
Commits on Jun 27, 2023
-
Python: Pin pyparsing and update tests (#7927)
* Python: Update pyparsing tests * Lock pyparsing to <3.1.0
Configuration menu - View commit details
-
Copy full SHA for 8d482b2 - Browse repository at this point
Copy the full SHA 8d482b2View commit details
Commits on Jun 29, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 4e103ac - Browse repository at this point
Copy the full SHA 4e103acView commit details -
Configuration menu - View commit details
-
Copy full SHA for 5a144aa - Browse repository at this point
Copy the full SHA 5a144aaView commit details
Commits on Jul 3, 2023
-
Build: Bump griffe from 0.29.1 to 0.30.0 in /python (#7961)
Bumps [griffe](https://github.com/mkdocstrings/griffe) from 0.29.1 to 0.30.0. - [Changelog](https://github.com/mkdocstrings/griffe/blob/main/CHANGELOG.md) - [Commits](mkdocstrings/griffe@0.29.1...0.30.0) --- updated-dependencies: - dependency-name: griffe dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 3b52416 - Browse repository at this point
Copy the full SHA 3b52416View commit details -
Build: Bump typing-extensions from 4.6.3 to 4.7.0 in /python (#7962)
Bumps [typing-extensions](https://github.com/python/typing_extensions) from 4.6.3 to 4.7.0. - [Release notes](https://github.com/python/typing_extensions/releases) - [Changelog](https://github.com/python/typing_extensions/blob/main/CHANGELOG.md) - [Commits](python/typing_extensions@4.6.3...4.7.0) --- updated-dependencies: - dependency-name: typing-extensions dependency-type: direct:development update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 89a5361 - Browse repository at this point
Copy the full SHA 89a5361View commit details
Commits on Jul 4, 2023
-
Build: Bump pydantic from 1.10.9 to 1.10.10 in /python (#7972)
Bumps [pydantic](https://github.com/pydantic/pydantic) from 1.10.9 to 1.10.10. - [Release notes](https://github.com/pydantic/pydantic/releases) - [Changelog](https://github.com/pydantic/pydantic/blob/main/HISTORY.md) - [Commits](pydantic/pydantic@v1.10.9...v1.10.10) --- updated-dependencies: - dependency-name: pydantic dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 5db824c - Browse repository at this point
Copy the full SHA 5db824cView commit details -
Build: Bump pandas from 2.0.2 to 2.0.3 in /python (#7960)
Bumps [pandas](https://github.com/pandas-dev/pandas) from 2.0.2 to 2.0.3. - [Release notes](https://github.com/pandas-dev/pandas/releases) - [Commits](pandas-dev/pandas@v2.0.2...v2.0.3) --- updated-dependencies: - dependency-name: pandas dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 64b3903 - Browse repository at this point
Copy the full SHA 64b3903View commit details -
Python: Update
test_console
tests (#7683)* Update test_console tests * Update poetry.lock file
Configuration menu - View commit details
-
Copy full SHA for 2ac40a2 - Browse repository at this point
Copy the full SHA 2ac40a2View commit details
Commits on Jul 5, 2023
-
Python: Add gzip metadata support (#7984)
* Python: Add gzip metadata support Resolves #7977 * Remove `get` verb
Configuration menu - View commit details
-
Copy full SHA for e41241a - Browse repository at this point
Copy the full SHA e41241aView commit details
Commits on Jul 6, 2023
-
Python: Add catalog name to identifiers (#7946)
* add catalog name to the identifier of table returned by glue catalog * add catalog name to the identifier of table returned by hive catalog
Configuration menu - View commit details
-
Copy full SHA for 6118a24 - Browse repository at this point
Copy the full SHA 6118a24View commit details -
Python: Add S3 proxies to PyIceberg Catalog FileIO (#7958)
* proxies * proxies config * typo * one proxy-uri cofig * isort * lint * proxy uri for both http and https on s3fs * lint * rename property * s3.proxy-uri * lint
Configuration menu - View commit details
-
Copy full SHA for 827845c - Browse repository at this point
Copy the full SHA 827845cView commit details -
* Python: Avro write support * Add class to write Avro files and add PoC update_table api call * Add tests for the avro readers and writers This commit also fixes some small bugs uncovered by the new tests * Appease pylint and pydocstyle * Appease pre-commit hooks * Address PR review comments * Appease pre-commit hooks * Add additional metadata to avro output file --------- Co-authored-by: Fokko Driesprong <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 0991137 - Browse repository at this point
Copy the full SHA 0991137View commit details
Commits on Jul 9, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 522e074 - Browse repository at this point
Copy the full SHA 522e074View commit details -
Configuration menu - View commit details
-
Copy full SHA for 39d3a08 - Browse repository at this point
Copy the full SHA 39d3a08View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9f8e6f6 - Browse repository at this point
Copy the full SHA 9f8e6f6View commit details -
Configuration menu - View commit details
-
Copy full SHA for 331f7ee - Browse repository at this point
Copy the full SHA 331f7eeView commit details
Commits on Jul 10, 2023
-
Python: Let produce last-updated-ms field in metadata at microsecond …
…level (#8026) * Let produce last-updated-ms field in metadata at microsecond level * Remove unused function * Add test for datetime_to_millis * Lint files * Add license header in test_datetime.py
Configuration menu - View commit details
-
Copy full SHA for 125f6db - Browse repository at this point
Copy the full SHA 125f6dbView commit details -
Configuration menu - View commit details
-
Copy full SHA for 1400787 - Browse repository at this point
Copy the full SHA 1400787View commit details
Commits on Jul 15, 2023
-
Python: Remove MemoryInputStream in favor of io.BytesIO (#8074)
* Python: Remove MemoryInputStream in favor of io.BytesIO * Add pre-commit fixes
Configuration menu - View commit details
-
Copy full SHA for 80214f2 - Browse repository at this point
Copy the full SHA 80214f2View commit details
Commits on Jul 16, 2023
-
Build: Bump moto from 4.1.12 to 4.1.13 in /python (#8080)
Bumps [moto](https://github.com/getmoto/moto) from 4.1.12 to 4.1.13. - [Changelog](https://github.com/getmoto/moto/blob/master/CHANGELOG.md) - [Commits](getmoto/moto@4.1.12...4.1.13) --- updated-dependencies: - dependency-name: moto dependency-type: direct:development update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for ab5b6b1 - Browse repository at this point
Copy the full SHA ab5b6b1View commit details -
Build: Bump griffe from 0.30.0 to 0.32.1 in /python (#8078)
Bumps [griffe](https://github.com/mkdocstrings/griffe) from 0.30.0 to 0.32.1. - [Release notes](https://github.com/mkdocstrings/griffe/releases) - [Changelog](https://github.com/mkdocstrings/griffe/blob/main/CHANGELOG.md) - [Commits](mkdocstrings/griffe@0.30.0...0.32.1) --- updated-dependencies: - dependency-name: griffe dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 3da09bd - Browse repository at this point
Copy the full SHA 3da09bdView commit details -
Python: Improve Avro read performance (#8075)
Utilize __slots__ for various Avro classes. Memoize the key/value reader functions in MapReader.
Configuration menu - View commit details
-
Copy full SHA for 06a88b5 - Browse repository at this point
Copy the full SHA 06a88b5View commit details
Commits on Jul 17, 2023
-
Configuration menu - View commit details
-
Copy full SHA for d555853 - Browse repository at this point
Copy the full SHA d555853View commit details
Commits on Jul 20, 2023
-
Python: Improve Avro Parse speed (#8082)
* Python: Improve Avro Parse speed Cache the hash value of the Struct types so that when new Record objects are created time is not spent recomputing the hash value. Change the implementation of the Record class to cache the mapping from field name to position. Also utilize an array rather than a dictionary for these lookups. * fix: adjust PR comments
Configuration menu - View commit details
-
Copy full SHA for 07bd6c1 - Browse repository at this point
Copy the full SHA 07bd6c1View commit details -
* Initial code for pyiceberg JDBC Catalog * pyiceberg JDBC Catalog PR modifications * pyiceberg JDBC Catalog PR modifications * pyiceberg JDBC Catalog PR modifications * pyiceberg JDBC Catalog PR modifications * Fix lint errors * Migrate to SQLAlchemy, initial code * Migrate to SQLAlchemy * Migrate to SQLAlchemy * Apply suggestions from code review Co-authored-by: Fokko Driesprong <[email protected]> * Update python/pyiceberg/catalog/sql.py Co-authored-by: Fokko Driesprong <[email protected]> * Finish PR review changes and port JDBCCatalog unit tests over * Migrate to SQLAlchemy * Fix lint issues * Fix lint issues * Fix lint issues * Fix lint issues * Add new namespace unit test * Apply suggestions from code review Co-authored-by: Fokko Driesprong <[email protected]> * PR review fix * Merge conflict * In-sync with master --------- Co-authored-by: cccs-eric <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for da33680 - Browse repository at this point
Copy the full SHA da33680View commit details -
Build: Bump aiohttp from 3.8.4 to 3.8.5 in /python (#8119)
Bumps [aiohttp](https://github.com/aio-libs/aiohttp) from 3.8.4 to 3.8.5. - [Release notes](https://github.com/aio-libs/aiohttp/releases) - [Changelog](https://github.com/aio-libs/aiohttp/blob/v3.8.5/CHANGES.rst) - [Commits](aio-libs/aiohttp@v3.8.4...v3.8.5) --- updated-dependencies: - dependency-name: aiohttp dependency-type: indirect ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 55debfb - Browse repository at this point
Copy the full SHA 55debfbView commit details -
Build: Bump fastavro from 1.7.4 to 1.8.2 in /python (#8118)
Bumps [fastavro](https://github.com/fastavro/fastavro) from 1.7.4 to 1.8.2. - [Release notes](https://github.com/fastavro/fastavro/releases) - [Changelog](https://github.com/fastavro/fastavro/blob/master/ChangeLog) - [Commits](fastavro/fastavro@1.7.4...1.8.2) --- updated-dependencies: - dependency-name: fastavro dependency-type: direct:development update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for bfbaf68 - Browse repository at this point
Copy the full SHA bfbaf68View commit details
Commits on Jul 21, 2023
-
Python: Fix datetime test locally (#8131)
running datetime test locally errors when system timezone is not UTC
Configuration menu - View commit details
-
Copy full SHA for 9fb67a8 - Browse repository at this point
Copy the full SHA 9fb67a8View commit details
Commits on Jul 23, 2023
-
Build: Bump mkdocs-material from 9.1.18 to 9.1.19 in /python (#8135)
Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 9.1.18 to 9.1.19. - [Release notes](https://github.com/squidfunk/mkdocs-material/releases) - [Changelog](https://github.com/squidfunk/mkdocs-material/blob/master/CHANGELOG) - [Commits](squidfunk/mkdocs-material@9.1.18...9.1.19) --- updated-dependencies: - dependency-name: mkdocs-material dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 0536e95 - Browse repository at this point
Copy the full SHA 0536e95View commit details -
Build: Bump griffe from 0.32.1 to 0.32.3 in /python (#8136)
Bumps [griffe](https://github.com/mkdocstrings/griffe) from 0.32.1 to 0.32.3. - [Release notes](https://github.com/mkdocstrings/griffe/releases) - [Changelog](https://github.com/mkdocstrings/griffe/blob/main/CHANGELOG.md) - [Commits](mkdocstrings/griffe@0.32.1...0.32.3) --- updated-dependencies: - dependency-name: griffe dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for c4c8f61 - Browse repository at this point
Copy the full SHA c4c8f61View commit details -
Build: Bump pytest-checkdocs from 2.9.0 to 2.10.0 in /python (#8137)
Bumps [pytest-checkdocs](https://github.com/jaraco/pytest-checkdocs) from 2.9.0 to 2.10.0. - [Release notes](https://github.com/jaraco/pytest-checkdocs/releases) - [Changelog](https://github.com/jaraco/pytest-checkdocs/blob/main/NEWS.rst) - [Commits](jaraco/pytest-checkdocs@v2.9.0...v2.10.0) --- updated-dependencies: - dependency-name: pytest-checkdocs dependency-type: direct:development update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 8c332da - Browse repository at this point
Copy the full SHA 8c332daView commit details -
Build: Bump click from 8.1.3 to 8.1.6 in /python (#8138)
Bumps [click](https://github.com/pallets/click) from 8.1.3 to 8.1.6. - [Release notes](https://github.com/pallets/click/releases) - [Changelog](https://github.com/pallets/click/blob/8.1.6/CHANGES.rst) - [Commits](pallets/click@8.1.3...8.1.6) --- updated-dependencies: - dependency-name: click dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 674146d - Browse repository at this point
Copy the full SHA 674146dView commit details -
Configuration menu - View commit details
-
Copy full SHA for ebfaa6d - Browse repository at this point
Copy the full SHA ebfaa6dView commit details -
Python: Bump to PyParsing 3.1.0 (#8116)
* Python: Bump to PyParsing 3.1.0 * Update poetry.lock
Configuration menu - View commit details
-
Copy full SHA for b458dd2 - Browse repository at this point
Copy the full SHA b458dd2View commit details
Commits on Jul 24, 2023
-
Configuration menu - View commit details
-
Copy full SHA for efbc70b - Browse repository at this point
Copy the full SHA efbc70bView commit details
Commits on Jul 25, 2023
-
Python: Improve AVRO reading speed (#8084)
* Python: Improve Avro read performance Utilize __slots__ for various Avro classes. Memoize the key/value reader functions in MapReader. * Python: improve Avro parsing by caching struct types. Cache the struct types for ManifestEntry and ManifestFile schemas. Cache the _position_to_field_name lookup in Records if a struct type is passed. Improve StructReader to use slots and avoid isinstance() lookups on each time the structure is read, by performing the check in __init__(). Improve StructReader to determine the arguments to create_struct() once in init and reuse the result each time the structure is read, avoid a try block. * Python: Improve Avro Parse speed Cache the hash value of the Struct types so that when new Record objects are created time is not spent recomputing the hash value. Change the implementation of the Record class to cache the mapping from field name to position. Also utilize an array rather than a dictionary for these lookups. * fix some lints * fix some type casing * fix: adjust PR comments * fix: address PR feedback. * Add additional tests for InMemoryBinaryDecoder * Load entire Avro file into memory rather than streaming it * fix: disable seeking on input file * Update python/pyiceberg/avro/file.py --------- Co-authored-by: Fokko Driesprong <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 7aa1d38 - Browse repository at this point
Copy the full SHA 7aa1d38View commit details -
Uncovered these when upgrading to Pydantic 2.0
Configuration menu - View commit details
-
Copy full SHA for 9f5701a - Browse repository at this point
Copy the full SHA 9f5701aView commit details
Commits on Jul 26, 2023
-
Python: Add pyarrow hdfs support (#7997)
* Add pyarrow hdfs support * Update PR review
Configuration menu - View commit details
-
Copy full SHA for 4c6d52c - Browse repository at this point
Copy the full SHA 4c6d52cView commit details
Commits on Jul 31, 2023
-
Build: Bump mkdocs from 1.4.3 to 1.5.1 in /python (#8184)
Bumps [mkdocs](https://github.com/mkdocs/mkdocs) from 1.4.3 to 1.5.1. - [Release notes](https://github.com/mkdocs/mkdocs/releases) - [Commits](mkdocs/mkdocs@1.4.3...1.5.1) --- updated-dependencies: - dependency-name: mkdocs dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 98d87d8 - Browse repository at this point
Copy the full SHA 98d87d8View commit details -
Build: Bump mkdocstrings-python from 1.1.2 to 1.2.1 in /python (#8185)
Bumps [mkdocstrings-python](https://github.com/mkdocstrings/python) from 1.1.2 to 1.2.1. - [Release notes](https://github.com/mkdocstrings/python/releases) - [Changelog](https://github.com/mkdocstrings/python/blob/main/CHANGELOG.md) - [Commits](mkdocstrings/python@1.1.2...1.2.1) --- updated-dependencies: - dependency-name: mkdocstrings-python dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 6cdd671 - Browse repository at this point
Copy the full SHA 6cdd671View commit details -
Build: Bump rich from 13.4.2 to 13.5.0 in /python (#8186)
Bumps [rich](https://github.com/Textualize/rich) from 13.4.2 to 13.5.0. - [Release notes](https://github.com/Textualize/rich/releases) - [Changelog](https://github.com/Textualize/rich/blob/master/CHANGELOG.md) - [Commits](Textualize/rich@v13.4.2...v13.5.0) --- updated-dependencies: - dependency-name: rich dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for cd3ae8f - Browse repository at this point
Copy the full SHA cd3ae8fView commit details -
Build: Bump ray from 2.6.0 to 2.6.1 in /python (#8187)
Bumps [ray](https://github.com/ray-project/ray) from 2.6.0 to 2.6.1. - [Release notes](https://github.com/ray-project/ray/releases) - [Commits](ray-project/ray@ray-2.6.0...ray-2.6.1) --- updated-dependencies: - dependency-name: ray dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for a5f3e3f - Browse repository at this point
Copy the full SHA a5f3e3fView commit details -
Build: Bump mkdocs-material from 9.1.19 to 9.1.21 in /python (#8188)
Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 9.1.19 to 9.1.21. - [Release notes](https://github.com/squidfunk/mkdocs-material/releases) - [Changelog](https://github.com/squidfunk/mkdocs-material/blob/master/CHANGELOG) - [Commits](squidfunk/mkdocs-material@9.1.19...9.1.21) --- updated-dependencies: - dependency-name: mkdocs-material dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for ef21348 - Browse repository at this point
Copy the full SHA ef21348View commit details
Commits on Aug 2, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 9ea3d43 - Browse repository at this point
Copy the full SHA 9ea3d43View commit details -
Python: Fix passing in Glue credentials (#8209)
Co-authored-by: bmaisonneuve <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 1b8825b - Browse repository at this point
Copy the full SHA 1b8825bView commit details
Commits on Aug 3, 2023
-
Configuration menu - View commit details
-
Copy full SHA for afb303b - Browse repository at this point
Copy the full SHA afb303bView commit details -
Python: Add retry for downloading spark package (#8219)
* curl retry * fixes --------- Co-authored-by: xianyangliu <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 1a1d7e1 - Browse repository at this point
Copy the full SHA 1a1d7e1View commit details
Commits on Aug 4, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 764be90 - Browse repository at this point
Copy the full SHA 764be90View commit details -
Configuration menu - View commit details
-
Copy full SHA for c71e463 - Browse repository at this point
Copy the full SHA c71e463View commit details -
Python: Add support
date
,time
anddatetime
in to_bytes (#8214)* added datetime support for to_bytes * fmt * resuing datetime_to_micros * removed unused imports * added new test cases * fixed format * removed type checking * added new test function * removed old test cases * datetypes added in function argument --------- Co-authored-by: Rishabh Srivastava <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 92ca3f5 - Browse repository at this point
Copy the full SHA 92ca3f5View commit details
Commits on Aug 6, 2023
-
Build: Bump ray from 2.6.1 to 2.6.2 in /python (#8236)
Bumps [ray](https://github.com/ray-project/ray) from 2.6.1 to 2.6.2. - [Release notes](https://github.com/ray-project/ray/releases) - [Commits](ray-project/ray@ray-2.6.1...ray-2.6.2) --- updated-dependencies: - dependency-name: ray dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 1285fbf - Browse repository at this point
Copy the full SHA 1285fbfView commit details -
Build: Bump mkdocs from 1.5.1 to 1.5.2 in /python (#8235)
Bumps [mkdocs](https://github.com/mkdocs/mkdocs) from 1.5.1 to 1.5.2. - [Release notes](https://github.com/mkdocs/mkdocs/releases) - [Commits](mkdocs/mkdocs@1.5.1...1.5.2) --- updated-dependencies: - dependency-name: mkdocs dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 02a3c04 - Browse repository at this point
Copy the full SHA 02a3c04View commit details -
Build: Bump mkdocs-autorefs from 0.4.1 to 0.5.0 in /python (#8234)
Bumps [mkdocs-autorefs](https://github.com/mkdocstrings/autorefs) from 0.4.1 to 0.5.0. - [Release notes](https://github.com/mkdocstrings/autorefs/releases) - [Changelog](https://github.com/mkdocstrings/autorefs/blob/main/CHANGELOG.md) - [Commits](mkdocstrings/autorefs@0.4.1...0.5.0) --- updated-dependencies: - dependency-name: mkdocs-autorefs dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 1d55496 - Browse repository at this point
Copy the full SHA 1d55496View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9ce6446 - Browse repository at this point
Copy the full SHA 9ce6446View commit details
Commits on Aug 7, 2023
-
Build: Bump pytest-checkdocs from 2.10.0 to 2.10.1 in /python (#8233)
Bumps [pytest-checkdocs](https://github.com/jaraco/pytest-checkdocs) from 2.10.0 to 2.10.1. - [Release notes](https://github.com/jaraco/pytest-checkdocs/releases) - [Changelog](https://github.com/jaraco/pytest-checkdocs/blob/main/NEWS.rst) - [Commits](jaraco/pytest-checkdocs@v2.10.0...v2.10.1) --- updated-dependencies: - dependency-name: pytest-checkdocs dependency-type: direct:development update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for bab25a9 - Browse repository at this point
Copy the full SHA bab25a9View commit details -
Build: Bump rich from 13.5.0 to 13.5.2 in /python (#8232)
Bumps [rich](https://github.com/Textualize/rich) from 13.5.0 to 13.5.2. - [Release notes](https://github.com/Textualize/rich/releases) - [Changelog](https://github.com/Textualize/rich/blob/master/CHANGELOG.md) - [Commits](Textualize/rich@v13.5.0...v13.5.2) --- updated-dependencies: - dependency-name: rich dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for e6ea6d0 - Browse repository at this point
Copy the full SHA e6ea6d0View commit details -
Python: Add more tests for the Avro writer (#8067)
* Python: Add more tests for the Avro writer * Fix the tests * WIP * Update * Update python/pyiceberg/utils/datetime.py * Update python/pyiceberg/utils/datetime.py * Update python/tests/avro/test_encoder.py * WIP * Cleanup * Cleanup * Cleanup * Cleanup * Fix the tests
Configuration menu - View commit details
-
Copy full SHA for 1a6b4de - Browse repository at this point
Copy the full SHA 1a6b4deView commit details
Commits on Aug 10, 2023
-
Python: Change UUID representation to bytes (#8267)
* Change UUID Inner Representation to bytes, add integration tests for uuid and fixed * address review comments * optimize transform code * supports conversion from bytes or fixed to uuid
Configuration menu - View commit details
-
Copy full SHA for 86bd97b - Browse repository at this point
Copy the full SHA 86bd97bView commit details
Commits on Aug 11, 2023
-
Python: Simplify
Readers
using inheritance (#8291)Numerous reader classes are simply reading integers, they can all inherit from IntegerReader rather than having their own implementations of read() and skip(). Make this change.
Configuration menu - View commit details
-
Copy full SHA for 02f3990 - Browse repository at this point
Copy the full SHA 02f3990View commit details
Commits on Aug 14, 2023
-
Python: Implement Cython based decoding for Avro (#8134)
* Python: Improve Avro read performance Utilize __slots__ for various Avro classes. Memoize the key/value reader functions in MapReader. * Python: improve Avro parsing by caching struct types. Cache the struct types for ManifestEntry and ManifestFile schemas. Cache the _position_to_field_name lookup in Records if a struct type is passed. Improve StructReader to use slots and avoid isinstance() lookups on each time the structure is read, by performing the check in __init__(). Improve StructReader to determine the arguments to create_struct() once in init and reuse the result each time the structure is read, avoid a try block. * Python: Improve Avro Parse speed Cache the hash value of the Struct types so that when new Record objects are created time is not spent recomputing the hash value. Change the implementation of the Record class to cache the mapping from field name to position. Also utilize an array rather than a dictionary for these lookups. * fix some lints * fix some type casing * fix: adjust PR comments * WIP: changes for cython parsing * fix: address PR feedback. * Add additional tests for InMemoryBinaryDecoder * More work on fast Avro decoder * Work in progress * Load entire Avro file into memory rather than streaming it * fix mypy and lint warnings * fix some more pylint warnings * Fix lints and build failures * fix: move lazydict out to its own file. * fix: disable seeking on input file * Cleanup expression * fix: improve integer test case * fix: rename decoding functions * fix: remove reader functions that returned native types * fix: simplify some ReaderClasses via inheritance Numerous reader classes are simply reading integers, they can all inherit from IntegerReader rather than having their own implementations of read() and skip(). Make this change. * fix: make sqlalchemy optional * fix: make lazydict generic and move out of avro, add tests * fix: some lint fixes * fix: some cleanups and comments * fix: commit linter changes --------- Co-authored-by: Fokko Driesprong <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for f2d0298 - Browse repository at this point
Copy the full SHA f2d0298View commit details -
Build: Bump mkdocstrings-python from 1.2.1 to 1.3.0 in /python (#8310)
Bumps [mkdocstrings-python](https://github.com/mkdocstrings/python) from 1.2.1 to 1.3.0. - [Release notes](https://github.com/mkdocstrings/python/releases) - [Changelog](https://github.com/mkdocstrings/python/blob/main/CHANGELOG.md) - [Commits](mkdocstrings/python@1.2.1...1.3.0) --- updated-dependencies: - dependency-name: mkdocstrings-python dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 10662e3 - Browse repository at this point
Copy the full SHA 10662e3View commit details -
Build: Bump coverage from 7.2.7 to 7.3.0 in /python (#8308)
Bumps [coverage](https://github.com/nedbat/coveragepy) from 7.2.7 to 7.3.0. - [Release notes](https://github.com/nedbat/coveragepy/releases) - [Changelog](https://github.com/nedbat/coveragepy/blob/master/CHANGES.rst) - [Commits](nedbat/coveragepy@7.2.7...7.3.0) --- updated-dependencies: - dependency-name: coverage dependency-type: direct:development update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for d26bffc - Browse repository at this point
Copy the full SHA d26bffcView commit details -
Python: Publish Wheels (#8287)
* Python: Publish Wheels * Add working-directory * Clean up the script
Configuration menu - View commit details
-
Copy full SHA for ad237d2 - Browse repository at this point
Copy the full SHA ad237d2View commit details -
* pyiceberg: Add Google Cloud Storage support * updated project dependecies * Update python/pyiceberg/io/fsspec.py Co-authored-by: Fokko Driesprong <[email protected]> * Fix some configuration * MOAR tests * Start GCS server * Fix makefile * Move to http --------- Co-authored-by: Victoria Bukta <[email protected]> Co-authored-by: Victoria Bukta <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for cbc604a - Browse repository at this point
Copy the full SHA cbc604aView commit details
Commits on Aug 15, 2023
-
Python: Update .gitignore and remove unused imports (#8319)
Noticed a few unused imports, and I have some Cython generated files that we shouldn't commit outside of the `.gitignore`.
Configuration menu - View commit details
-
Copy full SHA for 5a9ce00 - Browse repository at this point
Copy the full SHA 5a9ce00View commit details -
Python: Delegate JSON serialization to Pydantic (#8286)
* refactor TableMetadataUtil parse_object with annotated type * refactor TableMetadataUtil parse_obj as parse_raw (from dict to string) * move parse raw and deserialization logic in a separate TableMetadata factory
Configuration menu - View commit details
-
Copy full SHA for 63049de - Browse repository at this point
Copy the full SHA 63049deView commit details
Commits on Aug 16, 2023
-
Configuration menu - View commit details
-
Copy full SHA for f1f9d55 - Browse repository at this point
Copy the full SHA f1f9d55View commit details -
Python: Optimize concurrency for limited queries (#8104)
* feat(python): remove explicit row count lock * feat(python): stop waiting for task when limit reached * fix(python): remove unnecessary arg splat * fix(python): cancel all futures once result set acquired * fix(python): consistent scan ordering when limit applied * feat(python): reuse executor (wip) * fix(python): consolidate row count tracking * feat(python): use sortedcontainers in future ordering * feat(python): global executor * fix(python): formatting * fix(python): support limit = 0 Co-authored-by: Fokko Driesprong <[email protected]> * fix(python): support limit = 0 Co-authored-by: Fokko Driesprong <[email protected]> * fix(python): support limit = 0 Co-authored-by: Fokko Driesprong <[email protected]> * feat(python): lazy re-usable executory * fix(python): appease rat * fix(python): use row counts container for mutability * fix(python): scan future cancelling * fix(python): data scan row count updates in worker * feat(python): simplify result agg * fix(python): reusable executor factory method name * fix(python): remove custom config error * fix(python): only slice result when limit provided --------- Co-authored-by: Fokko Driesprong <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 0f39e0e - Browse repository at this point
Copy the full SHA 0f39e0eView commit details -
Configuration menu - View commit details
-
Copy full SHA for bd0c506 - Browse repository at this point
Copy the full SHA bd0c506View commit details
Commits on Aug 17, 2023
-
Configuration menu - View commit details
-
Copy full SHA for a0351fd - Browse repository at this point
Copy the full SHA a0351fdView commit details
Commits on Aug 20, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 4cc8179 - Browse repository at this point
Copy the full SHA 4cc8179View commit details -
Configuration menu - View commit details
-
Copy full SHA for d95dd21 - Browse repository at this point
Copy the full SHA d95dd21View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8461f17 - Browse repository at this point
Copy the full SHA 8461f17View commit details -
Configuration menu - View commit details
-
Copy full SHA for c9caf76 - Browse repository at this point
Copy the full SHA c9caf76View commit details -
Configuration menu - View commit details
-
Copy full SHA for 14cd393 - Browse repository at this point
Copy the full SHA 14cd393View commit details
Commits on Aug 21, 2023
-
Configuration menu - View commit details
-
Copy full SHA for cd61b5a - Browse repository at this point
Copy the full SHA cd61b5aView commit details
Commits on Aug 22, 2023
-
Python: Support for adding columns (#8174)
* Python: Support add column * Add integration tests (#264) * Python: Support add column * Add the requirement (#265) * Python: Support add column --------- Co-authored-by: Fokko Driesprong <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 4c50f4a - Browse repository at this point
Copy the full SHA 4c50f4aView commit details -
Python: Fix Windows wheel build (#8371)
The version was not correctly changed. Adding some quotes fixed it.
Configuration menu - View commit details
-
Copy full SHA for 67f57f0 - Browse repository at this point
Copy the full SHA 67f57f0View commit details
Commits on Aug 27, 2023
-
Build: Bump mkdocs-material from 9.1.21 to 9.2.4 in /python (#8405)
Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 9.1.21 to 9.2.4. - [Release notes](https://github.com/squidfunk/mkdocs-material/releases) - [Changelog](https://github.com/squidfunk/mkdocs-material/blob/master/CHANGELOG) - [Commits](squidfunk/mkdocs-material@9.1.21...9.2.4) --- updated-dependencies: - dependency-name: mkdocs-material dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 753a4c5 - Browse repository at this point
Copy the full SHA 753a4c5View commit details -
Build: Bump cython from 3.0.0 to 3.0.1 in /python (#8403)
Bumps [cython](https://github.com/cython/cython) from 3.0.0 to 3.0.1. - [Release notes](https://github.com/cython/cython/releases) - [Changelog](https://github.com/cython/cython/blob/master/CHANGES.rst) - [Commits](cython/cython@3.0.0...3.0.1) --- updated-dependencies: - dependency-name: cython dependency-type: direct:development update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 20b1455 - Browse repository at this point
Copy the full SHA 20b1455View commit details -
Build: Bump griffe from 0.33.0 to 0.35.1 in /python (#8404)
Bumps [griffe](https://github.com/mkdocstrings/griffe) from 0.33.0 to 0.35.1. - [Release notes](https://github.com/mkdocstrings/griffe/releases) - [Changelog](https://github.com/mkdocstrings/griffe/blob/main/CHANGELOG.md) - [Commits](mkdocstrings/griffe@0.33.0...0.35.1) --- updated-dependencies: - dependency-name: griffe dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for c3192f5 - Browse repository at this point
Copy the full SHA c3192f5View commit details -
Build: Bump moto from 4.1.14 to 4.2.0 in /python (#8402)
Bumps [moto](https://github.com/getmoto/moto) from 4.1.14 to 4.2.0. - [Changelog](https://github.com/getmoto/moto/blob/master/CHANGELOG.md) - [Commits](getmoto/moto@4.1.14...4.2.0) --- updated-dependencies: - dependency-name: moto dependency-type: direct:development update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for d97d0bb - Browse repository at this point
Copy the full SHA d97d0bbView commit details
Commits on Aug 28, 2023
-
Python: Fix D401 pydocstyle issues (#8401)
* Fix D401 pydocstyle issues * Update python/tests/conftest.py --------- Co-authored-by: Fokko Driesprong <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 344023b - Browse repository at this point
Copy the full SHA 344023bView commit details -
Python: Check if identifier fields are valid (#8393)
* Python: Check if identifier fields are valid * Python: Check if identifier fields are valid * Python: Check if identifier fields are valid * model_validator * change to private --------- Co-authored-by: Liwei Li <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 463031b - Browse repository at this point
Copy the full SHA 463031bView commit details -
Python: Remove files file (#8411)
This is already in `manifest.py`: ```python class ManifestContent(int, Enum): DATA = 0 DELETES = 1 def __repr__(self) -> str: """Returns the string representation of the ManifestContent class.""" return f"ManifestContent.{self.name}" class ManifestEntryStatus(int, Enum): EXISTING = 0 ADDED = 1 DELETED = 2 def __repr__(self) -> str: """Returns the string representation of the ManifestEntryStatus class.""" return f"ManifestEntryStatus.{self.name}" class FileFormat(str, Enum): AVRO = "AVRO" PARQUET = "PARQUET" ORC = "ORC" def __repr__(self) -> str: """Returns the string representation of the FileFormat class.""" return f"FileFormat.{self.name}" ```
Configuration menu - View commit details
-
Copy full SHA for e28715e - Browse repository at this point
Copy the full SHA e28715eView commit details
Commits on Aug 29, 2023
-
Build: Bump pyarrow from 12.0.1 to 13.0.0 in /python (#8406)
Bumps [pyarrow](https://github.com/apache/arrow) from 12.0.1 to 13.0.0. - [Commits](apache/arrow@go/v12.0.1...go/v13.0.0) --- updated-dependencies: - dependency-name: pyarrow dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 225a355 - Browse repository at this point
Copy the full SHA 225a355View commit details
Commits on Sep 1, 2023
-
Python: Add
py.typed
in the package (#8443)I noticed that the type annotations weren't working when integrating with Pola.rs
Configuration menu - View commit details
-
Copy full SHA for 44470b6 - Browse repository at this point
Copy the full SHA 44470b6View commit details -
Configuration menu - View commit details
-
Copy full SHA for 74f7789 - Browse repository at this point
Copy the full SHA 74f7789View commit details -
Python: Bump boto3 to 1.26.79 (#8436)
This is in line with the minimal version of s3fs
Configuration menu - View commit details
-
Copy full SHA for c2de268 - Browse repository at this point
Copy the full SHA c2de268View commit details
Commits on Sep 3, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 725def2 - Browse repository at this point
Copy the full SHA 725def2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 666f3c5 - Browse repository at this point
Copy the full SHA 666f3c5View commit details -
Configuration menu - View commit details
-
Copy full SHA for 787701b - Browse repository at this point
Copy the full SHA 787701bView commit details -
Build: Bump pre-commit from 3.3.3 to 3.4.0 in /python (#8476)
Bumps [pre-commit](https://github.com/pre-commit/pre-commit) from 3.3.3 to 3.4.0. - [Release notes](https://github.com/pre-commit/pre-commit/releases) - [Changelog](https://github.com/pre-commit/pre-commit/blob/main/CHANGELOG.md) - [Commits](pre-commit/pre-commit@v3.3.3...v3.4.0) --- updated-dependencies: - dependency-name: pre-commit dependency-type: direct:development update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for e439709 - Browse repository at this point
Copy the full SHA e439709View commit details -
Build: Bump mkdocstrings-python from 1.4.0 to 1.6.0 in /python (#8481)
Bumps [mkdocstrings-python](https://github.com/mkdocstrings/python) from 1.4.0 to 1.6.0. - [Release notes](https://github.com/mkdocstrings/python/releases) - [Changelog](https://github.com/mkdocstrings/python/blob/main/CHANGELOG.md) - [Commits](mkdocstrings/python@1.4.0...1.6.0) --- updated-dependencies: - dependency-name: mkdocstrings-python dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 8be13ec - Browse repository at this point
Copy the full SHA 8be13ecView commit details -
Build: Bump griffe from 0.35.1 to 0.36.0 in /python (#8479)
Bumps [griffe](https://github.com/mkdocstrings/griffe) from 0.35.1 to 0.36.0. - [Release notes](https://github.com/mkdocstrings/griffe/releases) - [Changelog](https://github.com/mkdocstrings/griffe/blob/main/CHANGELOG.md) - [Commits](mkdocstrings/griffe@0.35.1...0.36.0) --- updated-dependencies: - dependency-name: griffe dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 679feb0 - Browse repository at this point
Copy the full SHA 679feb0View commit details -
Build: Bump pytest from 7.4.0 to 7.4.1 in /python (#8478)
Bumps [pytest](https://github.com/pytest-dev/pytest) from 7.4.0 to 7.4.1. - [Release notes](https://github.com/pytest-dev/pytest/releases) - [Changelog](https://github.com/pytest-dev/pytest/blob/main/CHANGELOG.rst) - [Commits](pytest-dev/pytest@7.4.0...7.4.1) --- updated-dependencies: - dependency-name: pytest dependency-type: direct:development update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for ce9c201 - Browse repository at this point
Copy the full SHA ce9c201View commit details -
Configuration menu - View commit details
-
Copy full SHA for a048ff4 - Browse repository at this point
Copy the full SHA a048ff4View commit details
Commits on Sep 4, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 2929f19 - Browse repository at this point
Copy the full SHA 2929f19View commit details -
Configuration menu - View commit details
-
Copy full SHA for b94cccc - Browse repository at this point
Copy the full SHA b94ccccView commit details -
Python: Bump fsspec dependencies
>=2023.1.0
(#8433)* Python: Bump fsspec dependencies `>=2023.1.0` I think it is good to bump and make the lower bound of the fsspec dependencies uniform. Also, we don't test for the older versions. s3fs `2023.1.0` uses aiobotocore `2.4.2`: https://github.com/fsspec/s3fs/blob/2023.1.0/requirements.txt And that depends on `botocore>=1.27.59,<1.27.60`: https://github.com/aio-libs/aiobotocore/blob/2.4.2/setup.py#L10` Which is also close to our `boto3` pin of `>=1.24.59`: apache/iceberg#8436 * Fix poetry.lock
Configuration menu - View commit details
-
Copy full SHA for ef8173c - Browse repository at this point
Copy the full SHA ef8173cView commit details
Commits on Sep 8, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 6c3b01c - Browse repository at this point
Copy the full SHA 6c3b01cView commit details
Commits on Sep 9, 2023
-
Python: Standardized integer types over relying on C types (#8535)
Utilize libc.stdint for the definition of unsigned 64 bit integers. Change the array.array type to use integers that are at least 64 bits in width. Changes motiviated by differences in Windows builds
Configuration menu - View commit details
-
Copy full SHA for 18e25a6 - Browse repository at this point
Copy the full SHA 18e25a6View commit details -
Configuration menu - View commit details
-
Copy full SHA for 025dfa4 - Browse repository at this point
Copy the full SHA 025dfa4View commit details -
Configuration menu - View commit details
-
Copy full SHA for 7494e6d - Browse repository at this point
Copy the full SHA 7494e6dView commit details
Commits on Sep 10, 2023
-
Configuration menu - View commit details
-
Copy full SHA for eea61ef - Browse repository at this point
Copy the full SHA eea61efView commit details -
Configuration menu - View commit details
-
Copy full SHA for 103f328 - Browse repository at this point
Copy the full SHA 103f328View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6c9e5f9 - Browse repository at this point
Copy the full SHA 6c9e5f9View commit details -
Configuration menu - View commit details
-
Copy full SHA for 3e9c2d0 - Browse repository at this point
Copy the full SHA 3e9c2d0View commit details -
Configuration menu - View commit details
-
Copy full SHA for d509737 - Browse repository at this point
Copy the full SHA d509737View commit details -
Configuration menu - View commit details
-
Copy full SHA for 52b5888 - Browse repository at this point
Copy the full SHA 52b5888View commit details -
Python: Add checks after building the wheels (#8532)
* Python: Add checks after building the wheels * Improvements
Configuration menu - View commit details
-
Copy full SHA for 446c737 - Browse repository at this point
Copy the full SHA 446c737View commit details -
Configuration menu - View commit details
-
Copy full SHA for 40c15f1 - Browse repository at this point
Copy the full SHA 40c15f1View commit details -
Python: Non-Cython fallback Avro parser (#8545)
* Python: Non-Cython fallback Avro parser * Python: Non-Cython fallback Avro parser
Configuration menu - View commit details
-
Copy full SHA for d323d8e - Browse repository at this point
Copy the full SHA d323d8eView commit details -
Configuration menu - View commit details
-
Copy full SHA for ee3bf45 - Browse repository at this point
Copy the full SHA ee3bf45View commit details
Commits on Sep 12, 2023
-
Python: Inline the Filesystem imports (#8548)
* Python: Inline the Filesystem imports It can be that certain build flags are turned off: ``` -DARROW_GCS=ON: Build Arrow with GCS support (requires the GCloud SDK for C++) -DARROW_HDFS=ON: Arrow integration with libhdfs for accessing the Hadoop Filesystem ``` From: https://arrow.apache.org/docs/dev/developers/cpp/building.html#optional-components This will cause an ImportError when importing `pyarrow.py`, while it can be that you don't want to use a missing FS. Therefore it is better to inline the imports * Move imports to the top
Configuration menu - View commit details
-
Copy full SHA for e090fb1 - Browse repository at this point
Copy the full SHA e090fb1View commit details -
Python: Fix caching of FileSystem (#8549)
Before: ``` python3 /tmp/benchmark.py import: 0.175605 seconds catalog: 0.060079 seconds table: 0.245859 seconds scan: 5.218688 seconds Rows: 119890 ``` After: ``` python3 /tmp/benchmark.py import: 0.169811 seconds catalog: 0.054512 seconds table: 0.233786 seconds scan: 2.165105 seconds Rows: 119890 ```
Configuration menu - View commit details
-
Copy full SHA for e62f7c4 - Browse repository at this point
Copy the full SHA e62f7c4View commit details
Commits on Sep 17, 2023
-
Build: Bump mkdocs-section-index from 0.3.5 to 0.3.7 in /python (#8572)
Bumps [mkdocs-section-index](https://github.com/oprypin/mkdocs-section-index) from 0.3.5 to 0.3.7. - [Release notes](https://github.com/oprypin/mkdocs-section-index/releases) - [Commits](oprypin/mkdocs-section-index@v0.3.5...v0.3.7) --- updated-dependencies: - dependency-name: mkdocs-section-index dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for e758d74 - Browse repository at this point
Copy the full SHA e758d74View commit details -
Build: Bump mkdocstrings-python from 1.6.2 to 1.7.0 in /python (#8573)
Bumps [mkdocstrings-python](https://github.com/mkdocstrings/python) from 1.6.2 to 1.7.0. - [Release notes](https://github.com/mkdocstrings/python/releases) - [Changelog](https://github.com/mkdocstrings/python/blob/main/CHANGELOG.md) - [Commits](mkdocstrings/python@1.6.2...1.7.0) --- updated-dependencies: - dependency-name: mkdocstrings-python dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for a0591ef - Browse repository at this point
Copy the full SHA a0591efView commit details -
Build: Bump moto from 4.2.2 to 4.2.3 in /python (#8574)
Bumps [moto](https://github.com/getmoto/moto) from 4.2.2 to 4.2.3. - [Release notes](https://github.com/getmoto/moto/releases) - [Changelog](https://github.com/getmoto/moto/blob/master/CHANGELOG.md) - [Commits](getmoto/moto@4.2.2...4.2.3) --- updated-dependencies: - dependency-name: moto dependency-type: direct:development update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 8929e34 - Browse repository at this point
Copy the full SHA 8929e34View commit details -
Build: Bump mkdocs-material from 9.2.8 to 9.3.1 in /python (#8576)
Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 9.2.8 to 9.3.1. - [Release notes](https://github.com/squidfunk/mkdocs-material/releases) - [Changelog](https://github.com/squidfunk/mkdocs-material/blob/master/CHANGELOG) - [Commits](squidfunk/mkdocs-material@9.2.8...9.3.1) --- updated-dependencies: - dependency-name: mkdocs-material dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for f905893 - Browse repository at this point
Copy the full SHA f905893View commit details -
Build: Bump griffe from 0.36.1 to 0.36.2 in /python (#8575)
Bumps [griffe](https://github.com/mkdocstrings/griffe) from 0.36.1 to 0.36.2. - [Release notes](https://github.com/mkdocstrings/griffe/releases) - [Changelog](https://github.com/mkdocstrings/griffe/blob/main/CHANGELOG.md) - [Commits](mkdocstrings/griffe@0.36.1...0.36.2) --- updated-dependencies: - dependency-name: griffe dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for f0eca94 - Browse repository at this point
Copy the full SHA f0eca94View commit details
Commits on Sep 20, 2023
-
Python: Compute parquet stats (#7831)
* Add function to compute parquet file metadata * Addition of docstring and extra parameter to avoid reading the file unnecessarily * Refactor the statistics computation entirely to use pyarrow metadata This commit makes sure to test the metadata computation both using `pyarrow.parquet.ParqueWriter` and `pyarrow.parquet.write_to_dataset`. * Appease pre-commit hooks * Fix temporary path * Make the metrics mode configurable as documented here: https://iceberg.apache.org/docs/latest/configuration/ * Initialize binary serializers only once * Log arrow not implemented exception * Fix None comparison expression * Add map column to test data * Moving pyarrow specific code to io.pyarrow * type annotation * Refactor the stats collection using the pyarrow visitor * Clean redundant code and add warning message to the log * Address some of the review comments * Add tests to check of the number of columns found by the statistics collector is correct * We don't want to truncate numeric data types * Verify match of Iceberg types with Parquet physical types * Fix truncation of upper bounds * Transform asserts to ValueErrors * Add review suggestions * Address simple code style review comments * Fix potential null write * Apply function name refactoring * Move pyarrow statistics tests to a new file * Disable stats computation for nested types * Modularize the fill_parquet_file_metadata function * Allow metrics modes to have extra whitespace but not other trailing characters * Move upper bound truncation logic to another file * Be defensive with regards to missing row group statistics * Add tests for structs * Remove special treatment of UUIDType * Rely on parquet column path rather than column order This commit adds a visitor to compute a mapping from parquet column path to iceberg field ID. * Change mood to imperative to appease linter * Factor out the logic to obtain the current table schema
Configuration menu - View commit details
-
Copy full SHA for 601d5a1 - Browse repository at this point
Copy the full SHA 601d5a1View commit details -
Python: Register table functionality for SQL Catalog (#8589)
* Add register table implementation for sql catalog * Fix lint
Configuration menu - View commit details
-
Copy full SHA for 87fa047 - Browse repository at this point
Copy the full SHA 87fa047View commit details
Commits on Sep 22, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 6de9760 - Browse repository at this point
Copy the full SHA 6de9760View commit details -
Python: Add
__repr__
method to Table class (#8447)* Python: Add __repr__ method to Table class * update test for __repr__ of Table class * add sort_order to table repr --------- Co-authored-by: Thi Cam Tu Phan <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for ba05fee - Browse repository at this point
Copy the full SHA ba05feeView commit details -
Configuration menu - View commit details
-
Copy full SHA for 054ef7c - Browse repository at this point
Copy the full SHA 054ef7cView commit details -
Python: Improve Glue catalog using Boto3 types (#8304)
* Python: improve Glue catalog using Boto3 types * fix: address PR feedback --------- Co-authored-by: Fokko Driesprong <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for ac9b923 - Browse repository at this point
Copy the full SHA ac9b923View commit details -
Python: Add
__repr__
forCatalog
(#8558)* Python: Add `__repr__` for `Table` and `Catalog` * remove properties in `__repr__` output * remove table `__repr__` * clean up catalog __repr__ and add test * actually use repr instead of str * Update python/tests/catalog/test_base.py Co-authored-by: Fokko Driesprong <[email protected]> * Update python/pyiceberg/catalog/__init__.py * Update python/tests/catalog/test_base.py --------- Co-authored-by: Fokko Driesprong <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for a1d7186 - Browse repository at this point
Copy the full SHA a1d7186View commit details -
Python: Replace
isort
,pylint
,prettier
,pyupgrade
&flake8
…… with `ruff` (#8408)
Configuration menu - View commit details
-
Copy full SHA for 06abb3b - Browse repository at this point
Copy the full SHA 06abb3bView commit details
Commits on Sep 24, 2023
-
Build: Bump mkdocs from 1.5.2 to 1.5.3 in /python (#8633)
Bumps [mkdocs](https://github.com/mkdocs/mkdocs) from 1.5.2 to 1.5.3. - [Release notes](https://github.com/mkdocs/mkdocs/releases) - [Commits](mkdocs/mkdocs@1.5.2...1.5.3) --- updated-dependencies: - dependency-name: mkdocs dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 831a5bb - Browse repository at this point
Copy the full SHA 831a5bbView commit details -
Build: Bump mkdocs-material-extensions from 1.1.1 to 1.2 in /python (…
…#8632) Bumps [mkdocs-material-extensions](https://github.com/facelessuser/mkdocs-material-extensions) from 1.1.1 to 1.2. - [Release notes](https://github.com/facelessuser/mkdocs-material-extensions/releases) - [Changelog](https://github.com/facelessuser/mkdocs-material-extensions/blob/master/changelog.md) - [Commits](facelessuser/mkdocs-material-extensions@1.1.1...1.2) --- updated-dependencies: - dependency-name: mkdocs-material-extensions dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for d6eefda - Browse repository at this point
Copy the full SHA d6eefdaView commit details -
Build: Bump moto from 4.2.3 to 4.2.4 in /python (#8631)
Bumps [moto](https://github.com/getmoto/moto) from 4.2.3 to 4.2.4. - [Release notes](https://github.com/getmoto/moto/releases) - [Changelog](https://github.com/getmoto/moto/blob/master/CHANGELOG.md) - [Commits](getmoto/moto@4.2.3...4.2.4) --- updated-dependencies: - dependency-name: moto dependency-type: direct:development update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 2c52828 - Browse repository at this point
Copy the full SHA 2c52828View commit details
Commits on Sep 25, 2023
-
Build: Bump pytest from 7.4.1 to 7.4.2 in /python (#8630)
Bumps [pytest](https://github.com/pytest-dev/pytest) from 7.4.1 to 7.4.2. - [Release notes](https://github.com/pytest-dev/pytest/releases) - [Changelog](https://github.com/pytest-dev/pytest/blob/main/CHANGELOG.rst) - [Commits](pytest-dev/pytest@7.4.1...7.4.2) --- updated-dependencies: - dependency-name: pytest dependency-type: direct:development update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 14937b8 - Browse repository at this point
Copy the full SHA 14937b8View commit details -
Build: Bump mkdocs-material from 9.3.1 to 9.4.1 in /python (#8628)
Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 9.3.1 to 9.4.1. - [Release notes](https://github.com/squidfunk/mkdocs-material/releases) - [Changelog](https://github.com/squidfunk/mkdocs-material/blob/master/CHANGELOG) - [Commits](squidfunk/mkdocs-material@9.3.1...9.4.1) --- updated-dependencies: - dependency-name: mkdocs-material dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 9ba437f - Browse repository at this point
Copy the full SHA 9ba437fView commit details -
Build: Bump mkdocs-literate-nav from 0.6.0 to 0.6.1 in /python (#8627)
Bumps [mkdocs-literate-nav](https://github.com/oprypin/mkdocs-literate-nav) from 0.6.0 to 0.6.1. - [Release notes](https://github.com/oprypin/mkdocs-literate-nav/releases) - [Commits](oprypin/mkdocs-literate-nav@v0.6.0...v0.6.1) --- updated-dependencies: - dependency-name: mkdocs-literate-nav dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 583c4bc - Browse repository at this point
Copy the full SHA 583c4bcView commit details
Commits on Sep 28, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 7261ebb - Browse repository at this point
Copy the full SHA 7261ebbView commit details -
Configuration menu - View commit details
-
Copy full SHA for 624e825 - Browse repository at this point
Copy the full SHA 624e825View commit details
Commits on Sep 29, 2023
-
Python: ManifestWriter and ManifestListWriter (#8622)
* add ManifestWriter and ManifestListWriter * fix lint issue * remove assert, fix format issue * add prepare to ManifestWriter, remove TODO, fix format issue * fix some nit issue, add prepare... to ensure the correctness of data written * fix format issue * fix lint issue * avoid creating too much objects, handling v1, v2 data_file_type and DataFile class properly. * modify tests * refactor the way of handling two version of DataFile record * add integration tests, fix bugs, change PartitionSummary to a function * fix format issue * make data_type_v2 constants
Configuration menu - View commit details
-
Copy full SHA for 778c66f - Browse repository at this point
Copy the full SHA 778c66fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 44c5635 - Browse repository at this point
Copy the full SHA 44c5635View commit details -
Configuration menu - View commit details
-
Copy full SHA for 0a9f113 - Browse repository at this point
Copy the full SHA 0a9f113View commit details