Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Python: Migrate from iceberg to iceberg-python #3

Merged
merged 643 commits into from
Sep 30, 2023
Merged

Python: Migrate from iceberg to iceberg-python #3

merged 643 commits into from
Sep 30, 2023
This pull request is big! We’re only showing the most recent 250 commits.

Commits on Mar 5, 2023

  1. Build: Bump duckdb from 0.7.0 to 0.7.1 in /python (#7018)

    Bumps [duckdb](https://github.com/duckdb/duckdb) from 0.7.0 to 0.7.1.
    - [Release notes](https://github.com/duckdb/duckdb/releases)
    - [Changelog](https://github.com/duckdb/duckdb/blob/master/tools/release-pip.py)
    - [Commits](duckdb/duckdb@v0.7.0...v0.7.1)
    
    ---
    updated-dependencies:
    - dependency-name: duckdb
      dependency-type: direct:production
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Mar 5, 2023
    Configuration menu
    Copy the full SHA
    f2048e6 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    d9bebc4 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    627c82d View commit details
    Browse the repository at this point in the history
  4. Build: Bump coverage from 7.2.0 to 7.2.1 in /python (#7017)

    Bumps [coverage](https://github.com/nedbat/coveragepy) from 7.2.0 to 7.2.1.
    - [Release notes](https://github.com/nedbat/coveragepy/releases)
    - [Changelog](https://github.com/nedbat/coveragepy/blob/master/CHANGES.rst)
    - [Commits](nedbat/coveragepy@7.2.0...7.2.1)
    
    ---
    updated-dependencies:
    - dependency-name: coverage
      dependency-type: direct:development
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Mar 5, 2023
    Configuration menu
    Copy the full SHA
    900d5a4 View commit details
    Browse the repository at this point in the history

Commits on Mar 6, 2023

  1. Python: Don't warn on an identifier (#6844)

    When we pass in a warehouse identifier, we don't
    want to emit a warning. Also, the help message won't
    be helpful:
    
    ```
    No preferred file implementation for scheme:
    ```
    
    Since there is no scheme.
    Fokko authored Mar 6, 2023
    Configuration menu
    Copy the full SHA
    6a42a1a View commit details
    Browse the repository at this point in the history

Commits on Mar 7, 2023

  1. Configuration menu
    Copy the full SHA
    c686682 View commit details
    Browse the repository at this point in the history

Commits on Mar 12, 2023

  1. Build: Bump moto from 4.1.3 to 4.1.4 in /python (#7082)

    Bumps [moto](https://github.com/getmoto/moto) from 4.1.3 to 4.1.4.
    - [Release notes](https://github.com/getmoto/moto/releases)
    - [Changelog](https://github.com/getmoto/moto/blob/master/CHANGELOG.md)
    - [Commits](getmoto/moto@4.1.3...4.1.4)
    
    ---
    updated-dependencies:
    - dependency-name: moto
      dependency-type: direct:development
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Mar 12, 2023
    Configuration menu
    Copy the full SHA
    572921f View commit details
    Browse the repository at this point in the history
  2. Build: Bump pydantic from 1.10.5 to 1.10.6 in /python (#7083)

    Bumps [pydantic](https://github.com/pydantic/pydantic) from 1.10.5 to 1.10.6.
    - [Release notes](https://github.com/pydantic/pydantic/releases)
    - [Changelog](https://github.com/pydantic/pydantic/blob/v1.10.6/HISTORY.md)
    - [Commits](pydantic/pydantic@v1.10.5...v1.10.6)
    
    ---
    updated-dependencies:
    - dependency-name: pydantic
      dependency-type: direct:production
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Mar 12, 2023
    Configuration menu
    Copy the full SHA
    133a9ef View commit details
    Browse the repository at this point in the history
  3. Build: Bump fastavro from 1.7.2 to 1.7.3 in /python (#7084)

    Bumps [fastavro](https://github.com/fastavro/fastavro) from 1.7.2 to 1.7.3.
    - [Release notes](https://github.com/fastavro/fastavro/releases)
    - [Changelog](https://github.com/fastavro/fastavro/blob/master/ChangeLog)
    - [Commits](fastavro/fastavro@1.7.2...1.7.3)
    
    ---
    updated-dependencies:
    - dependency-name: fastavro
      dependency-type: direct:development
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Mar 12, 2023
    Configuration menu
    Copy the full SHA
    8918bb8 View commit details
    Browse the repository at this point in the history

Commits on Mar 15, 2023

  1. Python: Integration tests (#6398)

    * Integration tests
    
    * First version
    
    * Add caching
    
    * Add caching
    
    * Restore pyproject
    
    * WIP
    
    * NaN seems to be broken
    
    * WIP
    
    * Coming along
    
    * Cleanup
    
    * Install duckdb
    
    * Cleanup
    
    * Revert changes to poetry
    
    * Make it even nicer
    
    * Revert unneeded change
    
    * Update Spark version
    
    * Make test passing
    
    * comments
    Fokko authored Mar 15, 2023
    Configuration menu
    Copy the full SHA
    3d78ecb View commit details
    Browse the repository at this point in the history

Commits on Mar 19, 2023

  1. Configuration menu
    Copy the full SHA
    9546da7 View commit details
    Browse the repository at this point in the history
  2. Build: Bump coverage from 7.2.1 to 7.2.2 in /python (#7142)

    Bumps [coverage](https://github.com/nedbat/coveragepy) from 7.2.1 to 7.2.2.
    - [Release notes](https://github.com/nedbat/coveragepy/releases)
    - [Changelog](https://github.com/nedbat/coveragepy/blob/master/CHANGES.rst)
    - [Commits](nedbat/coveragepy@7.2.1...7.2.2)
    
    ---
    updated-dependencies:
    - dependency-name: coverage
      dependency-type: direct:development
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Mar 19, 2023
    Configuration menu
    Copy the full SHA
    dd3c6ba View commit details
    Browse the repository at this point in the history

Commits on Mar 21, 2023

  1. Configuration menu
    Copy the full SHA
    7c78093 View commit details
    Browse the repository at this point in the history

Commits on Mar 22, 2023

  1. Configuration menu
    Copy the full SHA
    6559b8e View commit details
    Browse the repository at this point in the history

Commits on Mar 23, 2023

  1. Configuration menu
    Copy the full SHA
    26f64d8 View commit details
    Browse the repository at this point in the history

Commits on Mar 24, 2023

  1. Python: Add limit to table scan (#7163)

    * Python: Add support for ORC
    
    Creates fragments based on the FileFormat.
    
    Blocked by: apache/iceberg#6997
    
    * Revert
    
    * TableScan add limit
    
    * pyarrow limit number of rows fetched from files if limit is set
    
    * add tests for scan limit
    
    * python ci rebuild container if changes on python/dev/
    
    * remove support for ORC
    
    * remove unused imports
    
    * increase sleep before running tests
    
    * update python docs to include limit in table query
    
    * docs fix format
    
    ---------
    
    Co-authored-by: Fokko Driesprong <[email protected]>
    Co-authored-by: Daniel Rückert García <[email protected]>
    3 people authored Mar 24, 2023
    Configuration menu
    Copy the full SHA
    e8e62bd View commit details
    Browse the repository at this point in the history

Commits on Mar 26, 2023

  1. Configuration menu
    Copy the full SHA
    0d86db5 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    2410878 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    52d18ab View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    bc1299b View commit details
    Browse the repository at this point in the history

Commits on Mar 31, 2023

  1. Configuration menu
    Copy the full SHA
    fafc624 View commit details
    Browse the repository at this point in the history

Commits on Apr 2, 2023

  1. Configuration menu
    Copy the full SHA
    6f051b2 View commit details
    Browse the repository at this point in the history

Commits on Apr 8, 2023

  1. Python: Use Prettier to format TOML (#7248)

    * Python: Use Prettier to format TOML and more files
    
    * Python: Make Prettier skip the mkdocs admonoitions
    deepyaman authored Apr 8, 2023
    Configuration menu
    Copy the full SHA
    a1c68cf View commit details
    Browse the repository at this point in the history

Commits on Apr 9, 2023

  1. Configuration menu
    Copy the full SHA
    6ce27bd View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    5b2a851 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    127a278 View commit details
    Browse the repository at this point in the history

Commits on Apr 16, 2023

  1. Build: Bump rich from 13.3.3 to 13.3.4 in /python (#7354)

    Bumps [rich](https://github.com/Textualize/rich) from 13.3.3 to 13.3.4.
    - [Release notes](https://github.com/Textualize/rich/releases)
    - [Changelog](https://github.com/Textualize/rich/blob/master/CHANGELOG.md)
    - [Commits](Textualize/rich@v13.3.3...v13.3.4)
    
    ---
    updated-dependencies:
    - dependency-name: rich
      dependency-type: direct:production
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Apr 16, 2023
    Configuration menu
    Copy the full SHA
    ba47828 View commit details
    Browse the repository at this point in the history
  2. Build: Bump pytest from 7.3.0 to 7.3.1 in /python (#7355)

    Bumps [pytest](https://github.com/pytest-dev/pytest) from 7.3.0 to 7.3.1.
    - [Release notes](https://github.com/pytest-dev/pytest/releases)
    - [Changelog](https://github.com/pytest-dev/pytest/blob/main/CHANGELOG.rst)
    - [Commits](pytest-dev/pytest@7.3.0...7.3.1)
    
    ---
    updated-dependencies:
    - dependency-name: pytest
      dependency-type: direct:development
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Apr 16, 2023
    Configuration menu
    Copy the full SHA
    60ce2e3 View commit details
    Browse the repository at this point in the history
  3. Build: Bump moto from 4.1.6 to 4.1.7 in /python (#7356)

    Bumps [moto](https://github.com/getmoto/moto) from 4.1.6 to 4.1.7.
    - [Release notes](https://github.com/getmoto/moto/releases)
    - [Changelog](https://github.com/getmoto/moto/blob/master/CHANGELOG.md)
    - [Commits](getmoto/moto@4.1.6...4.1.7)
    
    ---
    updated-dependencies:
    - dependency-name: moto
      dependency-type: direct:development
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Apr 16, 2023
    Configuration menu
    Copy the full SHA
    85afe6e View commit details
    Browse the repository at this point in the history

Commits on Apr 23, 2023

  1. Build: Bump zstandard from 0.20.0 to 0.21.0 in /python (#7411)

    Bumps [zstandard](https://github.com/indygreg/python-zstandard) from 0.20.0 to 0.21.0.
    - [Release notes](https://github.com/indygreg/python-zstandard/releases)
    - [Changelog](https://github.com/indygreg/python-zstandard/blob/main/docs/news.rst)
    - [Commits](indygreg/python-zstandard@0.20.0...0.21.0)
    
    ---
    updated-dependencies:
    - dependency-name: zstandard
      dependency-type: direct:production
      update-type: version-update:semver-minor
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Apr 23, 2023
    Configuration menu
    Copy the full SHA
    0d15082 View commit details
    Browse the repository at this point in the history

Commits on Apr 24, 2023

  1. Python: Add mkdocstrings (#7108)

    * Add mkdocstrings
    
    * Add mkdocs theme
    
    * Add theme to mkdocs and fix pages gen
    
    * Fix missing license
    
    * Fix prettier
    LuigiCerone authored Apr 24, 2023
    Configuration menu
    Copy the full SHA
    920be6c View commit details
    Browse the repository at this point in the history

Commits on Apr 25, 2023

  1. Python: Provide version ranges for each dependency (#7376)

    * Python: Provide version ranges for each dependency
    
    * Python: "Fix" the range specification for `duckdb`
    
    * Python: Add support for Pandas 2 and PyArrow 7.0.0
    
    * Python: Remove extraneous versioning justification
    
    * Python: Define explicit upper bound for Dependabot
    
    * Python: Update PyArrow lower bound from 7.0 to 9.0
    
    Co-authored-by: Fokko Driesprong <[email protected]>
    
    ---------
    
    Co-authored-by: Fokko Driesprong <[email protected]>
    deepyaman and Fokko authored Apr 25, 2023
    Configuration menu
    Copy the full SHA
    b2d9c14 View commit details
    Browse the repository at this point in the history

Commits on Apr 26, 2023

  1. Python: Use fsspec implementation of LocalFileSystem (#7432)

    instead of pyarrow implementation of LocalFileSystem
    kevinjqliu authored Apr 26, 2023
    Configuration menu
    Copy the full SHA
    0b39e65 View commit details
    Browse the repository at this point in the history

Commits on Apr 28, 2023

  1. Python: fix mkdocs warnings from conversions.py (#7462)

    * updates to remove mkdocs warnings from_bytes()
    
    * updated comments for mkdocs WARNINGS to be removed
    DarthData410 authored Apr 28, 2023
    Configuration menu
    Copy the full SHA
    f45cfa0 View commit details
    Browse the repository at this point in the history
  2. Python: fix mkdocs warnings from visitors.py (#7464)

    * updates to remove mkdocs warnings from_bytes()
    
    * updated comments for mkdocs WARNINGS to be removed
    
    * removal of warnings from mkdocs serve --strict
    DarthData410 authored Apr 28, 2023
    Configuration menu
    Copy the full SHA
    d1429b5 View commit details
    Browse the repository at this point in the history
  3. Python: fix mkdocs warnings from sorting.py (#7467)

    * updates to remove mkdocs warnings from_bytes()
    
    * updated comments for mkdocs WARNINGS to be removed
    
    * removal of warnings from mkdocs serve --strict
    
    * changes to SortOrder init() added order_id arg
    
    * reverted...
    
    * updated for keyword args vs args order_id
    
    * removed blank line 123 fom sorting.py
    
    * finalizing comments
    
    * Remove spaces
    
    ---------
    
    Co-authored-by: Fokko Driesprong <[email protected]>
    DarthData410 and Fokko authored Apr 28, 2023
    Configuration menu
    Copy the full SHA
    15c9a3d View commit details
    Browse the repository at this point in the history

Commits on Apr 30, 2023

  1. Configuration menu
    Copy the full SHA
    9af7c9c View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    36d098e View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    13f7de8 View commit details
    Browse the repository at this point in the history
  4. Build: Bump pyyaml from 5.4.1 to 6.0 in /python (#7477)

    Bumps [pyyaml](https://github.com/yaml/pyyaml) from 5.4.1 to 6.0.
    - [Release notes](https://github.com/yaml/pyyaml/releases)
    - [Changelog](https://github.com/yaml/pyyaml/blob/master/CHANGES)
    - [Commits](yaml/pyyaml@5.4.1...6.0)
    
    ---
    updated-dependencies:
    - dependency-name: pyyaml
      dependency-type: direct:production
      update-type: version-update:semver-major
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Apr 30, 2023
    Configuration menu
    Copy the full SHA
    d07635d View commit details
    Browse the repository at this point in the history
  5. Build: Bump mkdocs-material from 9.1.5 to 9.1.8 in /python (#7476)

    Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 9.1.5 to 9.1.8.
    - [Release notes](https://github.com/squidfunk/mkdocs-material/releases)
    - [Changelog](https://github.com/squidfunk/mkdocs-material/blob/master/CHANGELOG)
    - [Commits](squidfunk/mkdocs-material@9.1.5...9.1.8)
    
    ---
    updated-dependencies:
    - dependency-name: mkdocs-material
      dependency-type: direct:production
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Apr 30, 2023
    Configuration menu
    Copy the full SHA
    9a73cf6 View commit details
    Browse the repository at this point in the history
  6. Python: Fix warnings in documentation (#7472)

    * updates to remove mkdocs warnings from_bytes()
    
    * updated comments for mkdocs WARNINGS to be removed
    
    * removal of warnings from mkdocs serve --strict
    
    * changes to SortOrder init() added order_id arg
    
    * reverted...
    
    * updated for keyword args vs args order_id
    
    * removed blank line 123 fom sorting.py
    
    * finalizing comments
    
    * Remove spaces
    
    * fixed all mkdocs serve --strict warnings
    
    * fixed trailing whitespace
    
    * updates to comments for mkdocs serve --strict mode
    
    * updates to io/__init__.py for mkdocs warns removal
    
    * updates to remove mkdocs warns from types.py
    
    * updates for schema.py to remove mkdocs warns
    
    * updates to remove mkdoc warns from literals.py
    
    * final mkdocs fixed transforms.py
    
    * request PR changes from code review
    
    * reuest format changes for comments
    
    ---------
    
    Co-authored-by: Fokko Driesprong <[email protected]>
    DarthData410 and Fokko authored Apr 30, 2023
    Configuration menu
    Copy the full SHA
    c2b1700 View commit details
    Browse the repository at this point in the history

Commits on May 1, 2023

  1. Python: Fix code highlighting in docs (#7484)

    * updates to remove mkdocs warnings from_bytes()
    
    * updated comments for mkdocs WARNINGS to be removed
    
    * removal of warnings from mkdocs serve --strict
    
    * changes to SortOrder init() added order_id arg
    
    * reverted...
    
    * updated for keyword args vs args order_id
    
    * removed blank line 123 fom sorting.py
    
    * finalizing comments
    
    * Remove spaces
    
    * fixed all mkdocs serve --strict warnings
    
    * fixed trailing whitespace
    
    * updates to comments for mkdocs serve --strict mode
    
    * updates to io/__init__.py for mkdocs warns removal
    
    * updates to remove mkdocs warns from types.py
    
    * updates for schema.py to remove mkdocs warns
    
    * updates to remove mkdoc warns from literals.py
    
    * final mkdocs fixed transforms.py
    
    * request PR changes from code review
    
    * reuest format changes for comments
    
    * fix pymdownx markdown_ext for code hihglights
    
    ---------
    
    Co-authored-by: Fokko Driesprong <[email protected]>
    DarthData410 and Fokko authored May 1, 2023
    Configuration menu
    Copy the full SHA
    103f007 View commit details
    Browse the repository at this point in the history
  2. Python: Update pre-commit to the latest version (#7436)

    Removed some ignores and removed some list materialization
    Fokko authored May 1, 2023
    Configuration menu
    Copy the full SHA
    30da936 View commit details
    Browse the repository at this point in the history

Commits on May 2, 2023

  1. Configuration menu
    Copy the full SHA
    73a2fbe View commit details
    Browse the repository at this point in the history

Commits on May 4, 2023

  1. Python: Support Iceberg UUIDType from Parquet (#7523)

    * add cast if needed in the visitor
    
    * Revert "add cast if needed in the visitor"
    
    This reverts commit fa86862cb68399059fb40a10f96a97745c7102a0.
    
    * add promotion from Fixed16 to UUID
    
    * add a comment explaining why the promotion is needed
    JonasJ-ap authored May 4, 2023
    Configuration menu
    Copy the full SHA
    6bf0db8 View commit details
    Browse the repository at this point in the history

Commits on May 7, 2023

  1. Build: Bump mkdocstrings from 0.20.0 to 0.21.2 in /python (#7547)

    Bumps [mkdocstrings](https://github.com/mkdocstrings/mkdocstrings) from 0.20.0 to 0.21.2.
    - [Release notes](https://github.com/mkdocstrings/mkdocstrings/releases)
    - [Changelog](https://github.com/mkdocstrings/mkdocstrings/blob/master/CHANGELOG.md)
    - [Commits](mkdocstrings/mkdocstrings@0.20.0...0.21.2)
    
    ---
    updated-dependencies:
    - dependency-name: mkdocstrings
      dependency-type: direct:production
      update-type: version-update:semver-minor
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored May 7, 2023
    Configuration menu
    Copy the full SHA
    5d0b4cd View commit details
    Browse the repository at this point in the history
  2. Build: Bump griffe from 0.26.0 to 0.27.3 in /python (#7546)

    Bumps [griffe](https://github.com/mkdocstrings/griffe) from 0.26.0 to 0.27.3.
    - [Changelog](https://github.com/mkdocstrings/griffe/blob/master/CHANGELOG.md)
    - [Commits](mkdocstrings/griffe@0.26.0...0.27.3)
    
    ---
    updated-dependencies:
    - dependency-name: griffe
      dependency-type: direct:production
      update-type: version-update:semver-minor
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored May 7, 2023
    Configuration menu
    Copy the full SHA
    1f53261 View commit details
    Browse the repository at this point in the history
  3. Build: Bump rich from 13.3.4 to 13.3.5 in /python (#7545)

    Bumps [rich](https://github.com/Textualize/rich) from 13.3.4 to 13.3.5.
    - [Release notes](https://github.com/Textualize/rich/releases)
    - [Changelog](https://github.com/Textualize/rich/blob/master/CHANGELOG.md)
    - [Commits](Textualize/rich@v13.3.4...v13.3.5)
    
    ---
    updated-dependencies:
    - dependency-name: rich
      dependency-type: direct:production
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored May 7, 2023
    Configuration menu
    Copy the full SHA
    f9a96d0 View commit details
    Browse the repository at this point in the history
  4. Build: Bump requests from 2.28.2 to 2.30.0 in /python (#7544)

    Bumps [requests](https://github.com/psf/requests) from 2.28.2 to 2.30.0.
    - [Release notes](https://github.com/psf/requests/releases)
    - [Changelog](https://github.com/psf/requests/blob/main/HISTORY.md)
    - [Commits](psf/requests@v2.28.2...v2.30.0)
    
    ---
    updated-dependencies:
    - dependency-name: requests
      dependency-type: direct:production
      update-type: version-update:semver-minor
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored May 7, 2023
    Configuration menu
    Copy the full SHA
    4c26d4e View commit details
    Browse the repository at this point in the history
  5. Build: Bump mkdocs-material from 9.1.8 to 9.1.9 in /python (#7542)

    Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 9.1.8 to 9.1.9.
    - [Release notes](https://github.com/squidfunk/mkdocs-material/releases)
    - [Changelog](https://github.com/squidfunk/mkdocs-material/blob/master/CHANGELOG)
    - [Commits](squidfunk/mkdocs-material@9.1.8...9.1.9)
    
    ---
    updated-dependencies:
    - dependency-name: mkdocs-material
      dependency-type: direct:production
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored May 7, 2023
    Configuration menu
    Copy the full SHA
    e07db79 View commit details
    Browse the repository at this point in the history
  6. Python: Add REST support for SigV4 (#7519)

    * Add REST support for SigV4 signed requests
    
    * Add comment for second session create
    
    * lint
    
    * Address comments
    
    * Fix typing issues
    
    * Add docks
    
    * Lint
    
    * remove lint ignore
    danielcweeks authored May 7, 2023
    Configuration menu
    Copy the full SHA
    8d24e01 View commit details
    Browse the repository at this point in the history

Commits on May 8, 2023

  1. Build: Bump adlfs from 2023.1.0 to 2023.4.0 in /python (#7543)

    Bumps [adlfs](https://github.com/dask/adlfs) from 2023.1.0 to 2023.4.0.
    - [Changelog](https://github.com/fsspec/adlfs/blob/main/CHANGELOG.md)
    - [Commits](fsspec/adlfs@2023.1.0...2023.4.0)
    
    ---
    updated-dependencies:
    - dependency-name: adlfs
      dependency-type: direct:production
      update-type: version-update:semver-minor
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored May 8, 2023
    Configuration menu
    Copy the full SHA
    fd9833e View commit details
    Browse the repository at this point in the history

Commits on May 9, 2023

  1. Python: Move to strictyaml (#7529)

    To avoid the Norway problem
    Fokko authored May 9, 2023
    Configuration menu
    Copy the full SHA
    62b3bd7 View commit details
    Browse the repository at this point in the history

Commits on May 12, 2023

  1. Python: Bump PyArrow to 12.0.0 (#7588)

    This includes the fix apache/arrow#34015
    
    Now:
    
    ```
    [root@fa7688db87e9 /]# mc admin trace --call s3 minio
    2023-05-11T20:06:32.268 [206 Partial Content] s3.GetObject warehouse.minio:9000/nyc/taxis/metadata/00004-5eeae12f-6f3b-4c36-9413-2fbef26a94b7.metadata.json 172.22.0.2        2.791ms      ↑ 148 B ↓ 9.6 KiB
    2023-05-11T20:06:32.558 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/snap-3831732930279655857-1-9f7fb22f-eb4a-42d2-9657-87cc8039004d.avro 172.22.0.1        2.379ms      ↑ 153 B ↓ 0 B
    2023-05-11T20:06:32.566 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/snap-3831732930279655857-1-9f7fb22f-eb4a-42d2-9657-87cc8039004d.avro 172.22.0.1        1.925ms      ↑ 159 B ↓ 3.9 KiB
    2023-05-11T20:06:32.583 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/8e396fa9-dc45-4998-8d37-38665bf45724-m0.avro 172.22.0.1        528µs       ↑ 153 B ↓ 0 B
    2023-05-11T20:06:32.584 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/9f7fb22f-eb4a-42d2-9657-87cc8039004d-m0.avro 172.22.0.1        347µs       ↑ 153 B ↓ 0 B
    2023-05-11T20:06:32.584 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/273e2d75-5d3a-4c2c-bebd-a6ef37cadbe2-m0.avro 172.22.0.1        684µs       ↑ 153 B ↓ 0 B
    2023-05-11T20:06:32.584 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/5f6429bd-1ae4-4a54-820e-f53387e04e2b-m0.avro 172.22.0.1        502µs       ↑ 153 B ↓ 0 B
    2023-05-11T20:06:32.584 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/8f666929-42ff-4198-a203-af5c85cfb233-m0.avro 172.22.0.1        962µs       ↑ 153 B ↓ 0 B
    2023-05-11T20:06:32.589 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/5f6429bd-1ae4-4a54-820e-f53387e04e2b-m0.avro 172.22.0.1        1.805ms      ↑ 159 B ↓ 7.1 KiB
    2023-05-11T20:06:32.589 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/8e396fa9-dc45-4998-8d37-38665bf45724-m0.avro 172.22.0.1        1.54ms       ↑ 159 B ↓ 7.1 KiB
    2023-05-11T20:06:32.588 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/9f7fb22f-eb4a-42d2-9657-87cc8039004d-m0.avro 172.22.0.1        2.27ms       ↑ 159 B ↓ 7.1 KiB
    2023-05-11T20:06:32.589 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/273e2d75-5d3a-4c2c-bebd-a6ef37cadbe2-m0.avro 172.22.0.1        1.239ms      ↑ 159 B ↓ 7.1 KiB
    2023-05-11T20:06:32.589 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/8f666929-42ff-4198-a203-af5c85cfb233-m0.avro 172.22.0.1        2.783ms      ↑ 159 B ↓ 7.1 KiB
    2023-05-11T20:06:32.618 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1272-519910f9-3e1b-4a64-8745-3c34d879233d-00001.parquet 172.22.0.1        445µs       ↑ 153 B ↓ 0 B
    2023-05-11T20:06:32.618 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1290-df4bb385-1e5f-4841-960f-85600d3708e5-00001.parquet 172.22.0.1        319µs       ↑ 153 B ↓ 0 B
    2023-05-11T20:06:32.618 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1254-03dd06d8-f2da-4b9b-89ba-a2421e3f60fd-00001.parquet 172.22.0.1        263µs       ↑ 153 B ↓ 0 B
    2023-05-11T20:06:32.618 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1263-f568eb3b-a4d6-4a93-bcae-2b22f8baa1e7-00001.parquet 172.22.0.1        929µs       ↑ 153 B ↓ 0 B
    2023-05-11T20:06:32.618 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1281-d941a1d6-d041-4cf3-9e44-778191ae68fb-00001.parquet 172.22.0.1        275µs       ↑ 153 B ↓ 0 B
    2023-05-11T20:06:32.622 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1290-df4bb385-1e5f-4841-960f-85600d3708e5-00001.parquet 172.22.0.1        2.981ms      ↑ 159 B ↓ 64 KiB
    2023-05-11T20:06:32.622 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1272-519910f9-3e1b-4a64-8745-3c34d879233d-00001.parquet 172.22.0.1        6.991ms      ↑ 159 B ↓ 64 KiB
    2023-05-11T20:06:32.624 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1263-f568eb3b-a4d6-4a93-bcae-2b22f8baa1e7-00001.parquet 172.22.0.1        4.944ms      ↑ 159 B ↓ 64 KiB
    2023-05-11T20:06:32.624 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1281-d941a1d6-d041-4cf3-9e44-778191ae68fb-00001.parquet 172.22.0.1        6.287ms      ↑ 159 B ↓ 64 KiB
    2023-05-11T20:06:32.622 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1254-03dd06d8-f2da-4b9b-89ba-a2421e3f60fd-00001.parquet 172.22.0.1        9.967ms      ↑ 159 B ↓ 64 KiB
    2023-05-11T20:06:32.641 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1281-d941a1d6-d041-4cf3-9e44-778191ae68fb-00001.parquet 172.22.0.1        95.637ms     ↑ 159 B ↓ 6.6 MiB
    2023-05-11T20:06:32.638 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1272-519910f9-3e1b-4a64-8745-3c34d879233d-00001.parquet 172.22.0.1        711.24ms     ↑ 159 B ↓ 15 MiB
    2023-05-11T20:06:32.638 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1290-df4bb385-1e5f-4841-960f-85600d3708e5-00001.parquet 172.22.0.1        767.182ms    ↑ 159 B ↓ 16 MiB
    2023-05-11T20:06:32.640 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1263-f568eb3b-a4d6-4a93-bcae-2b22f8baa1e7-00001.parquet 172.22.0.1        1.694288s    ↑ 159 B ↓ 27 MiB
    2023-05-11T20:06:32.640 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1263-f568eb3b-a4d6-4a93-bcae-2b22f8baa1e7-00001.parquet 172.22.0.1        1.748438s    ↑ 159 B ↓ 27 MiB
    2023-05-11T20:06:32.640 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1272-519910f9-3e1b-4a64-8745-3c34d879233d-00001.parquet 172.22.0.1        1.895823s    ↑ 159 B ↓ 29 MiB
    2023-05-11T20:06:32.638 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1290-df4bb385-1e5f-4841-960f-85600d3708e5-00001.parquet 172.22.0.1        1.925349s    ↑ 159 B ↓ 32 MiB
    2023-05-11T20:06:32.644 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1281-d941a1d6-d041-4cf3-9e44-778191ae68fb-00001.parquet 172.22.0.1        1.944678s    ↑ 159 B ↓ 30 MiB
    2023-05-11T20:06:33.200 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1254-03dd06d8-f2da-4b9b-89ba-a2421e3f60fd-00001.parquet 172.22.0.1        1.510093s    ↑ 159 B ↓ 27 MiB
    2023-05-11T20:06:33.972 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1254-03dd06d8-f2da-4b9b-89ba-a2421e3f60fd-00001.parquet 172.22.0.1        1.326988s    ↑ 159 B ↓ 26 MiB
    ```
    
    Before:
    ```
    ^C[root@fa7688db87e9 /]# mc admin trace --call s3 minio
    2023-05-11T20:19:09.894 [206 Partial Content] s3.GetObject warehouse.minio:9000/nyc/taxis/metadata/00004-5eeae12f-6f3b-4c36-9413-2fbef26a94b7.metadata.json 172.22.0.2        897µs       ↑ 148 B ↓ 9.6 KiB
    2023-05-11T20:19:11.092 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/snap-3831732930279655857-1-9f7fb22f-eb4a-42d2-9657-87cc8039004d.avro 172.22.0.1        2.395ms      ↑ 153 B ↓ 0 B
    2023-05-11T20:19:11.113 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/snap-3831732930279655857-1-9f7fb22f-eb4a-42d2-9657-87cc8039004d.avro 172.22.0.1        1.439ms      ↑ 159 B ↓ 3.9 KiB
    2023-05-11T20:19:11.135 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/5f6429bd-1ae4-4a54-820e-f53387e04e2b-m0.avro 172.22.0.1        1.135ms      ↑ 153 B ↓ 0 B
    2023-05-11T20:19:11.136 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/273e2d75-5d3a-4c2c-bebd-a6ef37cadbe2-m0.avro 172.22.0.1        376µs       ↑ 153 B ↓ 0 B
    2023-05-11T20:19:11.136 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/8f666929-42ff-4198-a203-af5c85cfb233-m0.avro 172.22.0.1        465µs       ↑ 153 B ↓ 0 B
    2023-05-11T20:19:11.136 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/8e396fa9-dc45-4998-8d37-38665bf45724-m0.avro 172.22.0.1        841µs       ↑ 153 B ↓ 0 B
    2023-05-11T20:19:11.135 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/9f7fb22f-eb4a-42d2-9657-87cc8039004d-m0.avro 172.22.0.1        2.065ms      ↑ 153 B ↓ 0 B
    2023-05-11T20:19:11.143 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/9f7fb22f-eb4a-42d2-9657-87cc8039004d-m0.avro 172.22.0.1        1.153ms      ↑ 159 B ↓ 7.1 KiB
    2023-05-11T20:19:11.144 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/8e396fa9-dc45-4998-8d37-38665bf45724-m0.avro 172.22.0.1        1.105ms      ↑ 159 B ↓ 7.1 KiB
    2023-05-11T20:19:11.143 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/8f666929-42ff-4198-a203-af5c85cfb233-m0.avro 172.22.0.1        2.29ms       ↑ 159 B ↓ 7.1 KiB
    2023-05-11T20:19:11.143 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/5f6429bd-1ae4-4a54-820e-f53387e04e2b-m0.avro 172.22.0.1        2.646ms      ↑ 159 B ↓ 7.1 KiB
    2023-05-11T20:19:11.144 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/metadata/273e2d75-5d3a-4c2c-bebd-a6ef37cadbe2-m0.avro 172.22.0.1        1.914ms      ↑ 159 B ↓ 7.1 KiB
    2023-05-11T20:19:11.176 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1281-d941a1d6-d041-4cf3-9e44-778191ae68fb-00001.parquet 172.22.0.1        368µs       ↑ 153 B ↓ 0 B
    2023-05-11T20:19:11.176 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1290-df4bb385-1e5f-4841-960f-85600d3708e5-00001.parquet 172.22.0.1        380µs       ↑ 153 B ↓ 0 B
    2023-05-11T20:19:11.176 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1272-519910f9-3e1b-4a64-8745-3c34d879233d-00001.parquet 172.22.0.1        280µs       ↑ 153 B ↓ 0 B
    2023-05-11T20:19:11.177 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1254-03dd06d8-f2da-4b9b-89ba-a2421e3f60fd-00001.parquet 172.22.0.1        255µs       ↑ 153 B ↓ 0 B
    2023-05-11T20:19:11.177 [200 OK] s3.HeadObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1263-f568eb3b-a4d6-4a93-bcae-2b22f8baa1e7-00001.parquet 172.22.0.1        433µs       ↑ 153 B ↓ 0 B
    2023-05-11T20:19:11.180 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1281-d941a1d6-d041-4cf3-9e44-778191ae68fb-00001.parquet 172.22.0.1        4.36ms       ↑ 159 B ↓ 64 KiB
    2023-05-11T20:19:11.182 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1263-f568eb3b-a4d6-4a93-bcae-2b22f8baa1e7-00001.parquet 172.22.0.1        3.465ms      ↑ 159 B ↓ 64 KiB
    2023-05-11T20:19:11.180 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1290-df4bb385-1e5f-4841-960f-85600d3708e5-00001.parquet 172.22.0.1        6.57ms       ↑ 159 B ↓ 64 KiB
    2023-05-11T20:19:11.180 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1272-519910f9-3e1b-4a64-8745-3c34d879233d-00001.parquet 172.22.0.1        7.434ms      ↑ 159 B ↓ 64 KiB
    2023-05-11T20:19:11.182 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1254-03dd06d8-f2da-4b9b-89ba-a2421e3f60fd-00001.parquet 172.22.0.1        6.438ms      ↑ 159 B ↓ 64 KiB
    2023-05-11T20:19:11.196 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1290-df4bb385-1e5f-4841-960f-85600d3708e5-00001.parquet 172.22.0.1        3.827ms      ↑ 159 B ↓ 64 KiB
    2023-05-11T20:19:11.196 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1263-f568eb3b-a4d6-4a93-bcae-2b22f8baa1e7-00001.parquet 172.22.0.1        3.971ms      ↑ 159 B ↓ 64 KiB
    2023-05-11T20:19:11.194 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1281-d941a1d6-d041-4cf3-9e44-778191ae68fb-00001.parquet 172.22.0.1        5.977ms      ↑ 159 B ↓ 64 KiB
    2023-05-11T20:19:11.198 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1254-03dd06d8-f2da-4b9b-89ba-a2421e3f60fd-00001.parquet 172.22.0.1        7.024ms      ↑ 159 B ↓ 64 KiB
    2023-05-11T20:19:11.196 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1272-519910f9-3e1b-4a64-8745-3c34d879233d-00001.parquet 172.22.0.1        9.302ms      ↑ 159 B ↓ 64 KiB
    2023-05-11T20:19:11.213 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1281-d941a1d6-d041-4cf3-9e44-778191ae68fb-00001.parquet 172.22.0.1        69.011ms     ↑ 159 B ↓ 6.6 MiB
    2023-05-11T20:19:11.211 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1272-519910f9-3e1b-4a64-8745-3c34d879233d-00001.parquet 172.22.0.1        685.555ms    ↑ 159 B ↓ 15 MiB
    2023-05-11T20:19:11.213 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1290-df4bb385-1e5f-4841-960f-85600d3708e5-00001.parquet 172.22.0.1        886.157ms    ↑ 159 B ↓ 16 MiB
    2023-05-11T20:19:11.211 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1263-f568eb3b-a4d6-4a93-bcae-2b22f8baa1e7-00001.parquet 172.22.0.1        1.711973s    ↑ 159 B ↓ 27 MiB
    2023-05-11T20:19:11.213 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1263-f568eb3b-a4d6-4a93-bcae-2b22f8baa1e7-00001.parquet 172.22.0.1        1.740533s    ↑ 159 B ↓ 27 MiB
    2023-05-11T20:19:11.211 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1272-519910f9-3e1b-4a64-8745-3c34d879233d-00001.parquet 172.22.0.1        1.754817s    ↑ 159 B ↓ 29 MiB
    2023-05-11T20:19:11.209 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1281-d941a1d6-d041-4cf3-9e44-778191ae68fb-00001.parquet 172.22.0.1        1.960224s    ↑ 159 B ↓ 30 MiB
    2023-05-11T20:19:11.211 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1290-df4bb385-1e5f-4841-960f-85600d3708e5-00001.parquet 172.22.0.1        2.066043s    ↑ 159 B ↓ 32 MiB
    2023-05-11T20:19:11.784 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1254-03dd06d8-f2da-4b9b-89ba-a2421e3f60fd-00001.parquet 172.22.0.1        1.618623s    ↑ 159 B ↓ 27 MiB
    2023-05-11T20:19:12.526 [206 Partial Content] s3.GetObject 127.0.0.1:9000/warehouse/nyc/taxis/data/00003-1254-03dd06d8-f2da-4b9b-89ba-a2421e3f60fd-00001.parquet 172.22.0.1        1.407968s    ↑ 159 B ↓ 26 MiB
    ```
    Fokko authored May 12, 2023
    Configuration menu
    Copy the full SHA
    91f2634 View commit details
    Browse the repository at this point in the history

Commits on May 14, 2023

  1. Build: Bump mkdocstrings-python from 0.9.0 to 1.0.0 in /python (#7606)

    Bumps [mkdocstrings-python](https://github.com/mkdocstrings/python) from 0.9.0 to 1.0.0.
    - [Changelog](https://github.com/mkdocstrings/python/blob/master/CHANGELOG.md)
    - [Commits](mkdocstrings/python@0.9.0...1.0.0)
    
    ---
    updated-dependencies:
    - dependency-name: mkdocstrings-python
      dependency-type: direct:production
      update-type: version-update:semver-major
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored May 14, 2023
    Configuration menu
    Copy the full SHA
    595c15a View commit details
    Browse the repository at this point in the history
  2. Build: Bump pre-commit from 3.2.2 to 3.3.1 in /python (#7605)

    Bumps [pre-commit](https://github.com/pre-commit/pre-commit) from 3.2.2 to 3.3.1.
    - [Release notes](https://github.com/pre-commit/pre-commit/releases)
    - [Changelog](https://github.com/pre-commit/pre-commit/blob/main/CHANGELOG.md)
    - [Commits](pre-commit/pre-commit@v3.2.2...v3.3.1)
    
    ---
    updated-dependencies:
    - dependency-name: pre-commit
      dependency-type: direct:development
      update-type: version-update:semver-minor
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored May 14, 2023
    Configuration menu
    Copy the full SHA
    7a456f9 View commit details
    Browse the repository at this point in the history
  3. Build: Bump griffe from 0.27.3 to 0.27.5 in /python (#7604)

    Bumps [griffe](https://github.com/mkdocstrings/griffe) from 0.27.3 to 0.27.5.
    - [Changelog](https://github.com/mkdocstrings/griffe/blob/master/CHANGELOG.md)
    - [Commits](mkdocstrings/griffe@0.27.3...0.27.5)
    
    ---
    updated-dependencies:
    - dependency-name: griffe
      dependency-type: direct:production
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored May 14, 2023
    Configuration menu
    Copy the full SHA
    fa881ce View commit details
    Browse the repository at this point in the history
  4. Build: Bump mkdocs-material from 9.1.9 to 9.1.12 in /python (#7603)

    Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 9.1.9 to 9.1.12.
    - [Release notes](https://github.com/squidfunk/mkdocs-material/releases)
    - [Changelog](https://github.com/squidfunk/mkdocs-material/blob/master/CHANGELOG)
    - [Commits](squidfunk/mkdocs-material@9.1.9...9.1.12)
    
    ---
    updated-dependencies:
    - dependency-name: mkdocs-material
      dependency-type: direct:production
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored May 14, 2023
    Configuration menu
    Copy the full SHA
    bed250f View commit details
    Browse the repository at this point in the history
  5. Build: Bump mkdocs from 1.4.2 to 1.4.3 in /python (#7602)

    Bumps [mkdocs](https://github.com/mkdocs/mkdocs) from 1.4.2 to 1.4.3.
    - [Release notes](https://github.com/mkdocs/mkdocs/releases)
    - [Commits](mkdocs/mkdocs@1.4.2...1.4.3)
    
    ---
    updated-dependencies:
    - dependency-name: mkdocs
      dependency-type: direct:production
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored May 14, 2023
    Configuration menu
    Copy the full SHA
    b5716dc View commit details
    Browse the repository at this point in the history

Commits on May 21, 2023

  1. Build: Bump mkdocs-material from 9.1.12 to 9.1.14 in /python (#7670)

    Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 9.1.12 to 9.1.14.
    - [Release notes](https://github.com/squidfunk/mkdocs-material/releases)
    - [Changelog](https://github.com/squidfunk/mkdocs-material/blob/master/CHANGELOG)
    - [Commits](squidfunk/mkdocs-material@9.1.12...9.1.14)
    
    ---
    updated-dependencies:
    - dependency-name: mkdocs-material
      dependency-type: direct:production
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored May 21, 2023
    Configuration menu
    Copy the full SHA
    8dfc4bc View commit details
    Browse the repository at this point in the history
  2. Build: Bump fastavro from 1.7.3 to 1.7.4 in /python (#7671)

    Bumps [fastavro](https://github.com/fastavro/fastavro) from 1.7.3 to 1.7.4.
    - [Release notes](https://github.com/fastavro/fastavro/releases)
    - [Changelog](https://github.com/fastavro/fastavro/blob/master/ChangeLog)
    - [Commits](fastavro/fastavro@1.7.3...1.7.4)
    
    ---
    updated-dependencies:
    - dependency-name: fastavro
      dependency-type: direct:development
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored May 21, 2023
    Configuration menu
    Copy the full SHA
    a7ba17b View commit details
    Browse the repository at this point in the history
  3. Build: Bump duckdb from 0.7.1 to 0.8.0 in /python (#7673)

    Bumps [duckdb](https://github.com/duckdb/duckdb) from 0.7.1 to 0.8.0.
    - [Release notes](https://github.com/duckdb/duckdb/releases)
    - [Changelog](https://github.com/duckdb/duckdb/blob/master/tools/release-pip.py)
    - [Commits](duckdb/duckdb@v0.7.1...v0.8.0)
    
    ---
    updated-dependencies:
    - dependency-name: duckdb
      dependency-type: direct:production
      update-type: version-update:semver-minor
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored May 21, 2023
    Configuration menu
    Copy the full SHA
    3ed938b View commit details
    Browse the repository at this point in the history
  4. Build: Bump griffe from 0.27.5 to 0.28.0 in /python (#7674)

    Bumps [griffe](https://github.com/mkdocstrings/griffe) from 0.27.5 to 0.28.0.
    - [Changelog](https://github.com/mkdocstrings/griffe/blob/master/CHANGELOG.md)
    - [Commits](mkdocstrings/griffe@0.27.5...0.28.0)
    
    ---
    updated-dependencies:
    - dependency-name: griffe
      dependency-type: direct:production
      update-type: version-update:semver-minor
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored May 21, 2023
    Configuration menu
    Copy the full SHA
    188a8b6 View commit details
    Browse the repository at this point in the history

Commits on May 22, 2023

  1. Build: Bump pre-commit from 3.3.1 to 3.3.2 in /python (#7672)

    Bumps [pre-commit](https://github.com/pre-commit/pre-commit) from 3.3.1 to 3.3.2.
    - [Release notes](https://github.com/pre-commit/pre-commit/releases)
    - [Changelog](https://github.com/pre-commit/pre-commit/blob/main/CHANGELOG.md)
    - [Commits](pre-commit/pre-commit@v3.3.1...v3.3.2)
    
    ---
    updated-dependencies:
    - dependency-name: pre-commit
      dependency-type: direct:development
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored May 22, 2023
    Configuration menu
    Copy the full SHA
    242400d View commit details
    Browse the repository at this point in the history

Commits on May 23, 2023

  1. Build: Bump requests from 2.30.0 to 2.31.0 in /python (#7689)

    Bumps [requests](https://github.com/psf/requests) from 2.30.0 to 2.31.0.
    - [Release notes](https://github.com/psf/requests/releases)
    - [Changelog](https://github.com/psf/requests/blob/main/HISTORY.md)
    - [Commits](psf/requests@v2.30.0...v2.31.0)
    
    ---
    updated-dependencies:
    - dependency-name: requests
      dependency-type: direct:production
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored May 23, 2023
    Configuration menu
    Copy the full SHA
    86975ec View commit details
    Browse the repository at this point in the history

Commits on May 25, 2023

  1. Python: Refactor integration tests (#7698)

    * Python: Refactor integration tests
    
    This splits out running and building the integration tests that
    enables quick development iterations. I've also added ipython
    that will give a more meaningful error when something goes wrong
    with the provisioning of the tests.
    
    * Simplify SQL
    Fokko authored May 25, 2023
    Configuration menu
    Copy the full SHA
    cfc9c63 View commit details
    Browse the repository at this point in the history

Commits on May 30, 2023

  1. Revert "Python: Refactor integration tests (#7698)" (#7729)

    This reverts commit 3a584a2.
    Fokko authored May 30, 2023
    Configuration menu
    Copy the full SHA
    f44fd3a View commit details
    Browse the repository at this point in the history

Commits on Jun 1, 2023

  1. Python: Loosen dependency on typing-extensions (#7747)

    In the CI we pin the `typing-extensions` dependency on `4.5.0`,
    but it looks like some bug has been introduced in `4.6.1`.
    
    By loosening this requirement, we install the same version as when
    someone would when they don't install the dev requirements.
    
    Resolves #7746
    Fokko authored Jun 1, 2023
    Configuration menu
    Copy the full SHA
    d3c07fd View commit details
    Browse the repository at this point in the history
  2. Build: Bump griffe from 0.28.0 to 0.29.0 in /python (#7728)

    Bumps [griffe](https://github.com/mkdocstrings/griffe) from 0.28.0 to 0.29.0.
    - [Changelog](https://github.com/mkdocstrings/griffe/blob/master/CHANGELOG.md)
    - [Commits](mkdocstrings/griffe@0.28.0...0.29.0)
    
    ---
    updated-dependencies:
    - dependency-name: griffe
      dependency-type: direct:production
      update-type: version-update:semver-minor
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Jun 1, 2023
    Configuration menu
    Copy the full SHA
    be67d5a View commit details
    Browse the repository at this point in the history
  3. Build: Bump mkdocstrings from 0.21.2 to 0.22.0 in /python (#7727)

    Bumps [mkdocstrings](https://github.com/mkdocstrings/mkdocstrings) from 0.21.2 to 0.22.0.
    - [Release notes](https://github.com/mkdocstrings/mkdocstrings/releases)
    - [Changelog](https://github.com/mkdocstrings/mkdocstrings/blob/master/CHANGELOG.md)
    - [Commits](mkdocstrings/mkdocstrings@0.21.2...0.22.0)
    
    ---
    updated-dependencies:
    - dependency-name: mkdocstrings
      dependency-type: direct:production
      update-type: version-update:semver-minor
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Jun 1, 2023
    Configuration menu
    Copy the full SHA
    0fbf805 View commit details
    Browse the repository at this point in the history
  4. Build: Bump mkdocstrings-python from 1.0.0 to 1.1.0 in /python (#7724)

    Bumps [mkdocstrings-python](https://github.com/mkdocstrings/python) from 1.0.0 to 1.1.0.
    - [Changelog](https://github.com/mkdocstrings/python/blob/master/CHANGELOG.md)
    - [Commits](mkdocstrings/python@1.0.0...1.1.0)
    
    ---
    updated-dependencies:
    - dependency-name: mkdocstrings-python
      dependency-type: direct:production
      update-type: version-update:semver-minor
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Jun 1, 2023
    Configuration menu
    Copy the full SHA
    a909527 View commit details
    Browse the repository at this point in the history

Commits on Jun 2, 2023

  1. Configuration menu
    Copy the full SHA
    7c15086 View commit details
    Browse the repository at this point in the history

Commits on Jun 4, 2023

  1. Build: Bump typing-extensions from 4.6.2 to 4.6.3 in /python (#7765)

    Bumps [typing-extensions](https://github.com/python/typing_extensions) from 4.6.2 to 4.6.3.
    - [Changelog](https://github.com/python/typing_extensions/blob/main/CHANGELOG.md)
    - [Commits](python/typing_extensions@4.6.2...4.6.3)
    
    ---
    updated-dependencies:
    - dependency-name: typing-extensions
      dependency-type: direct:development
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Jun 4, 2023
    Configuration menu
    Copy the full SHA
    813d344 View commit details
    Browse the repository at this point in the history
  2. Build: Bump mkdocs-material from 9.1.14 to 9.1.15 in /python (#7764)

    Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 9.1.14 to 9.1.15.
    - [Release notes](https://github.com/squidfunk/mkdocs-material/releases)
    - [Changelog](https://github.com/squidfunk/mkdocs-material/blob/master/CHANGELOG)
    - [Commits](squidfunk/mkdocs-material@9.1.14...9.1.15)
    
    ---
    updated-dependencies:
    - dependency-name: mkdocs-material
      dependency-type: direct:production
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Jun 4, 2023
    Configuration menu
    Copy the full SHA
    0adbbf3 View commit details
    Browse the repository at this point in the history

Commits on Jun 5, 2023

  1. Python: Refactor integration tests (#7698) (#7768)

    * Python: Refactor integration tests (#7698)
    
    * Python: Refactor integration tests
    
    This splits out running and building the integration tests that
    enables quick development iterations. I've also added ipython
    that will give a more meaningful error when something goes wrong
    with the provisioning of the tests.
    
    * Simplify SQL
    
    * Bump to Iceberg 1.3.0
    Fokko authored Jun 5, 2023
    Configuration menu
    Copy the full SHA
    f44e041 View commit details
    Browse the repository at this point in the history
  2. Python: Add support for pydocstyle (#7772)

    This will make sure that our docstrings are properly formatted.
    
    This is getting important since we also generate docs from the doc
    strings. This PR is about adding the framework, and then we can follow
    up in new PRs for each of the error codes.
    Fokko authored Jun 5, 2023
    Configuration menu
    Copy the full SHA
    906e279 View commit details
    Browse the repository at this point in the history

Commits on Jun 6, 2023

  1. Python: Pin mkdocs-admon (#7779)

    A new version has been released 9 hours ago, and broke the build:
    
    https://pypi.org/project/mdformat_admon/1.0.2/
    
    Let's pin the versions.
    Fokko authored Jun 6, 2023
    Configuration menu
    Copy the full SHA
    86f8a3f View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    96d2485 View commit details
    Browse the repository at this point in the history
  3. Python: Add support for sequence number inheritance (#7778)

    * Python: Add support for sequence number inheritance
    
    * Refactor
    Fokko authored Jun 6, 2023
    Configuration menu
    Copy the full SHA
    e9d4fae View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2023

  1. Python: Fix optionality of Manifest fields (#7796)

    Without these changes the Avro files that were generated couldn't be
    parsed by the iceberg rest catalog service.
    maxdebayser authored Jun 7, 2023
    Configuration menu
    Copy the full SHA
    b6c7a67 View commit details
    Browse the repository at this point in the history

Commits on Jun 9, 2023

  1. Configuration menu
    Copy the full SHA
    95edc7f View commit details
    Browse the repository at this point in the history

Commits on Jun 10, 2023

  1. Python: D414 and D200 docstring issues (#7806)

    Co-authored-by: Michael DeRoy <[email protected]>
    mderoy and Michael DeRoy authored Jun 10, 2023
    Configuration menu
    Copy the full SHA
    818ebe7 View commit details
    Browse the repository at this point in the history
  2. Python: Resolve pydocstring D202 violations (#7805)

    Co-authored-by: Michael DeRoy <[email protected]>
    Co-authored-by: Fokko Driesprong <[email protected]>
    3 people authored Jun 10, 2023
    Configuration menu
    Copy the full SHA
    ecdd235 View commit details
    Browse the repository at this point in the history

Commits on Jun 11, 2023

  1. Configuration menu
    Copy the full SHA
    cf4d5b8 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    d46b7f7 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    9d15af0 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    a02cbb1 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    fafb449 View commit details
    Browse the repository at this point in the history

Commits on Jun 13, 2023

  1. Python: Make Glue catalog configurable (#7781)

    * Make boto3 session for Glue catalog configurable.
    
    (cherry picked from commit aecc33bda59da974f6dfaa6cba97206f320d67a9)
    
    * Fix linting issues.
    tilman151 authored Jun 13, 2023
    Configuration menu
    Copy the full SHA
    f1df60d View commit details
    Browse the repository at this point in the history

Commits on Jun 14, 2023

  1. Python: Fix D400 Docstring voilations (#7829)

    * Update decoder.py
    
    * Update file.py
    
    D400: First line should end with a period
    
    * Update reader.py
    
    D400: First line should end with a period
    
    * Update resolver.py
    
    * Update __init__.py
    
    D400: First line should end with a period
    
    * Update dynamodb.py
    
    * Update glue.py
    
    D400: First line should end with a period
    
    * Update hive.py
    
    D400: First line should end with a period
    
    * Update rest.py
    
    D400: First line should end with a period
    
    * Update console.py
    
    D400: First line should end with a period
    
    * Update output.py
    
    D400: First line should end with a period
    
    * Update output.py
    
    D400: First line should end with a period
    
    * Update __init__.py
    
    D400: First line should end with a period
    
    * Update literals.py
    
    D400: First line should end with a period
    
    * Update visitors.py
    
    D400: First line should end with a period
    
    * Update __init__.py
    
    D400: First line should end with a period
    
    * Update fsspec.py
    
    D400: First line should end with a period
    
    * Update memory.py
    
    D400: First line should end with a period
    
    * Update pyarrow.py
    
    D400: First line should end with a period
    
    * Update __init__.py
    
    D400: First line should end with a period
    
    * Update metadata.py
    
    D400: First line should end with a period
    
    * Update snapshots.py
    
    D400: First line should end with a period
    
    * Update sorting.py
    
    D400: First line should end with a period
    
    * Update config.py
    
    D400: First line should end with a period
    
    * Update datetime.py
    
    D400: First line should end with a period
    
    * Update decimal.py
    
    D400: First line should end with a period
    
    * Update parsing.py
    
    D400: First line should end with a period
    
    * Update schema_conversion.py
    
    D400: First line should end with a period
    
    * Update singleton.py
    
    D400: First line should end with a period
    
    * Update conversions.py
    
    D400: First line should end with a period
    
    * Update exceptions.py
    
    D400: First line should end with a period
    
    * Update files.py
    
    D400: First line should end with a period
    
    * Update manifest.py
    
    D400: First line should end with a period
    
    * Update partitioning.py
    
    D400: First line should end with a period
    
    * Update schema.py
    
    D400: First line should end with a period
    
    * Update serializers.py
    
    D400: First line should end with a period
    
    * Update transforms.py
    
    D400: First line should end with a period
    
    * Update typedef.py
    
    D400: First line should end with a period
    
    * Update types.py
    
    D400: First line should end with a period
    
    * Removed D400 code from .pre-commit-config.yaml
    
    * Update dynamodb.py
    
    fixed D400 compliance
    
    * Update python/pyiceberg/catalog/__init__.py
    
    Co-authored-by: Fokko Driesprong <[email protected]>
    
    * Update conversions.py
    
    D400 fix
    
    * Update metadata.py
    
    d400 fix
    
    * Update console.py
    
    d400 fix
    
    * Update visitors.py
    
    D400 fix
    
    * Update types.py
    
    D400 compliance
    
    * Update partitioning.py
    
    D400 fix
    
    * Update config.py
    
    D400 fix
    
    * Update decoder.py
    
    D400
    
    * Update file.py
    
    D400 fix
    
    * Update schema_conversion.py
    
    D400 fixes and added small definitions for compliance purposes.
    
    * Update fsspec.py
    
    D400 fix
    
    * Update snapshots.py
    
    D400 fix
    
    * Update integration_test_glue.py
    
    D400 fix
    
    * Update integration_test_dynamodb.py
    
    D400 fix
    
    * Update conftest.py
    
    D400 fix
    
    * Update deprecated.py
    
    D400 fix
    
    * Update snappy_codec.py
    
    D400 fix
    
    * Update parser.py
    
    D400 fix
    
    * Update types.py
    
    fix D400
    
    * Update conftest.py
    
    fix D400
    
    * Update decoder.py
    
    fix D200
    
    * Update snapshots.py
    
    fix D200
    
    * Fixed trailing whitespaces
    
    * Fixed trailing whitespaces
    
    * Fixed trailing whitespaces
    
    * Fixed trailing whitespaces
    
    * Fixed trailing whitespaces
    
    * Fixed trailing whitespaces
    
    * Fixed trailing whitespaces
    
    * Fixed trailing whitespaces
    
    * Fixed trailing whitespaces
    
    * Update python/pyiceberg/catalog/__init__.py
    
    * Update python/pyiceberg/io/pyarrow.py
    
    * Update python/pyiceberg/io/pyarrow.py
    
    * Update python/pyiceberg/serializers.py
    
    ---------
    
    Co-authored-by: Fokko Driesprong <[email protected]>
    Rondiz and Fokko authored Jun 14, 2023
    Configuration menu
    Copy the full SHA
    560d6b5 View commit details
    Browse the repository at this point in the history
  2. Python: Add pickle support (#7645)

    * Python: Add pickle support
    
    * Fix test
    
    * Fix type annotation
    
    * Update python/pyiceberg/types.py
    
    * Update python/pyiceberg/types.py
    
    * Update python/pyiceberg/types.py
    
    ---------
    
    Co-authored-by: Georg Grob <[email protected]>
    Co-authored-by: Fokko Driesprong <[email protected]>
    3 people authored Jun 14, 2023
    Configuration menu
    Copy the full SHA
    38b6b4c View commit details
    Browse the repository at this point in the history
  3. Python: Fixes for D205 issues (#7823)

    * Fixes for D205 issues
    
    fix one comment
    
    * Update python/pyiceberg/utils/deprecated.py
    
    * Update python/pyiceberg/utils/deprecated.py
    
    ---------
    
    Co-authored-by: Michael DeRoy <[email protected]>
    Co-authored-by: Fokko Driesprong <[email protected]>
    3 people authored Jun 14, 2023
    Configuration menu
    Copy the full SHA
    7808b43 View commit details
    Browse the repository at this point in the history

Commits on Jun 18, 2023

  1. Configuration menu
    Copy the full SHA
    f7a4bf7 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    45aceec View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    2192398 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    292056c View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    e69867a View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    92eb0b4 View commit details
    Browse the repository at this point in the history

Commits on Jun 20, 2023

  1. Configuration menu
    Copy the full SHA
    48267eb View commit details
    Browse the repository at this point in the history

Commits on Jun 22, 2023

  1. Python: Alter table plumbing and REST support (#6323)

    * Alter table
    
    * Make the CI happy
    
    * Comments
    
    * Thanks Ryan!
    
    * Python: Bump dependencies to the latest version
    
    * Remove from docs
    
    * WIP
    
    * Comments
    
    * Make CI happy
    
    * Update docstrings
    
    * Do some renaming
    
    * Add a context manager
    
    * Rename commit to commit_transaction()
    
    * Update docs
    
    * Refresh in place
    
    * Remove redudant call
    
    * Load a fresh copy instead
    
    * Fix the docstrings
    
    * Restore CommitTableResponse
    
    * Conflicts
    Fokko authored Jun 22, 2023
    Configuration menu
    Copy the full SHA
    9b915e7 View commit details
    Browse the repository at this point in the history
  2. Python: Fix D105 docstring violations (#7852)

    Co-authored-by: Michael DeRoy <[email protected]>
    mderoy and Michael DeRoy authored Jun 22, 2023
    Configuration menu
    Copy the full SHA
    35714c6 View commit details
    Browse the repository at this point in the history
  3. Python: Fix docstrings (#7877)

    Fokko authored Jun 22, 2023
    Configuration menu
    Copy the full SHA
    78ee36d View commit details
    Browse the repository at this point in the history

Commits on Jun 23, 2023

  1. Configuration menu
    Copy the full SHA
    dff1f1a View commit details
    Browse the repository at this point in the history
  2. Python: Log to logging instead of warn (#7876)

    * Python: Log to logging instead of warn
    
    I was doing some final testing befor the release, and noticed
    that when you don't have PyArrow installed (only s3fs), and
    you try to describe a table, you'll get a warning:
    
    ```
    root@0d64c149ba01:/vo# pyiceberg describe dbt_tabular.rides
    /vo/pyiceberg/io/__init__.py:283: UserWarning: Could not initialize FileIO: pyiceberg.io.pyarrow.PyArrowFileIO
      warnings.warn(f"Could not initialize FileIO: {io_impl}")
    Table format version  1
    
    Metadata location
    s3://tabular-wh-us-east-1/6efbcaf4-21ae-499d-b340-3bc1a7003f52/f59f662e-878f-42e4-8b66-04b076c8ee23/metadata/00037-c9977e9d-64d7-45fc-a93a-7e10efdfecc9.gz.metadat…
    Table UUID            f59f662e-878f-42e4-8b66-04b076c8ee23
    
    Last Updated          1684818900590
    
    Partition spec        []
    
    Sort order            []
    
    Current schema        Schema, id=13
    
                          ├── 1: vendor: optional string (TPEP provider that provided the record)
    
                          ├── 2: pickup_time: optional timestamptz (The date and time when the meter was engaged.)
    
                          ├── 3: pickup_zone_name: optional string (Taxi Zone in which the taximeter was engaged.)
    
                          ├── 4: pickup_borough: optional string (Borough in which the taximeter was engaged.)
    
                          ├── 5: dropoff_time: optional timestamptz (The date and time when the meter was disengaged.)
    
                          ├── 6: dropoff_zone_name: optional string (Taxi Zone in which the taximeter was disengaged)
    
                          ├── 7: dropoff_borough: optional string (Borough in which the taximeter was disengaged)
    
                          ├── 8: passenger_count: optional int (The number of passengers in the vehicle (This is a driver-entered value).)
    ```
    
    I think it makes more sense to send this to logging so you
    don't see it in the console.
    
    * Oops
    Fokko authored Jun 23, 2023
    Configuration menu
    Copy the full SHA
    fcbed0d View commit details
    Browse the repository at this point in the history

Commits on Jun 26, 2023

  1. Build: Bump pytest from 7.3.2 to 7.4.0 in /python (#7902)

    Bumps [pytest](https://github.com/pytest-dev/pytest) from 7.3.2 to 7.4.0.
    - [Release notes](https://github.com/pytest-dev/pytest/releases)
    - [Changelog](https://github.com/pytest-dev/pytest/blob/main/CHANGELOG.rst)
    - [Commits](pytest-dev/pytest@7.3.2...7.4.0)
    
    ---
    updated-dependencies:
    - dependency-name: pytest
      dependency-type: direct:development
      update-type: version-update:semver-minor
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Jun 26, 2023
    Configuration menu
    Copy the full SHA
    15032b7 View commit details
    Browse the repository at this point in the history
  2. Build: Bump mkdocs-material from 9.1.16 to 9.1.17 in /python (#7903)

    Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 9.1.16 to 9.1.17.
    - [Release notes](https://github.com/squidfunk/mkdocs-material/releases)
    - [Changelog](https://github.com/squidfunk/mkdocs-material/blob/master/CHANGELOG)
    - [Commits](squidfunk/mkdocs-material@9.1.16...9.1.17)
    
    ---
    updated-dependencies:
    - dependency-name: mkdocs-material
      dependency-type: direct:production
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Jun 26, 2023
    Configuration menu
    Copy the full SHA
    3138750 View commit details
    Browse the repository at this point in the history
  3. Build: Bump griffe from 0.29.0 to 0.29.1 in /python (#7904)

    Bumps [griffe](https://github.com/mkdocstrings/griffe) from 0.29.0 to 0.29.1.
    - [Changelog](https://github.com/mkdocstrings/griffe/blob/main/CHANGELOG.md)
    - [Commits](mkdocstrings/griffe@0.29.0...0.29.1)
    
    ---
    updated-dependencies:
    - dependency-name: griffe
      dependency-type: direct:production
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Jun 26, 2023
    Configuration menu
    Copy the full SHA
    f1c435d View commit details
    Browse the repository at this point in the history
  4. Build: Bump moto from 4.1.11 to 4.1.12 in /python (#7905)

    Bumps [moto](https://github.com/getmoto/moto) from 4.1.11 to 4.1.12.
    - [Changelog](https://github.com/getmoto/moto/blob/master/CHANGELOG.md)
    - [Commits](getmoto/moto@4.1.11...4.1.12)
    
    ---
    updated-dependencies:
    - dependency-name: moto
      dependency-type: direct:development
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Jun 26, 2023
    Configuration menu
    Copy the full SHA
    f02325b View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    42b43aa View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2023

  1. Python: Pin pyparsing and update tests (#7927)

    * Python: Update pyparsing tests
    
    * Lock pyparsing to <3.1.0
    Fokko authored Jun 27, 2023
    Configuration menu
    Copy the full SHA
    8d482b2 View commit details
    Browse the repository at this point in the history

Commits on Jun 29, 2023

  1. Configuration menu
    Copy the full SHA
    4e103ac View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    5a144aa View commit details
    Browse the repository at this point in the history

Commits on Jul 3, 2023

  1. Build: Bump griffe from 0.29.1 to 0.30.0 in /python (#7961)

    Bumps [griffe](https://github.com/mkdocstrings/griffe) from 0.29.1 to 0.30.0.
    - [Changelog](https://github.com/mkdocstrings/griffe/blob/main/CHANGELOG.md)
    - [Commits](mkdocstrings/griffe@0.29.1...0.30.0)
    
    ---
    updated-dependencies:
    - dependency-name: griffe
      dependency-type: direct:production
      update-type: version-update:semver-minor
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Jul 3, 2023
    Configuration menu
    Copy the full SHA
    3b52416 View commit details
    Browse the repository at this point in the history
  2. Build: Bump typing-extensions from 4.6.3 to 4.7.0 in /python (#7962)

    Bumps [typing-extensions](https://github.com/python/typing_extensions) from 4.6.3 to 4.7.0.
    - [Release notes](https://github.com/python/typing_extensions/releases)
    - [Changelog](https://github.com/python/typing_extensions/blob/main/CHANGELOG.md)
    - [Commits](python/typing_extensions@4.6.3...4.7.0)
    
    ---
    updated-dependencies:
    - dependency-name: typing-extensions
      dependency-type: direct:development
      update-type: version-update:semver-minor
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Jul 3, 2023
    Configuration menu
    Copy the full SHA
    89a5361 View commit details
    Browse the repository at this point in the history

Commits on Jul 4, 2023

  1. Build: Bump pydantic from 1.10.9 to 1.10.10 in /python (#7972)

    Bumps [pydantic](https://github.com/pydantic/pydantic) from 1.10.9 to 1.10.10.
    - [Release notes](https://github.com/pydantic/pydantic/releases)
    - [Changelog](https://github.com/pydantic/pydantic/blob/main/HISTORY.md)
    - [Commits](pydantic/pydantic@v1.10.9...v1.10.10)
    
    ---
    updated-dependencies:
    - dependency-name: pydantic
      dependency-type: direct:production
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Jul 4, 2023
    Configuration menu
    Copy the full SHA
    5db824c View commit details
    Browse the repository at this point in the history
  2. Build: Bump pandas from 2.0.2 to 2.0.3 in /python (#7960)

    Bumps [pandas](https://github.com/pandas-dev/pandas) from 2.0.2 to 2.0.3.
    - [Release notes](https://github.com/pandas-dev/pandas/releases)
    - [Commits](pandas-dev/pandas@v2.0.2...v2.0.3)
    
    ---
    updated-dependencies:
    - dependency-name: pandas
      dependency-type: direct:production
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Jul 4, 2023
    Configuration menu
    Copy the full SHA
    64b3903 View commit details
    Browse the repository at this point in the history
  3. Python: Update test_console tests (#7683)

    * Update test_console tests
    
    * Update poetry.lock file
    LuigiCerone authored Jul 4, 2023
    Configuration menu
    Copy the full SHA
    2ac40a2 View commit details
    Browse the repository at this point in the history

Commits on Jul 5, 2023

  1. Python: Add gzip metadata support (#7984)

    * Python: Add gzip metadata support
    
    Resolves #7977
    
    * Remove `get` verb
    Fokko authored Jul 5, 2023
    Configuration menu
    Copy the full SHA
    e41241a View commit details
    Browse the repository at this point in the history

Commits on Jul 6, 2023

  1. Python: Add catalog name to identifiers (#7946)

    * add catalog name to the identifier of table returned by glue catalog
    
    * add catalog name to the identifier of table returned by hive catalog
    JonasJ-ap authored Jul 6, 2023
    Configuration menu
    Copy the full SHA
    6118a24 View commit details
    Browse the repository at this point in the history
  2. Python: Add S3 proxies to PyIceberg Catalog FileIO (#7958)

    * proxies
    
    * proxies config
    
    * typo
    
    * one proxy-uri cofig
    
    * isort
    
    * lint
    
    * proxy uri for both http and https on s3fs
    
    * lint
    
    * rename property
    
    * s3.proxy-uri
    
    * lint
    sungwy authored Jul 6, 2023
    Configuration menu
    Copy the full SHA
    827845c View commit details
    Browse the repository at this point in the history
  3. Python: Avro write (#7873)

    * Python: Avro write support
    
    * Add class to write Avro files and add PoC update_table api call
    
    * Add tests for the avro readers and writers
    
    This commit also fixes some small bugs uncovered by the new tests
    
    * Appease pylint and pydocstyle
    
    * Appease pre-commit hooks
    
    * Address PR review comments
    
    * Appease pre-commit hooks
    
    * Add additional metadata to avro output file
    
    ---------
    
    Co-authored-by: Fokko Driesprong <[email protected]>
    maxdebayser and Fokko authored Jul 6, 2023
    Configuration menu
    Copy the full SHA
    0991137 View commit details
    Browse the repository at this point in the history

Commits on Jul 9, 2023

  1. Configuration menu
    Copy the full SHA
    522e074 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    39d3a08 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    9f8e6f6 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    331f7ee View commit details
    Browse the repository at this point in the history

Commits on Jul 10, 2023

  1. Python: Let produce last-updated-ms field in metadata at microsecond …

    …level (#8026)
    
    * Let produce last-updated-ms field in metadata at microsecond level
    
    * Remove unused function
    
    * Add test for datetime_to_millis
    
    * Lint files
    
    * Add license header in test_datetime.py
    ktk1012 authored Jul 10, 2023
    Configuration menu
    Copy the full SHA
    125f6db View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    1400787 View commit details
    Browse the repository at this point in the history

Commits on Jul 15, 2023

  1. Python: Remove MemoryInputStream in favor of io.BytesIO (#8074)

    * Python: Remove MemoryInputStream in favor of io.BytesIO
    
    * Add pre-commit fixes
    rustyconover authored Jul 15, 2023
    Configuration menu
    Copy the full SHA
    80214f2 View commit details
    Browse the repository at this point in the history

Commits on Jul 16, 2023

  1. Build: Bump moto from 4.1.12 to 4.1.13 in /python (#8080)

    Bumps [moto](https://github.com/getmoto/moto) from 4.1.12 to 4.1.13.
    - [Changelog](https://github.com/getmoto/moto/blob/master/CHANGELOG.md)
    - [Commits](getmoto/moto@4.1.12...4.1.13)
    
    ---
    updated-dependencies:
    - dependency-name: moto
      dependency-type: direct:development
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Jul 16, 2023
    Configuration menu
    Copy the full SHA
    ab5b6b1 View commit details
    Browse the repository at this point in the history
  2. Build: Bump griffe from 0.30.0 to 0.32.1 in /python (#8078)

    Bumps [griffe](https://github.com/mkdocstrings/griffe) from 0.30.0 to 0.32.1.
    - [Release notes](https://github.com/mkdocstrings/griffe/releases)
    - [Changelog](https://github.com/mkdocstrings/griffe/blob/main/CHANGELOG.md)
    - [Commits](mkdocstrings/griffe@0.30.0...0.32.1)
    
    ---
    updated-dependencies:
    - dependency-name: griffe
      dependency-type: direct:production
      update-type: version-update:semver-minor
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Jul 16, 2023
    Configuration menu
    Copy the full SHA
    3da09bd View commit details
    Browse the repository at this point in the history
  3. Python: Improve Avro read performance (#8075)

    Utilize __slots__ for various Avro classes.
    
    Memoize the key/value reader functions in MapReader.
    rustyconover authored Jul 16, 2023
    Configuration menu
    Copy the full SHA
    06a88b5 View commit details
    Browse the repository at this point in the history

Commits on Jul 17, 2023

  1. Configuration menu
    Copy the full SHA
    d555853 View commit details
    Browse the repository at this point in the history

Commits on Jul 20, 2023

  1. Python: Improve Avro Parse speed (#8082)

    * Python: Improve Avro Parse speed
    
    Cache the hash value of the Struct types so that when new
    Record objects are created time is not spent recomputing
    the hash value.
    
    Change the implementation of the Record class to cache the
    mapping from field name to position.  Also utilize an array
    rather than a dictionary for these lookups.
    
    * fix: adjust PR comments
    rustyconover authored Jul 20, 2023
    Configuration menu
    Copy the full SHA
    07bd6c1 View commit details
    Browse the repository at this point in the history
  2. Python: SqlCatalog (#7921)

    * Initial code for pyiceberg JDBC Catalog
    
    * pyiceberg JDBC Catalog PR modifications
    
    * pyiceberg JDBC Catalog PR modifications
    
    * pyiceberg JDBC Catalog PR modifications
    
    * pyiceberg JDBC Catalog PR modifications
    
    * Fix lint errors
    
    * Migrate to SQLAlchemy, initial code
    
    * Migrate to SQLAlchemy
    
    * Migrate to SQLAlchemy
    
    * Apply suggestions from code review
    
    Co-authored-by: Fokko Driesprong <[email protected]>
    
    * Update python/pyiceberg/catalog/sql.py
    
    Co-authored-by: Fokko Driesprong <[email protected]>
    
    * Finish PR review changes and port JDBCCatalog unit tests over
    
    * Migrate to SQLAlchemy
    
    * Fix lint issues
    
    * Fix lint issues
    
    * Fix lint issues
    
    * Fix lint issues
    
    * Add new namespace unit test
    
    * Apply suggestions from code review
    
    Co-authored-by: Fokko Driesprong <[email protected]>
    
    * PR review fix
    
    * Merge conflict
    
    * In-sync with master
    
    ---------
    
    Co-authored-by: cccs-eric <[email protected]>
    Fokko and cccs-eric authored Jul 20, 2023
    Configuration menu
    Copy the full SHA
    da33680 View commit details
    Browse the repository at this point in the history
  3. Build: Bump aiohttp from 3.8.4 to 3.8.5 in /python (#8119)

    Bumps [aiohttp](https://github.com/aio-libs/aiohttp) from 3.8.4 to 3.8.5.
    - [Release notes](https://github.com/aio-libs/aiohttp/releases)
    - [Changelog](https://github.com/aio-libs/aiohttp/blob/v3.8.5/CHANGES.rst)
    - [Commits](aio-libs/aiohttp@v3.8.4...v3.8.5)
    
    ---
    updated-dependencies:
    - dependency-name: aiohttp
      dependency-type: indirect
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Jul 20, 2023
    Configuration menu
    Copy the full SHA
    55debfb View commit details
    Browse the repository at this point in the history
  4. Build: Bump fastavro from 1.7.4 to 1.8.2 in /python (#8118)

    Bumps [fastavro](https://github.com/fastavro/fastavro) from 1.7.4 to 1.8.2.
    - [Release notes](https://github.com/fastavro/fastavro/releases)
    - [Changelog](https://github.com/fastavro/fastavro/blob/master/ChangeLog)
    - [Commits](fastavro/fastavro@1.7.4...1.8.2)
    
    ---
    updated-dependencies:
    - dependency-name: fastavro
      dependency-type: direct:development
      update-type: version-update:semver-minor
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Jul 20, 2023
    Configuration menu
    Copy the full SHA
    bfbaf68 View commit details
    Browse the repository at this point in the history

Commits on Jul 21, 2023

  1. Python: Fix datetime test locally (#8131)

    running datetime test locally errors when system timezone is not UTC
    kevinjqliu authored Jul 21, 2023
    Configuration menu
    Copy the full SHA
    9fb67a8 View commit details
    Browse the repository at this point in the history

Commits on Jul 23, 2023

  1. Build: Bump mkdocs-material from 9.1.18 to 9.1.19 in /python (#8135)

    Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 9.1.18 to 9.1.19.
    - [Release notes](https://github.com/squidfunk/mkdocs-material/releases)
    - [Changelog](https://github.com/squidfunk/mkdocs-material/blob/master/CHANGELOG)
    - [Commits](squidfunk/mkdocs-material@9.1.18...9.1.19)
    
    ---
    updated-dependencies:
    - dependency-name: mkdocs-material
      dependency-type: direct:production
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Jul 23, 2023
    Configuration menu
    Copy the full SHA
    0536e95 View commit details
    Browse the repository at this point in the history
  2. Build: Bump griffe from 0.32.1 to 0.32.3 in /python (#8136)

    Bumps [griffe](https://github.com/mkdocstrings/griffe) from 0.32.1 to 0.32.3.
    - [Release notes](https://github.com/mkdocstrings/griffe/releases)
    - [Changelog](https://github.com/mkdocstrings/griffe/blob/main/CHANGELOG.md)
    - [Commits](mkdocstrings/griffe@0.32.1...0.32.3)
    
    ---
    updated-dependencies:
    - dependency-name: griffe
      dependency-type: direct:production
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Jul 23, 2023
    Configuration menu
    Copy the full SHA
    c4c8f61 View commit details
    Browse the repository at this point in the history
  3. Build: Bump pytest-checkdocs from 2.9.0 to 2.10.0 in /python (#8137)

    Bumps [pytest-checkdocs](https://github.com/jaraco/pytest-checkdocs) from 2.9.0 to 2.10.0.
    - [Release notes](https://github.com/jaraco/pytest-checkdocs/releases)
    - [Changelog](https://github.com/jaraco/pytest-checkdocs/blob/main/NEWS.rst)
    - [Commits](jaraco/pytest-checkdocs@v2.9.0...v2.10.0)
    
    ---
    updated-dependencies:
    - dependency-name: pytest-checkdocs
      dependency-type: direct:development
      update-type: version-update:semver-minor
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Jul 23, 2023
    Configuration menu
    Copy the full SHA
    8c332da View commit details
    Browse the repository at this point in the history
  4. Build: Bump click from 8.1.3 to 8.1.6 in /python (#8138)

    Bumps [click](https://github.com/pallets/click) from 8.1.3 to 8.1.6.
    - [Release notes](https://github.com/pallets/click/releases)
    - [Changelog](https://github.com/pallets/click/blob/8.1.6/CHANGES.rst)
    - [Commits](pallets/click@8.1.3...8.1.6)
    
    ---
    updated-dependencies:
    - dependency-name: click
      dependency-type: direct:production
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Jul 23, 2023
    Configuration menu
    Copy the full SHA
    674146d View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    ebfaa6d View commit details
    Browse the repository at this point in the history
  6. Python: Bump to PyParsing 3.1.0 (#8116)

    * Python: Bump to PyParsing 3.1.0
    
    * Update poetry.lock
    Fokko authored Jul 23, 2023
    Configuration menu
    Copy the full SHA
    b458dd2 View commit details
    Browse the repository at this point in the history

Commits on Jul 24, 2023

  1. Configuration menu
    Copy the full SHA
    efbc70b View commit details
    Browse the repository at this point in the history

Commits on Jul 25, 2023

  1. Python: Improve AVRO reading speed (#8084)

    * Python: Improve Avro read performance
    
    Utilize __slots__ for various Avro classes.
    
    Memoize the key/value reader functions in MapReader.
    
    * Python: improve Avro parsing by caching struct types.
    
    Cache the struct types for ManifestEntry and ManifestFile schemas.
    
    Cache the _position_to_field_name lookup in Records if a struct type is passed.
    
    Improve StructReader to use slots and avoid isinstance() lookups on each time
    the structure is read, by performing the check in __init__().
    
    Improve StructReader to determine the arguments to create_struct() once in init
    and reuse the result each time the structure is read, avoid a try block.
    
    * Python: Improve Avro Parse speed
    
    Cache the hash value of the Struct types so that when new
    Record objects are created time is not spent recomputing
    the hash value.
    
    Change the implementation of the Record class to cache the
    mapping from field name to position.  Also utilize an array
    rather than a dictionary for these lookups.
    
    * fix some lints
    
    * fix some type casing
    
    * fix: adjust PR comments
    
    * fix: address PR feedback.
    
    * Add additional tests for InMemoryBinaryDecoder
    
    * Load entire Avro file into memory rather than streaming it
    
    * fix: disable seeking on input file
    
    * Update python/pyiceberg/avro/file.py
    
    ---------
    
    Co-authored-by: Fokko Driesprong <[email protected]>
    rustyconover and Fokko authored Jul 25, 2023
    Configuration menu
    Copy the full SHA
    7aa1d38 View commit details
    Browse the repository at this point in the history
  2. Python: Small fixes (#7989)

    Uncovered these when upgrading to Pydantic 2.0
    Fokko authored Jul 25, 2023
    Configuration menu
    Copy the full SHA
    9f5701a View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2023

  1. Python: Add pyarrow hdfs support (#7997)

    * Add pyarrow hdfs support
    
    * Update PR review
    LuigiCerone authored Jul 26, 2023
    Configuration menu
    Copy the full SHA
    4c6d52c View commit details
    Browse the repository at this point in the history

Commits on Jul 31, 2023

  1. Build: Bump mkdocs from 1.4.3 to 1.5.1 in /python (#8184)

    Bumps [mkdocs](https://github.com/mkdocs/mkdocs) from 1.4.3 to 1.5.1.
    - [Release notes](https://github.com/mkdocs/mkdocs/releases)
    - [Commits](mkdocs/mkdocs@1.4.3...1.5.1)
    
    ---
    updated-dependencies:
    - dependency-name: mkdocs
      dependency-type: direct:production
      update-type: version-update:semver-minor
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Jul 31, 2023
    Configuration menu
    Copy the full SHA
    98d87d8 View commit details
    Browse the repository at this point in the history
  2. Build: Bump mkdocstrings-python from 1.1.2 to 1.2.1 in /python (#8185)

    Bumps [mkdocstrings-python](https://github.com/mkdocstrings/python) from 1.1.2 to 1.2.1.
    - [Release notes](https://github.com/mkdocstrings/python/releases)
    - [Changelog](https://github.com/mkdocstrings/python/blob/main/CHANGELOG.md)
    - [Commits](mkdocstrings/python@1.1.2...1.2.1)
    
    ---
    updated-dependencies:
    - dependency-name: mkdocstrings-python
      dependency-type: direct:production
      update-type: version-update:semver-minor
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Jul 31, 2023
    Configuration menu
    Copy the full SHA
    6cdd671 View commit details
    Browse the repository at this point in the history
  3. Build: Bump rich from 13.4.2 to 13.5.0 in /python (#8186)

    Bumps [rich](https://github.com/Textualize/rich) from 13.4.2 to 13.5.0.
    - [Release notes](https://github.com/Textualize/rich/releases)
    - [Changelog](https://github.com/Textualize/rich/blob/master/CHANGELOG.md)
    - [Commits](Textualize/rich@v13.4.2...v13.5.0)
    
    ---
    updated-dependencies:
    - dependency-name: rich
      dependency-type: direct:production
      update-type: version-update:semver-minor
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Jul 31, 2023
    Configuration menu
    Copy the full SHA
    cd3ae8f View commit details
    Browse the repository at this point in the history
  4. Build: Bump ray from 2.6.0 to 2.6.1 in /python (#8187)

    Bumps [ray](https://github.com/ray-project/ray) from 2.6.0 to 2.6.1.
    - [Release notes](https://github.com/ray-project/ray/releases)
    - [Commits](ray-project/ray@ray-2.6.0...ray-2.6.1)
    
    ---
    updated-dependencies:
    - dependency-name: ray
      dependency-type: direct:production
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Jul 31, 2023
    Configuration menu
    Copy the full SHA
    a5f3e3f View commit details
    Browse the repository at this point in the history
  5. Build: Bump mkdocs-material from 9.1.19 to 9.1.21 in /python (#8188)

    Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 9.1.19 to 9.1.21.
    - [Release notes](https://github.com/squidfunk/mkdocs-material/releases)
    - [Changelog](https://github.com/squidfunk/mkdocs-material/blob/master/CHANGELOG)
    - [Commits](squidfunk/mkdocs-material@9.1.19...9.1.21)
    
    ---
    updated-dependencies:
    - dependency-name: mkdocs-material
      dependency-type: direct:production
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Jul 31, 2023
    Configuration menu
    Copy the full SHA
    ef21348 View commit details
    Browse the repository at this point in the history

Commits on Aug 2, 2023

  1. Configuration menu
    Copy the full SHA
    9ea3d43 View commit details
    Browse the repository at this point in the history
  2. Python: Fix passing in Glue credentials (#8209)

    Co-authored-by: bmaisonneuve <[email protected]>
    bmaisonn and bmaisonneuve authored Aug 2, 2023
    Configuration menu
    Copy the full SHA
    1b8825b View commit details
    Browse the repository at this point in the history

Commits on Aug 3, 2023

  1. Configuration menu
    Copy the full SHA
    afb303b View commit details
    Browse the repository at this point in the history
  2. Python: Add retry for downloading spark package (#8219)

    * curl retry
    
    * fixes
    
    ---------
    
    Co-authored-by: xianyangliu <[email protected]>
    ConeyLiu and ConeyLiu authored Aug 3, 2023
    Configuration menu
    Copy the full SHA
    1a1d7e1 View commit details
    Browse the repository at this point in the history

Commits on Aug 4, 2023

  1. Configuration menu
    Copy the full SHA
    764be90 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    c71e463 View commit details
    Browse the repository at this point in the history
  3. Python: Add support date, time and datetime in to_bytes (#8214)

    * added datetime support for to_bytes
    
    * fmt
    
    * resuing datetime_to_micros
    
    * removed unused imports
    
    * added new test cases
    
    * fixed format
    
    * removed type checking
    
    * added new test function
    
    * removed old test cases
    
    * datetypes added in function argument
    
    ---------
    
    Co-authored-by: Rishabh Srivastava <[email protected]>
    onerishabh and Rishabh Srivastava authored Aug 4, 2023
    Configuration menu
    Copy the full SHA
    92ca3f5 View commit details
    Browse the repository at this point in the history

Commits on Aug 6, 2023

  1. Build: Bump ray from 2.6.1 to 2.6.2 in /python (#8236)

    Bumps [ray](https://github.com/ray-project/ray) from 2.6.1 to 2.6.2.
    - [Release notes](https://github.com/ray-project/ray/releases)
    - [Commits](ray-project/ray@ray-2.6.1...ray-2.6.2)
    
    ---
    updated-dependencies:
    - dependency-name: ray
      dependency-type: direct:production
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Aug 6, 2023
    Configuration menu
    Copy the full SHA
    1285fbf View commit details
    Browse the repository at this point in the history
  2. Build: Bump mkdocs from 1.5.1 to 1.5.2 in /python (#8235)

    Bumps [mkdocs](https://github.com/mkdocs/mkdocs) from 1.5.1 to 1.5.2.
    - [Release notes](https://github.com/mkdocs/mkdocs/releases)
    - [Commits](mkdocs/mkdocs@1.5.1...1.5.2)
    
    ---
    updated-dependencies:
    - dependency-name: mkdocs
      dependency-type: direct:production
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Aug 6, 2023
    Configuration menu
    Copy the full SHA
    02a3c04 View commit details
    Browse the repository at this point in the history
  3. Build: Bump mkdocs-autorefs from 0.4.1 to 0.5.0 in /python (#8234)

    Bumps [mkdocs-autorefs](https://github.com/mkdocstrings/autorefs) from 0.4.1 to 0.5.0.
    - [Release notes](https://github.com/mkdocstrings/autorefs/releases)
    - [Changelog](https://github.com/mkdocstrings/autorefs/blob/main/CHANGELOG.md)
    - [Commits](mkdocstrings/autorefs@0.4.1...0.5.0)
    
    ---
    updated-dependencies:
    - dependency-name: mkdocs-autorefs
      dependency-type: direct:production
      update-type: version-update:semver-minor
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Aug 6, 2023
    Configuration menu
    Copy the full SHA
    1d55496 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    9ce6446 View commit details
    Browse the repository at this point in the history

Commits on Aug 7, 2023

  1. Build: Bump pytest-checkdocs from 2.10.0 to 2.10.1 in /python (#8233)

    Bumps [pytest-checkdocs](https://github.com/jaraco/pytest-checkdocs) from 2.10.0 to 2.10.1.
    - [Release notes](https://github.com/jaraco/pytest-checkdocs/releases)
    - [Changelog](https://github.com/jaraco/pytest-checkdocs/blob/main/NEWS.rst)
    - [Commits](jaraco/pytest-checkdocs@v2.10.0...v2.10.1)
    
    ---
    updated-dependencies:
    - dependency-name: pytest-checkdocs
      dependency-type: direct:development
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Aug 7, 2023
    Configuration menu
    Copy the full SHA
    bab25a9 View commit details
    Browse the repository at this point in the history
  2. Build: Bump rich from 13.5.0 to 13.5.2 in /python (#8232)

    Bumps [rich](https://github.com/Textualize/rich) from 13.5.0 to 13.5.2.
    - [Release notes](https://github.com/Textualize/rich/releases)
    - [Changelog](https://github.com/Textualize/rich/blob/master/CHANGELOG.md)
    - [Commits](Textualize/rich@v13.5.0...v13.5.2)
    
    ---
    updated-dependencies:
    - dependency-name: rich
      dependency-type: direct:production
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Aug 7, 2023
    Configuration menu
    Copy the full SHA
    e6ea6d0 View commit details
    Browse the repository at this point in the history
  3. Python: Add more tests for the Avro writer (#8067)

    * Python: Add more tests for the Avro writer
    
    * Fix the tests
    
    * WIP
    
    * Update
    
    * Update python/pyiceberg/utils/datetime.py
    
    * Update python/pyiceberg/utils/datetime.py
    
    * Update python/tests/avro/test_encoder.py
    
    * WIP
    
    * Cleanup
    
    * Cleanup
    
    * Cleanup
    
    * Cleanup
    
    * Fix the tests
    Fokko authored Aug 7, 2023
    Configuration menu
    Copy the full SHA
    1a6b4de View commit details
    Browse the repository at this point in the history

Commits on Aug 10, 2023

  1. Python: Change UUID representation to bytes (#8267)

    * Change UUID Inner Representation to bytes, add integration tests for uuid and fixed
    
    * address review comments
    
    * optimize transform code
    
    * supports conversion from bytes or fixed to uuid
    HonahX authored Aug 10, 2023
    Configuration menu
    Copy the full SHA
    86bd97b View commit details
    Browse the repository at this point in the history

Commits on Aug 11, 2023

  1. Python: Simplify Readers using inheritance (#8291)

    Numerous reader classes are simply reading integers, they can all
    inherit from IntegerReader rather than having their own implementations
    of read() and skip().  Make this change.
    rustyconover authored Aug 11, 2023
    Configuration menu
    Copy the full SHA
    02f3990 View commit details
    Browse the repository at this point in the history

Commits on Aug 14, 2023

  1. Python: Implement Cython based decoding for Avro (#8134)

    * Python: Improve Avro read performance
    
    Utilize __slots__ for various Avro classes.
    
    Memoize the key/value reader functions in MapReader.
    
    * Python: improve Avro parsing by caching struct types.
    
    Cache the struct types for ManifestEntry and ManifestFile schemas.
    
    Cache the _position_to_field_name lookup in Records if a struct type is passed.
    
    Improve StructReader to use slots and avoid isinstance() lookups on each time
    the structure is read, by performing the check in __init__().
    
    Improve StructReader to determine the arguments to create_struct() once in init
    and reuse the result each time the structure is read, avoid a try block.
    
    * Python: Improve Avro Parse speed
    
    Cache the hash value of the Struct types so that when new
    Record objects are created time is not spent recomputing
    the hash value.
    
    Change the implementation of the Record class to cache the
    mapping from field name to position.  Also utilize an array
    rather than a dictionary for these lookups.
    
    * fix some lints
    
    * fix some type casing
    
    * fix: adjust PR comments
    
    * WIP: changes for cython parsing
    
    * fix: address PR feedback.
    
    * Add additional tests for InMemoryBinaryDecoder
    
    * More work on fast Avro decoder
    
    * Work in progress
    
    * Load entire Avro file into memory rather than streaming it
    
    * fix mypy and lint warnings
    
    * fix some more pylint warnings
    
    * Fix lints and build failures
    
    * fix: move lazydict out to its own file.
    
    * fix: disable seeking on input file
    
    * Cleanup expression
    
    * fix: improve integer test case
    
    * fix: rename decoding functions
    
    * fix: remove reader functions that returned native types
    
    * fix: simplify some ReaderClasses via inheritance
    
    Numerous reader classes are simply reading integers, they can all
    inherit from IntegerReader rather than having their own implementations
    of read() and skip().  Make this change.
    
    * fix: make sqlalchemy optional
    
    * fix: make lazydict generic and move out of avro, add tests
    
    * fix: some lint fixes
    
    * fix: some cleanups and comments
    
    * fix: commit linter changes
    
    ---------
    
    Co-authored-by: Fokko Driesprong <[email protected]>
    rustyconover and Fokko authored Aug 14, 2023
    Configuration menu
    Copy the full SHA
    f2d0298 View commit details
    Browse the repository at this point in the history
  2. Build: Bump mkdocstrings-python from 1.2.1 to 1.3.0 in /python (#8310)

    Bumps [mkdocstrings-python](https://github.com/mkdocstrings/python) from 1.2.1 to 1.3.0.
    - [Release notes](https://github.com/mkdocstrings/python/releases)
    - [Changelog](https://github.com/mkdocstrings/python/blob/main/CHANGELOG.md)
    - [Commits](mkdocstrings/python@1.2.1...1.3.0)
    
    ---
    updated-dependencies:
    - dependency-name: mkdocstrings-python
      dependency-type: direct:production
      update-type: version-update:semver-minor
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Aug 14, 2023
    Configuration menu
    Copy the full SHA
    10662e3 View commit details
    Browse the repository at this point in the history
  3. Build: Bump coverage from 7.2.7 to 7.3.0 in /python (#8308)

    Bumps [coverage](https://github.com/nedbat/coveragepy) from 7.2.7 to 7.3.0.
    - [Release notes](https://github.com/nedbat/coveragepy/releases)
    - [Changelog](https://github.com/nedbat/coveragepy/blob/master/CHANGES.rst)
    - [Commits](nedbat/coveragepy@7.2.7...7.3.0)
    
    ---
    updated-dependencies:
    - dependency-name: coverage
      dependency-type: direct:development
      update-type: version-update:semver-minor
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Aug 14, 2023
    Configuration menu
    Copy the full SHA
    d26bffc View commit details
    Browse the repository at this point in the history
  4. Python: Publish Wheels (#8287)

    * Python: Publish Wheels
    
    * Add working-directory
    
    * Clean up the script
    Fokko authored Aug 14, 2023
    Configuration menu
    Copy the full SHA
    ad237d2 View commit details
    Browse the repository at this point in the history
  5. Python: GCS Support (#8207)

    * pyiceberg: Add Google Cloud Storage support
    
    * updated project dependecies
    
    * Update python/pyiceberg/io/fsspec.py
    
    Co-authored-by: Fokko Driesprong <[email protected]>
    
    * Fix some configuration
    
    * MOAR tests
    
    * Start GCS server
    
    * Fix makefile
    
    * Move to http
    
    ---------
    
    Co-authored-by: Victoria Bukta <[email protected]>
    Co-authored-by: Victoria Bukta <[email protected]>
    3 people authored Aug 14, 2023
    Configuration menu
    Copy the full SHA
    cbc604a View commit details
    Browse the repository at this point in the history

Commits on Aug 15, 2023

  1. Python: Update .gitignore and remove unused imports (#8319)

    Noticed a few unused imports, and I have some Cython
    generated files that we shouldn't commit outside of the
    `.gitignore`.
    Fokko authored Aug 15, 2023
    Configuration menu
    Copy the full SHA
    5a9ce00 View commit details
    Browse the repository at this point in the history
  2. Python: Delegate JSON serialization to Pydantic (#8286)

    * refactor TableMetadataUtil parse_object with annotated type
    
    * refactor TableMetadataUtil parse_obj as parse_raw (from dict to string)
    
    * move parse raw and deserialization logic in a separate TableMetadata factory
    aless10 authored Aug 15, 2023
    Configuration menu
    Copy the full SHA
    63049de View commit details
    Browse the repository at this point in the history

Commits on Aug 16, 2023

  1. Configuration menu
    Copy the full SHA
    f1f9d55 View commit details
    Browse the repository at this point in the history
  2. Python: Optimize concurrency for limited queries (#8104)

    * feat(python): remove explicit row count lock
    
    * feat(python): stop waiting for task when limit reached
    
    * fix(python): remove unnecessary arg splat
    
    * fix(python): cancel all futures once result set acquired
    
    * fix(python): consistent scan ordering when limit applied
    
    * feat(python): reuse executor (wip)
    
    * fix(python): consolidate row count tracking
    
    * feat(python): use sortedcontainers in future ordering
    
    * feat(python): global executor
    
    * fix(python): formatting
    
    * fix(python): support limit = 0
    
    Co-authored-by: Fokko Driesprong <[email protected]>
    
    * fix(python): support limit = 0
    
    Co-authored-by: Fokko Driesprong <[email protected]>
    
    * fix(python): support limit = 0
    
    Co-authored-by: Fokko Driesprong <[email protected]>
    
    * feat(python): lazy re-usable executory
    
    * fix(python): appease rat
    
    * fix(python): use row counts container for mutability
    
    * fix(python): scan future cancelling
    
    * fix(python): data scan row count updates in worker
    
    * feat(python): simplify result agg
    
    * fix(python): reusable executor factory method name
    
    * fix(python): remove custom config error
    
    * fix(python): only slice result when limit provided
    
    ---------
    
    Co-authored-by: Fokko Driesprong <[email protected]>
    mr-brobot and Fokko authored Aug 16, 2023
    Configuration menu
    Copy the full SHA
    0f39e0e View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    bd0c506 View commit details
    Browse the repository at this point in the history

Commits on Aug 17, 2023

  1. Configuration menu
    Copy the full SHA
    a0351fd View commit details
    Browse the repository at this point in the history

Commits on Aug 20, 2023

  1. Configuration menu
    Copy the full SHA
    4cc8179 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    d95dd21 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    8461f17 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    c9caf76 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    14cd393 View commit details
    Browse the repository at this point in the history

Commits on Aug 21, 2023

  1. Configuration menu
    Copy the full SHA
    cd61b5a View commit details
    Browse the repository at this point in the history

Commits on Aug 22, 2023

  1. Python: Support for adding columns (#8174)

    * Python: Support add column
    
    * Add integration tests (#264)
    
    * Python: Support add column
    
    * Add the requirement (#265)
    
    * Python: Support add column
    
    ---------
    
    Co-authored-by: Fokko Driesprong <[email protected]>
    hililiwei and Fokko authored Aug 22, 2023
    Configuration menu
    Copy the full SHA
    4c50f4a View commit details
    Browse the repository at this point in the history
  2. Python: Fix Windows wheel build (#8371)

    The version was not correctly changed. Adding some quotes fixed it.
    Fokko authored Aug 22, 2023
    Configuration menu
    Copy the full SHA
    67f57f0 View commit details
    Browse the repository at this point in the history

Commits on Aug 27, 2023

  1. Build: Bump mkdocs-material from 9.1.21 to 9.2.4 in /python (#8405)

    Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 9.1.21 to 9.2.4.
    - [Release notes](https://github.com/squidfunk/mkdocs-material/releases)
    - [Changelog](https://github.com/squidfunk/mkdocs-material/blob/master/CHANGELOG)
    - [Commits](squidfunk/mkdocs-material@9.1.21...9.2.4)
    
    ---
    updated-dependencies:
    - dependency-name: mkdocs-material
      dependency-type: direct:production
      update-type: version-update:semver-minor
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Aug 27, 2023
    Configuration menu
    Copy the full SHA
    753a4c5 View commit details
    Browse the repository at this point in the history
  2. Build: Bump cython from 3.0.0 to 3.0.1 in /python (#8403)

    Bumps [cython](https://github.com/cython/cython) from 3.0.0 to 3.0.1.
    - [Release notes](https://github.com/cython/cython/releases)
    - [Changelog](https://github.com/cython/cython/blob/master/CHANGES.rst)
    - [Commits](cython/cython@3.0.0...3.0.1)
    
    ---
    updated-dependencies:
    - dependency-name: cython
      dependency-type: direct:development
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Aug 27, 2023
    Configuration menu
    Copy the full SHA
    20b1455 View commit details
    Browse the repository at this point in the history
  3. Build: Bump griffe from 0.33.0 to 0.35.1 in /python (#8404)

    Bumps [griffe](https://github.com/mkdocstrings/griffe) from 0.33.0 to 0.35.1.
    - [Release notes](https://github.com/mkdocstrings/griffe/releases)
    - [Changelog](https://github.com/mkdocstrings/griffe/blob/main/CHANGELOG.md)
    - [Commits](mkdocstrings/griffe@0.33.0...0.35.1)
    
    ---
    updated-dependencies:
    - dependency-name: griffe
      dependency-type: direct:production
      update-type: version-update:semver-minor
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Aug 27, 2023
    Configuration menu
    Copy the full SHA
    c3192f5 View commit details
    Browse the repository at this point in the history
  4. Build: Bump moto from 4.1.14 to 4.2.0 in /python (#8402)

    Bumps [moto](https://github.com/getmoto/moto) from 4.1.14 to 4.2.0.
    - [Changelog](https://github.com/getmoto/moto/blob/master/CHANGELOG.md)
    - [Commits](getmoto/moto@4.1.14...4.2.0)
    
    ---
    updated-dependencies:
    - dependency-name: moto
      dependency-type: direct:development
      update-type: version-update:semver-minor
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Aug 27, 2023
    Configuration menu
    Copy the full SHA
    d97d0bb View commit details
    Browse the repository at this point in the history

Commits on Aug 28, 2023

  1. Python: Fix D401 pydocstyle issues (#8401)

    * Fix D401 pydocstyle issues
    
    * Update python/tests/conftest.py
    
    ---------
    
    Co-authored-by: Fokko Driesprong <[email protected]>
    TjuAachen and Fokko authored Aug 28, 2023
    Configuration menu
    Copy the full SHA
    344023b View commit details
    Browse the repository at this point in the history
  2. Python: Check if identifier fields are valid (#8393)

    * Python: Check if identifier fields are valid
    
    * Python: Check if identifier fields are valid
    
    * Python: Check if identifier fields are valid
    
    * model_validator
    
    * change to private
    
    ---------
    
    Co-authored-by: Liwei Li <[email protected]>
    hililiwei and Liwei Li authored Aug 28, 2023
    Configuration menu
    Copy the full SHA
    463031b View commit details
    Browse the repository at this point in the history
  3. Python: Remove files file (#8411)

    This is already in `manifest.py`:
    
    ```python
    class ManifestContent(int, Enum):
        DATA = 0
        DELETES = 1
    
        def __repr__(self) -> str:
            """Returns the string representation of the ManifestContent class."""
            return f"ManifestContent.{self.name}"
    
    class ManifestEntryStatus(int, Enum):
        EXISTING = 0
        ADDED = 1
        DELETED = 2
    
        def __repr__(self) -> str:
            """Returns the string representation of the ManifestEntryStatus class."""
            return f"ManifestEntryStatus.{self.name}"
    
    class FileFormat(str, Enum):
        AVRO = "AVRO"
        PARQUET = "PARQUET"
        ORC = "ORC"
    
        def __repr__(self) -> str:
            """Returns the string representation of the FileFormat class."""
            return f"FileFormat.{self.name}"
    ```
    Fokko authored Aug 28, 2023
    Configuration menu
    Copy the full SHA
    e28715e View commit details
    Browse the repository at this point in the history

Commits on Aug 29, 2023

  1. Build: Bump pyarrow from 12.0.1 to 13.0.0 in /python (#8406)

    Bumps [pyarrow](https://github.com/apache/arrow) from 12.0.1 to 13.0.0.
    - [Commits](apache/arrow@go/v12.0.1...go/v13.0.0)
    
    ---
    updated-dependencies:
    - dependency-name: pyarrow
      dependency-type: direct:production
      update-type: version-update:semver-major
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Aug 29, 2023
    Configuration menu
    Copy the full SHA
    225a355 View commit details
    Browse the repository at this point in the history

Commits on Sep 1, 2023

  1. Python: Add py.typed in the package (#8443)

    I noticed that the type annotations weren't working when
    integrating with Pola.rs
    Fokko authored Sep 1, 2023
    Configuration menu
    Copy the full SHA
    44470b6 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    74f7789 View commit details
    Browse the repository at this point in the history
  3. Python: Bump boto3 to 1.26.79 (#8436)

    This is in line with the minimal version of s3fs
    Fokko authored Sep 1, 2023
    Configuration menu
    Copy the full SHA
    c2de268 View commit details
    Browse the repository at this point in the history

Commits on Sep 3, 2023

  1. Configuration menu
    Copy the full SHA
    725def2 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    666f3c5 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    787701b View commit details
    Browse the repository at this point in the history
  4. Build: Bump pre-commit from 3.3.3 to 3.4.0 in /python (#8476)

    Bumps [pre-commit](https://github.com/pre-commit/pre-commit) from 3.3.3 to 3.4.0.
    - [Release notes](https://github.com/pre-commit/pre-commit/releases)
    - [Changelog](https://github.com/pre-commit/pre-commit/blob/main/CHANGELOG.md)
    - [Commits](pre-commit/pre-commit@v3.3.3...v3.4.0)
    
    ---
    updated-dependencies:
    - dependency-name: pre-commit
      dependency-type: direct:development
      update-type: version-update:semver-minor
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Sep 3, 2023
    Configuration menu
    Copy the full SHA
    e439709 View commit details
    Browse the repository at this point in the history
  5. Build: Bump mkdocstrings-python from 1.4.0 to 1.6.0 in /python (#8481)

    Bumps [mkdocstrings-python](https://github.com/mkdocstrings/python) from 1.4.0 to 1.6.0.
    - [Release notes](https://github.com/mkdocstrings/python/releases)
    - [Changelog](https://github.com/mkdocstrings/python/blob/main/CHANGELOG.md)
    - [Commits](mkdocstrings/python@1.4.0...1.6.0)
    
    ---
    updated-dependencies:
    - dependency-name: mkdocstrings-python
      dependency-type: direct:production
      update-type: version-update:semver-minor
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Sep 3, 2023
    Configuration menu
    Copy the full SHA
    8be13ec View commit details
    Browse the repository at this point in the history
  6. Build: Bump griffe from 0.35.1 to 0.36.0 in /python (#8479)

    Bumps [griffe](https://github.com/mkdocstrings/griffe) from 0.35.1 to 0.36.0.
    - [Release notes](https://github.com/mkdocstrings/griffe/releases)
    - [Changelog](https://github.com/mkdocstrings/griffe/blob/main/CHANGELOG.md)
    - [Commits](mkdocstrings/griffe@0.35.1...0.36.0)
    
    ---
    updated-dependencies:
    - dependency-name: griffe
      dependency-type: direct:production
      update-type: version-update:semver-minor
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Sep 3, 2023
    Configuration menu
    Copy the full SHA
    679feb0 View commit details
    Browse the repository at this point in the history
  7. Build: Bump pytest from 7.4.0 to 7.4.1 in /python (#8478)

    Bumps [pytest](https://github.com/pytest-dev/pytest) from 7.4.0 to 7.4.1.
    - [Release notes](https://github.com/pytest-dev/pytest/releases)
    - [Changelog](https://github.com/pytest-dev/pytest/blob/main/CHANGELOG.rst)
    - [Commits](pytest-dev/pytest@7.4.0...7.4.1)
    
    ---
    updated-dependencies:
    - dependency-name: pytest
      dependency-type: direct:development
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Sep 3, 2023
    Configuration menu
    Copy the full SHA
    ce9c201 View commit details
    Browse the repository at this point in the history
  8. Python: Add note on pip (#8484)

    Fixes #8374
    Fokko authored Sep 3, 2023
    Configuration menu
    Copy the full SHA
    a048ff4 View commit details
    Browse the repository at this point in the history

Commits on Sep 4, 2023

  1. Configuration menu
    Copy the full SHA
    2929f19 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    b94cccc View commit details
    Browse the repository at this point in the history
  3. Python: Bump fsspec dependencies >=2023.1.0 (#8433)

    * Python: Bump fsspec dependencies `>=2023.1.0`
    
    I think it is good to bump and make the lower bound of the
    fsspec dependencies uniform. Also, we don't test for the
    older versions.
    
    s3fs `2023.1.0` uses aiobotocore `2.4.2`:
    https://github.com/fsspec/s3fs/blob/2023.1.0/requirements.txt
    
    And that depends on `botocore>=1.27.59,<1.27.60`:
    https://github.com/aio-libs/aiobotocore/blob/2.4.2/setup.py#L10`
    
    Which is also close to our `boto3` pin of `>=1.24.59`:
    apache/iceberg#8436
    
    * Fix poetry.lock
    Fokko authored Sep 4, 2023
    Configuration menu
    Copy the full SHA
    ef8173c View commit details
    Browse the repository at this point in the history

Commits on Sep 8, 2023

  1. Configuration menu
    Copy the full SHA
    6c3b01c View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2023

  1. Python: Standardized integer types over relying on C types (#8535)

    Utilize libc.stdint for the definition of unsigned 64 bit integers.
    
    Change the array.array type to use integers that are at least 64 bits in width.
    
    Changes motiviated by differences in Windows builds
    rustyconover authored Sep 9, 2023
    Configuration menu
    Copy the full SHA
    18e25a6 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    025dfa4 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    7494e6d View commit details
    Browse the repository at this point in the history

Commits on Sep 10, 2023

  1. Configuration menu
    Copy the full SHA
    eea61ef View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    103f328 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    6c9e5f9 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    3e9c2d0 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    d509737 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    52b5888 View commit details
    Browse the repository at this point in the history
  7. Python: Add checks after building the wheels (#8532)

    * Python: Add checks after building the wheels
    
    * Improvements
    Fokko authored Sep 10, 2023
    Configuration menu
    Copy the full SHA
    446c737 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    40c15f1 View commit details
    Browse the repository at this point in the history
  9. Python: Non-Cython fallback Avro parser (#8545)

    * Python: Non-Cython fallback Avro parser
    
    * Python: Non-Cython fallback Avro parser
    Fokko authored Sep 10, 2023
    Configuration menu
    Copy the full SHA
    d323d8e View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    ee3bf45 View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2023

  1. Python: Inline the Filesystem imports (#8548)

    * Python: Inline the Filesystem imports
    
    It can be that certain build flags are turned off:
    
    ```
    -DARROW_GCS=ON: Build Arrow with GCS support (requires the GCloud SDK for C++)
    -DARROW_HDFS=ON: Arrow integration with libhdfs for accessing the Hadoop Filesystem
    ```
    From: https://arrow.apache.org/docs/dev/developers/cpp/building.html#optional-components
    
    This will cause an ImportError when importing `pyarrow.py`,
    while it can be that you don't want to use a missing FS.
    Therefore it is better to inline the imports
    
    * Move imports to the top
    Fokko authored Sep 12, 2023
    Configuration menu
    Copy the full SHA
    e090fb1 View commit details
    Browse the repository at this point in the history
  2. Python: Fix caching of FileSystem (#8549)

    Before:
    ```
    python3 /tmp/benchmark.py
    
    import: 0.175605 seconds
    catalog: 0.060079 seconds
    table: 0.245859 seconds
    scan: 5.218688 seconds
    Rows: 119890
    ```
    
    After:
    ```
    python3 /tmp/benchmark.py
    
    import: 0.169811 seconds
    catalog: 0.054512 seconds
    table: 0.233786 seconds
    scan: 2.165105 seconds
    Rows: 119890
    ```
    Fokko authored Sep 12, 2023
    Configuration menu
    Copy the full SHA
    e62f7c4 View commit details
    Browse the repository at this point in the history

Commits on Sep 17, 2023

  1. Build: Bump mkdocs-section-index from 0.3.5 to 0.3.7 in /python (#8572)

    Bumps [mkdocs-section-index](https://github.com/oprypin/mkdocs-section-index) from 0.3.5 to 0.3.7.
    - [Release notes](https://github.com/oprypin/mkdocs-section-index/releases)
    - [Commits](oprypin/mkdocs-section-index@v0.3.5...v0.3.7)
    
    ---
    updated-dependencies:
    - dependency-name: mkdocs-section-index
      dependency-type: direct:production
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Sep 17, 2023
    Configuration menu
    Copy the full SHA
    e758d74 View commit details
    Browse the repository at this point in the history
  2. Build: Bump mkdocstrings-python from 1.6.2 to 1.7.0 in /python (#8573)

    Bumps [mkdocstrings-python](https://github.com/mkdocstrings/python) from 1.6.2 to 1.7.0.
    - [Release notes](https://github.com/mkdocstrings/python/releases)
    - [Changelog](https://github.com/mkdocstrings/python/blob/main/CHANGELOG.md)
    - [Commits](mkdocstrings/python@1.6.2...1.7.0)
    
    ---
    updated-dependencies:
    - dependency-name: mkdocstrings-python
      dependency-type: direct:production
      update-type: version-update:semver-minor
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Sep 17, 2023
    Configuration menu
    Copy the full SHA
    a0591ef View commit details
    Browse the repository at this point in the history
  3. Build: Bump moto from 4.2.2 to 4.2.3 in /python (#8574)

    Bumps [moto](https://github.com/getmoto/moto) from 4.2.2 to 4.2.3.
    - [Release notes](https://github.com/getmoto/moto/releases)
    - [Changelog](https://github.com/getmoto/moto/blob/master/CHANGELOG.md)
    - [Commits](getmoto/moto@4.2.2...4.2.3)
    
    ---
    updated-dependencies:
    - dependency-name: moto
      dependency-type: direct:development
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Sep 17, 2023
    Configuration menu
    Copy the full SHA
    8929e34 View commit details
    Browse the repository at this point in the history
  4. Build: Bump mkdocs-material from 9.2.8 to 9.3.1 in /python (#8576)

    Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 9.2.8 to 9.3.1.
    - [Release notes](https://github.com/squidfunk/mkdocs-material/releases)
    - [Changelog](https://github.com/squidfunk/mkdocs-material/blob/master/CHANGELOG)
    - [Commits](squidfunk/mkdocs-material@9.2.8...9.3.1)
    
    ---
    updated-dependencies:
    - dependency-name: mkdocs-material
      dependency-type: direct:production
      update-type: version-update:semver-minor
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Sep 17, 2023
    Configuration menu
    Copy the full SHA
    f905893 View commit details
    Browse the repository at this point in the history
  5. Build: Bump griffe from 0.36.1 to 0.36.2 in /python (#8575)

    Bumps [griffe](https://github.com/mkdocstrings/griffe) from 0.36.1 to 0.36.2.
    - [Release notes](https://github.com/mkdocstrings/griffe/releases)
    - [Changelog](https://github.com/mkdocstrings/griffe/blob/main/CHANGELOG.md)
    - [Commits](mkdocstrings/griffe@0.36.1...0.36.2)
    
    ---
    updated-dependencies:
    - dependency-name: griffe
      dependency-type: direct:production
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Sep 17, 2023
    Configuration menu
    Copy the full SHA
    f0eca94 View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2023

  1. Python: Compute parquet stats (#7831)

    * Add function to compute parquet file metadata
    
    * Addition of docstring and extra parameter to avoid reading the file
    unnecessarily
    
    * Refactor the statistics computation entirely to use pyarrow metadata
    
    This commit makes sure to test the metadata computation both using
    `pyarrow.parquet.ParqueWriter` and `pyarrow.parquet.write_to_dataset`.
    
    * Appease pre-commit hooks
    
    * Fix temporary path
    
    * Make the metrics mode configurable as documented here: https://iceberg.apache.org/docs/latest/configuration/
    
    * Initialize binary serializers only once
    
    * Log arrow not implemented exception
    
    * Fix None comparison expression
    
    * Add map column to test data
    
    * Moving pyarrow specific code to io.pyarrow
    
    * type annotation
    
    * Refactor the stats collection using the pyarrow visitor
    
    * Clean redundant code and add warning message to the log
    
    * Address some of the review comments
    
    * Add tests to check of the number of columns found by the statistics
    collector is correct
    
    * We don't want to truncate numeric data types
    
    * Verify match of Iceberg types with Parquet physical types
    
    * Fix truncation of upper bounds
    
    * Transform asserts to ValueErrors
    
    * Add review suggestions
    
    * Address simple code style review comments
    
    * Fix potential null write
    
    * Apply function name refactoring
    
    * Move pyarrow statistics tests to a new file
    
    * Disable stats computation for nested types
    
    * Modularize the fill_parquet_file_metadata function
    
    * Allow metrics modes to have extra whitespace but not other trailing
    characters
    
    * Move upper bound truncation logic to another file
    
    * Be defensive with regards to missing row group statistics
    
    * Add tests for structs
    
    * Remove special treatment of UUIDType
    
    * Rely on parquet column path rather than column order
    
    This commit adds a visitor to compute a mapping from
    parquet column path to iceberg field ID.
    
    * Change mood to imperative to appease linter
    
    * Factor out the logic to obtain the current table schema
    maxdebayser authored Sep 20, 2023
    Configuration menu
    Copy the full SHA
    601d5a1 View commit details
    Browse the repository at this point in the history
  2. Python: Register table functionality for SQL Catalog (#8589)

    * Add register table implementation for sql catalog
    
    * Fix lint
    rushilshah1 authored Sep 20, 2023
    Configuration menu
    Copy the full SHA
    87fa047 View commit details
    Browse the repository at this point in the history

Commits on Sep 22, 2023

  1. Configuration menu
    Copy the full SHA
    6de9760 View commit details
    Browse the repository at this point in the history
  2. Python: Add __repr__ method to Table class (#8447)

    * Python: Add __repr__ method to Table class
    
    * update test for __repr__ of Table class
    
    * add sort_order to table repr
    
    ---------
    
    Co-authored-by: Thi Cam Tu Phan <[email protected]>
    tlm365 and KaiPhan authored Sep 22, 2023
    Configuration menu
    Copy the full SHA
    ba05fee View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    054ef7c View commit details
    Browse the repository at this point in the history
  4. Python: Improve Glue catalog using Boto3 types (#8304)

    * Python: improve Glue catalog using Boto3 types
    
    * fix: address PR feedback
    
    ---------
    
    Co-authored-by: Fokko Driesprong <[email protected]>
    rustyconover and Fokko authored Sep 22, 2023
    Configuration menu
    Copy the full SHA
    ac9b923 View commit details
    Browse the repository at this point in the history
  5. Python: Add __repr__ for Catalog (#8558)

    * Python: Add `__repr__` for `Table` and `Catalog`
    
    * remove properties in `__repr__` output
    
    * remove table `__repr__`
    
    * clean up catalog __repr__ and add test
    
    * actually use repr instead of str
    
    * Update python/tests/catalog/test_base.py
    
    Co-authored-by: Fokko Driesprong <[email protected]>
    
    * Update python/pyiceberg/catalog/__init__.py
    
    * Update python/tests/catalog/test_base.py
    
    ---------
    
    Co-authored-by: Fokko Driesprong <[email protected]>
    jayceslesar and Fokko authored Sep 22, 2023
    Configuration menu
    Copy the full SHA
    a1d7186 View commit details
    Browse the repository at this point in the history
  6. Python: Replace isort, pylint, prettier, pyupgrade & flake8

    … with `ruff` (#8408)
    MehulBatra authored Sep 22, 2023
    Configuration menu
    Copy the full SHA
    06abb3b View commit details
    Browse the repository at this point in the history

Commits on Sep 24, 2023

  1. Build: Bump mkdocs from 1.5.2 to 1.5.3 in /python (#8633)

    Bumps [mkdocs](https://github.com/mkdocs/mkdocs) from 1.5.2 to 1.5.3.
    - [Release notes](https://github.com/mkdocs/mkdocs/releases)
    - [Commits](mkdocs/mkdocs@1.5.2...1.5.3)
    
    ---
    updated-dependencies:
    - dependency-name: mkdocs
      dependency-type: direct:production
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Sep 24, 2023
    Configuration menu
    Copy the full SHA
    831a5bb View commit details
    Browse the repository at this point in the history
  2. Build: Bump mkdocs-material-extensions from 1.1.1 to 1.2 in /python (…

    …#8632)
    
    Bumps [mkdocs-material-extensions](https://github.com/facelessuser/mkdocs-material-extensions) from 1.1.1 to 1.2.
    - [Release notes](https://github.com/facelessuser/mkdocs-material-extensions/releases)
    - [Changelog](https://github.com/facelessuser/mkdocs-material-extensions/blob/master/changelog.md)
    - [Commits](facelessuser/mkdocs-material-extensions@1.1.1...1.2)
    
    ---
    updated-dependencies:
    - dependency-name: mkdocs-material-extensions
      dependency-type: direct:production
      update-type: version-update:semver-minor
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Sep 24, 2023
    Configuration menu
    Copy the full SHA
    d6eefda View commit details
    Browse the repository at this point in the history
  3. Build: Bump moto from 4.2.3 to 4.2.4 in /python (#8631)

    Bumps [moto](https://github.com/getmoto/moto) from 4.2.3 to 4.2.4.
    - [Release notes](https://github.com/getmoto/moto/releases)
    - [Changelog](https://github.com/getmoto/moto/blob/master/CHANGELOG.md)
    - [Commits](getmoto/moto@4.2.3...4.2.4)
    
    ---
    updated-dependencies:
    - dependency-name: moto
      dependency-type: direct:development
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Sep 24, 2023
    Configuration menu
    Copy the full SHA
    2c52828 View commit details
    Browse the repository at this point in the history

Commits on Sep 25, 2023

  1. Build: Bump pytest from 7.4.1 to 7.4.2 in /python (#8630)

    Bumps [pytest](https://github.com/pytest-dev/pytest) from 7.4.1 to 7.4.2.
    - [Release notes](https://github.com/pytest-dev/pytest/releases)
    - [Changelog](https://github.com/pytest-dev/pytest/blob/main/CHANGELOG.rst)
    - [Commits](pytest-dev/pytest@7.4.1...7.4.2)
    
    ---
    updated-dependencies:
    - dependency-name: pytest
      dependency-type: direct:development
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Sep 25, 2023
    Configuration menu
    Copy the full SHA
    14937b8 View commit details
    Browse the repository at this point in the history
  2. Build: Bump mkdocs-material from 9.3.1 to 9.4.1 in /python (#8628)

    Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 9.3.1 to 9.4.1.
    - [Release notes](https://github.com/squidfunk/mkdocs-material/releases)
    - [Changelog](https://github.com/squidfunk/mkdocs-material/blob/master/CHANGELOG)
    - [Commits](squidfunk/mkdocs-material@9.3.1...9.4.1)
    
    ---
    updated-dependencies:
    - dependency-name: mkdocs-material
      dependency-type: direct:production
      update-type: version-update:semver-minor
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Sep 25, 2023
    Configuration menu
    Copy the full SHA
    9ba437f View commit details
    Browse the repository at this point in the history
  3. Build: Bump mkdocs-literate-nav from 0.6.0 to 0.6.1 in /python (#8627)

    Bumps [mkdocs-literate-nav](https://github.com/oprypin/mkdocs-literate-nav) from 0.6.0 to 0.6.1.
    - [Release notes](https://github.com/oprypin/mkdocs-literate-nav/releases)
    - [Commits](oprypin/mkdocs-literate-nav@v0.6.0...v0.6.1)
    
    ---
    updated-dependencies:
    - dependency-name: mkdocs-literate-nav
      dependency-type: direct:production
      update-type: version-update:semver-patch
    ...
    
    Signed-off-by: dependabot[bot] <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Sep 25, 2023
    Configuration menu
    Copy the full SHA
    583c4bc View commit details
    Browse the repository at this point in the history

Commits on Sep 28, 2023

  1. Configuration menu
    Copy the full SHA
    7261ebb View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    624e825 View commit details
    Browse the repository at this point in the history

Commits on Sep 29, 2023

  1. Python: ManifestWriter and ManifestListWriter (#8622)

    * add ManifestWriter and ManifestListWriter
    
    * fix lint issue
    
    * remove assert, fix format issue
    
    * add prepare to ManifestWriter, remove TODO, fix format issue
    
    * fix some nit issue, add prepare... to ensure the correctness of data written
    
    * fix format issue
    
    * fix lint issue
    
    * avoid creating too much objects, handling v1, v2 data_file_type and DataFile class properly.
    
    * modify tests
    
    * refactor the way of handling two version of DataFile record
    
    * add integration tests, fix bugs, change PartitionSummary to a function
    
    * fix format issue
    
    * make data_type_v2 constants
    HonahX authored Sep 29, 2023
    Configuration menu
    Copy the full SHA
    778c66f View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    44c5635 View commit details
    Browse the repository at this point in the history
  3. Add missing root files

    Fokko committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    0a9f113 View commit details
    Browse the repository at this point in the history