Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fix: athena-iceberg/schema-evolution/new-columns-empty-in-athena #3067

Open
wants to merge 2 commits into
base: main
Choose a base branch
from
Open

fix: athena-iceberg/schema-evolution/new-columns-empty-in-athena #3067

wants to merge 2 commits into from

Conversation

lautarortega
Copy link

Feature or Bugfix

  • Bugfix

Detail

  • Using the catalog columns only meant the new columns were being dropped. This caused the insert into statements to fail to write data for new columns.

Relates

Issue-2997

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

@lautarortega
bugfix/writing-complete-df
19635ce 
Using the catalog columns only meant the new columns were being dropped. This caused the insert into statements to fail to write data for new columns.
@lautarortega lautarortega changed the title bugfix/athena-iceberg/schema-evolution/new-columns-empty-in-athena fix/athena-iceberg/schema-evolution/new-columns-empty-in-athena Jan 9, 2025
@malachi-constant
Copy link
Contributor

AWS CodeBuild CI Report

  • CodeBuild project: GitHubCodeBuild8756EF16-4rfo0GHQ0u9a
  • Commit ID: 19635ce
  • Result: SUCCEEDED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

@lautarortega lautarortega changed the title fix/athena-iceberg/schema-evolution/new-columns-empty-in-athena fix: athena-iceberg/schema-evolution/new-columns-empty-in-athena Jan 9, 2025
@malachi-constant
Copy link
Contributor

AWS CodeBuild CI Report

  • CodeBuild project: GitHubDistributedCodeBuild6-jWcl5DLmvupS
  • Commit ID: 19635ce
  • Result: SUCCEEDED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

jaidisido
jaidisido reviewed Jan 13, 2025
View reviewed changes
Copy link
Contributor

@jaidisido jaidisido left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you please add a test illustrating the issue you are trying to fix here?

@jaidisido
Copy link
Contributor

AWS CodeBuild CI Report

  • CodeBuild project: GitHubCodeBuild8756EF16-4rfo0GHQ0u9a
  • Commit ID: a2e4ed4
  • Result: SUCCEEDED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

@jaidisido
Copy link
Contributor

AWS CodeBuild CI Report

  • CodeBuild project: GitHubDistributedCodeBuild6-jWcl5DLmvupS
  • Commit ID: a2e4ed4
  • Result: SUCCEEDED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@jaidisido jaidisido jaidisido left review comments

@kukushking kukushking Awaiting requested review from kukushking

At least 2 approving reviews are required to merge this pull request.

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@lautarortega @malachi-constant @jaidisido