Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update epacamd_eia to properly use latest version #478

Open
wants to merge 5 commits into
base: main
Choose a base branch
from

Conversation

zschira
Copy link
Member

@zschira zschira commented Nov 14, 2024

Overview

Minor update to epacamd_eia to use latest year of data instead of pinning to 2021.

  • Run data for each year going back to 2018 (point to our tags, not EPA repo)
  • Debug each run and tag the outputs
  • Have the archiver refer to the tagged outputs
  • Update README to match this

Out of scope:

  • In PUDL, will need to eventually merge the multi-years of crosswalks - but for now just grab the last year
  • Ask Greg M about contributing his manual fix spreadsheet to PUDL directly

zaneselvans
zaneselvans previously approved these changes Nov 14, 2024
"""Get latest version from our forked repo."""
resources = []
for year in [2021, 2023]:
url = f"https://github.com/catalyst-cooperative/camd-eia-crosswalk-latest/archive/refs/tags/v{year}.zip"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If we're not just pulling from main and are going to refer to these past tags we should make sure we document that in the README for our fork of the crosswalk repo, so we don't forget next time someone goes in to update it.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Are the changes not cumulative? Does the 2023 update only cover 2023, and the 2021 update only covers 2021? What happens to the 2022 data? Or the 2019-2020 data?

@zaneselvans zaneselvans self-requested a review November 14, 2024 21:36
@zaneselvans
Copy link
Member

zaneselvans commented Nov 14, 2024

Whoops I meant to comment not approve.

@zaneselvans
Copy link
Member

@zschira Do you think there's a short path to getting this into shape for doing annual updates?

@e-belfer
Copy link
Member

e-belfer commented Jan 6, 2025

@zschira Do you want me to pick up and finish this PR?

@e-belfer e-belfer self-assigned this Jan 15, 2025
@e-belfer e-belfer dismissed zaneselvans’s stale review January 15, 2025 19:21

Will make major changes to this PR!

@e-belfer e-belfer removed the request for review from zaneselvans January 17, 2025 17:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
Status: Backlog
Development

Successfully merging this pull request may close these issues.

4 participants