Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adapt LayerData upload scripts #40

Open
6 tasks
micah-prime opened this issue Jan 6, 2025 · 3 comments
Open
6 tasks

Adapt LayerData upload scripts #40

micah-prime opened this issue Jan 6, 2025 · 3 comments
Assignees
Labels
enhancement New feature or request

Comments

@micah-prime
Copy link
Contributor

Adapt the scripts for uploading LayerData to the new table organization using the class in snowex_db.upload.layers in this PR #39

Scripts include:

  • add_alaska_pits_2023.py
  • add_iop_pits.py
  • add_smp.py
  • add_ssa.py
  • add_time_series_pits_2020.py
  • add_time_series_pits_2021.py

Each script will need to upload the site properties csv before the rest of the data to ensure the Site table is populated with the environment info first

@micah-prime micah-prime added the enhancement New feature or request label Jan 6, 2025
@micah-prime
Copy link
Contributor Author

@micahjohnson150 FYI here is the start of this issue

@aaarendt
Copy link

aaarendt commented Jan 9, 2025

@micah-prime , @micahjohnson150 are all the raw data files accessible on NSIDC? If not, is there a way I can access preliminary data folders for testing and development?

@micah-prime
Copy link
Contributor Author

@micah-prime , @micahjohnson150 are all the raw data files accessible on NSIDC? If not, is there a way I can access preliminary data folders for testing and development?

The data files are accessible on NSIDC. The easiest way is running the download scripts like https://github.com/SnowEx/snowex_db/blob/main/scripts/download/download_nsidc.sh
but change what is in https://github.com/SnowEx/snowex_db/blob/main/scripts/download/nsidc_sources.txt first or you'll get a lot of datasets
Also, this requires your netrc to be populated I believe

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

4 participants