Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

edits to pbs.py to improve usability #114

Merged
merged 2 commits into from
Oct 18, 2024
Merged

edits to pbs.py to improve usability #114

merged 2 commits into from
Oct 18, 2024

Conversation

dkimpara
Copy link
Collaborator

@dkimpara dkimpara commented Oct 11, 2024


before, if you tried to use a config where the path included symlinks, the logic would delete the config file at save_loc/model.yml even though it is the same file. tested on derecho with launch option

explanation: realpath resolves symlinks and then applies abspath


new feature:

  • updated pbs.py so that .o files are saved to save_loc

testing:
checkout the branch, update your credit env, update the env in unet_test.yml with your env then launch a test with:

python applications/train.py -c [path-to-your-repo]miles-credit/config/unet_test.yml -l 1

see this dir for my results:
/glade/work/dkimpara/CREDIT_runs/test_1dg_unet/

@yingkaisha
Copy link
Collaborator

I'm not familiar with the difference. It would be great if others can check.

@dkimpara dkimpara changed the title handling symlinks in model.yml deletion/replacement logic edits to training infra to improve usability Oct 17, 2024
@dkimpara dkimpara changed the title edits to training infra to improve usability edits to pbs.py to improve usability Oct 17, 2024
@dkimpara dkimpara force-pushed the resolving_symlink_issue branch from 37897e9 to 2ff991c Compare October 18, 2024 16:32
@dkimpara dkimpara requested a review from sethmcg October 18, 2024 17:06
@dkimpara dkimpara force-pushed the resolving_symlink_issue branch from 2ff991c to f8a005f Compare October 18, 2024 20:45
@dkimpara dkimpara requested a review from kanz76 October 18, 2024 20:47
@djgagne djgagne merged commit a343e67 into main Oct 18, 2024
1 check passed
@dkimpara dkimpara deleted the resolving_symlink_issue branch October 18, 2024 21:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants