Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upgrade hetmatpy with p-value imprecision fix #15

Merged
merged 2 commits into from
Feb 5, 2019

Conversation

dhimmel
Copy link
Collaborator

@dhimmel dhimmel commented Feb 4, 2019

@dhimmel
Copy link
Collaborator Author

dhimmel commented Feb 4, 2019

@dongbohu where is CI? I don't see any CI being performed on this PR either via #15 or https://circleci.com/gh/greenelab/hetmech-backend.

Sid note: we should add a CI badge to README.

@dongbohu
Copy link
Contributor

dongbohu commented Feb 5, 2019 via email

@dhimmel
Copy link
Collaborator Author

dhimmel commented Feb 5, 2019

I just switched this "advanced" CircleCI setting on:

Build forked pull requests
Run builds for pull requests from forks. CircleCI will automatically update the commit status shown on GitHub's pull request page.

IMO the most important purpose of CI is to build pull requests such that we don't end up merging faulty code. I am shocked this feature is not enabled by default.

@cgreene
Copy link
Member

cgreene commented Feb 5, 2019

@dhimmel : do you store any secrets in environment variables / etc that could get written out? Some CI services expose that to the build environment that runs PRs. That means anyone who files a PR could extract those secrets. I'm not sure 1) if this repo uses anything like that to automate deployment; 2) Circle CI has protection for this.

@dhimmel
Copy link
Collaborator Author

dhimmel commented Feb 5, 2019

PR builds now seem to be working. Although it looks like it's just building the commit rather than the commit merged into the current master (which IMO is slightly preferable).

do you store any secrets in environment variables / etc that could get written out?

I don't think so. We define public secrets for CircleCI. Of course, secrets shouldn't be available to PR builds. Haven't checked CircleCI's behavior here.

@dhimmel
Copy link
Collaborator Author

dhimmel commented Feb 5, 2019

After deleting and recreating the dj_hetmech database as per #16, the import succeeded with the following output:

>>> python manage.py populate_database --max-metapath-length=3  --reduced-metapaths --batch-size=12000

_download_hetionet_hetmat(self=<dj_hetmech_app.management.commands.populate_database.Command object at 0x7f9a810e8320>) ran in 0:00:00
_hetionet_graph(self=<dj_hetmech_app.management.commands.populate_database.Command object at 0x7f9a810e8320>) ran in 0:01:02
_populate_metanode_table() ran in 0:00:00
_populate_node_table() ran in 0:00:08
_populate_metapath_table() ran in 0:00:00
_download_path_counts(length=1) ran in 0:00:00
_populate_degree_grouped_permutation_table(length=1) ran in 0:00:00
_download_path_counts(length=2) ran in 0:00:01
_populate_degree_grouped_permutation_table(length=2) ran in 0:00:03
_download_path_counts(length=3) ran in 0:00:02
_populate_degree_grouped_permutation_table(length=3) ran in 0:00:34
_populate_path_count_table() ran in 0:19:43

@ben-heil reports the zero p-values due to imprecision are no longer in the database. Will merge this PR.

@dhimmel dhimmel merged commit c9174c4 into greenelab:master Feb 5, 2019
@dhimmel dhimmel deleted the imprecision branch February 5, 2019 18:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants