Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Scitools Understand Parser #309

Merged
merged 21 commits into from
Dec 8, 2024
Merged

Conversation

RavenMarQ
Copy link
Collaborator

This is to test Committing and PR

This is to test Committing and PR
@RavenMarQ RavenMarQ linked an issue Sep 12, 2024 that may be closed by this pull request
11 tasks
@carlosparadis carlosparadis changed the title Test Scitools Understand Parser Sep 13, 2024
Modeled after parse_dependencies with a similar output, this is for review to see if it is in-line with specification
@RavenMarQ RavenMarQ self-assigned this Sep 26, 2024
Per the specifications in Issue 308, the files are functional and ready to be put into a notebook.
Quick fix
Updating NAMESPACE to export the new functions and creating the Rmd, are the primary notes. The folder holding the sample project also is included locally, but uses the calculator project provided in Issue from Carlos
@carlosparadis
Copy link
Member

@RavenMarQ just a reminder the notebook should have more than just code, please check with @daomcgill or ask her for a code review if needed.

Copy link
Member

@carlosparadis carlosparadis left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am a bi concerned with the use of loops here and the overall code logic, did you follow

https://github.com/sailuh/kaiaulu/blob/c7811069ef3c7943b509c76d4b9116d1a14dc343/R/src.R#L373C1-L378

?

@carlosparadis
Copy link
Member

In addition to the above, see CONTRIBUTING.md on how to edit NEWS.md, and DESCRIPTION. A lot of files that shouldn't be added have been pushed in this PR and those that should be edited were not.

Most of the code review notes have been resolved, except for changing the file.path and descriptions. The notebook is currently being updated, but a preview on the proposed format is provided.
Copy link
Collaborator

@daomcgill daomcgill left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The reason for having a notebook is to help users understand what they can do with it, and why they would want to use the features in the first place (as well as understanding how to use the code). The user should not need to read through your issue or code in order to know what is going on. This is the place to explain it to them.

Having addressing most things, especially using file.path, the functions are functional and the notebook works.
Copy link
Member

@carlosparadis carlosparadis left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Minor changes from the call, not comprehensive but complement.

RavenMarQ and others added 4 commits October 8, 2024 17:23
Resolving comments received on the notebook.
- Refactored the understand_showcase.Rmd notebook to expect the use of the getters from R/config.R (i #230 contains the getter functions in R/config.R).
Copy link

codecov bot commented Oct 11, 2024

Codecov Report

Attention: Patch coverage is 0% with 54 lines in your changes missing coverage. Please review.

Project coverage is 37.94%. Comparing base (2bc8d14) to head (857d3c4).
Report is 4 commits behind head on master.

Files with missing lines Patch % Lines
R/src.R 0.00% 54 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##           master     #309      +/-   ##
==========================================
- Coverage   39.79%   37.94%   -1.85%     
==========================================
  Files          20       20              
  Lines        3091     3355     +264     
==========================================
+ Hits         1230     1273      +43     
- Misses       1861     2082     +221     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

RavenMarQ and others added 4 commits October 10, 2024 15:51
- The project configuration sections of a notebook was incorrectly using the project directory (kaiaulu/) as its working directory rather than the directory that it resides in (/vignettes/) as its working directory.
@carlosparadis
Copy link
Member

@daomcgill the GitHub Actions problem was incidentally isolated: The moment I merged The GitHub Refresher, master started passing. I thought GitHub Actions broke something, but the problem is deeper and in our end. Notice how @RavenMarQ PR also passed just now after I merged the passing master. @beydlern @crepesAlot please merge master to your PRs that are still open. master is currently passing, as so is this PR. If yours is not passing, I can't merge.

Ping me on your PRs that do not pass master so we can diagnose. If you had to merge Dao's PR, then the issue on her code likely spread to yours.

@carlosparadis
Copy link
Member

I will be looking at this code next, please do not commit to it until I confirm otherwise.

Signed-off-by: Carlos Paradis <carlosviansi@gmail.com>
@carlosparadis
Copy link
Member

@daomcgill @RavenMarQ @crepesAlot @beydlern please make sure you are not adding unrelated files using git add . on everything on the other PRs you made, see 222e3ba.

@carlosparadis
Copy link
Member

@RavenMarQ The example on this notebook is Kaiaulu on the config, but the specified language to understand is java. This doesn't make sense. The notebook has to give a realistic example to the user.

@carlosparadis
Copy link
Member

The notebook does not call tools.yml, yet scitools is a third party tool. It should not assume every computer has "und" readily available.

Changed conf used to helix, the same used as depends_showcase notebook

Added scitools understand to tools.yml as not every computer will have
und available.

Signed-off-by: Carlos Paradis <carlosviansi@gmail.com>
This modifies the XML files so they are saved locally.
This adds an additional function step, removes the scitools
and dependency from parser.

The independent parser function means the raw data is not locked
behind the db, should a new version make it incompatible to extract
in the future. It also facilitates inspection of the raw data
should the parser ever break in the future.

Signed-off-by: Carlos Paradis <carlosviansi@gmail.com>
@carlosparadis
Copy link
Member

@daomcgill @RavenMarQ @crepesAlot @beydlern consider commit message a38e617 for any downloaders or parsers you may make in the future, it is a variant case of "keeping raw data locally".

@carlosparadis
Copy link
Member

Current implementation of transformer assumes no duplicate ever happens. This is fine in general for a true network, but using the "label" to name nodes causes the function to create the visualization to throw errors due to duplicates. For example, the file package-info.java in helix appears 18 times in different locations of the code base.

With a full path this can be avoidable, but the graph becomes unreadable. The most sane way to proceed here is to concatenate the id that scitools gives to the node to the label, therefore making it unique. However, the same correction needs to be done to the edges. Since this is something needed for graph only, the logic will be placed on the transform function.

Concatenate labels for node and edges

Signed-off-by: Carlos Paradis <carlosviansi@gmail.com>
Passes unit tests, notebooks, etc.

Signed-off-by: Carlos Paradis <carlosviansi@gmail.com>
Signed-off-by: Carlos Paradis <carlosviansi@gmail.com>
Copy link
Member

@carlosparadis carlosparadis left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All checks pass locally.

@carlosparadis carlosparadis merged commit ac522b6 into master Dec 8, 2024
0 of 2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Scitools' Understand Parser
4 participants