Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

can you provide any script for visualization? #2

Open
JasonQSY opened this issue May 26, 2021 · 1 comment
Open

can you provide any script for visualization? #2

JasonQSY opened this issue May 26, 2021 · 1 comment

Comments

@JasonQSY
Copy link

Given a rgbd videos, I want to run ScrewNet and generate the predicted rotation axis. I've checked the code and it only gives me the number. How do I generate predictions like Fig 7 (real world image) in the paper? Thank you very much!

@jainajinkya
Copy link
Contributor

ScrewNet predicts the screw axis in the object's local frame of reference, which is placed at the center of the bounding box of the object. If you want the axis in the camera frame, you will additionally need the object's pose in the camera frame. With that, you can use equation 2 from the paper to define a transformation matrix for the screw axis and transform the axis to the camera frame (You can find an implementation of it in function "utils.py/transform_plucker_line" in the repo at: https://github.com/Pearl-UTexas/ScrewNet/blob/main/utils.py#L225 ). You can then overlay the screw axis in the camera frame on the image using standard opencv functions (cv2.projectPoints). Please let me know if you have any questions.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants