Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to reproject estimated 3D Pose to Camera Coordinate System in the wild videos? #152

Open
Crazy-wu-20 opened this issue Jan 16, 2025 · 1 comment

Comments

@Crazy-wu-20
Copy link

Very nice work! However, I have a question:
How can I reproject the estimated 3D pose to the Camera Coordinate System, considering that the training data use a λ which is minimized from | | λ P ^ C P ^ p | | 2 , while for inference, it seems hard to get λ even if I have the R/ T/ f/ c, etx.

@Crazy-wu-20
Copy link
Author

I've noticed that in lib/data/datareader_h36m.py the code snippet:
train_labels = self.dt_dataset['train']['joint3d_image'][::self.sample_stride, :, :3].astype(np.float32) # [N, 17, 3]
suggests that MB didn’t use λ for training. Instead, it appears to rely on the 3D pose in the Camera Coordinate System. Is that correct?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant