Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Why are "extrinsics" presented in the train Method? #40

Open
eotich32 opened this issue Dec 4, 2024 · 1 comment
Open

Why are "extrinsics" presented in the train Method? #40

eotich32 opened this issue Dec 4, 2024 · 1 comment

Comments

@eotich32
Copy link

eotich32 commented Dec 4, 2024

As mentioned in the paper, the NoPoSplat is a pose free 3dgs, but why extrinsics are needed in training_step in model_wrapper.py?

def training_step(self, batch, batch_idx):
...
gaussians = self.encoder(batch["context"], self.global_step, visualization_dump=visualization_dump)
output = self.decoder.forward(
gaussians,
batch["target"]["extrinsics"], # here, it seems that we need extrinsics from the training dataset
batch["target"]["intrinsics"],
batch["target"]["near"],
batch["target"]["far"],
(h, w),
depth_mode=self.train_cfg.depth_mode,
)

these confused me

@eotich32
Copy link
Author

eotich32 commented Dec 5, 2024

I get it now.
The proposed approach needs GT extrinsics to train a NN model on large dataset.
After trained, the model predicts gaussians without extrinsics for any given scenes.
This approach really differs from previous 3DGSs.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant