Poor Reconstruction Results on Custom Data

[destroy314]

Thank you for sharing your work. I am attempting to reconstruct a desktop scene using a 6-camera setup as shown in the image below.

Based on the configuration in multipleview/default.py, I made some modifications: using half the learning rate, 7k coarse iterations, and 50k iterations. As shown in the video, the moving objects appear somewhat blurry in the input views, and some view overfitting can be observed in the novel views.

cam2.mp4

video.mp4

Do you have any suggestions or hypotheses regarding this issue? I would greatly appreciate your help.

[guanjunwu]

Interesting. In fact, the experiment conducted on 4D-GS is easy and simple, this is a hard and complex/large motion. If you can set a strict multiview, I recommend:

1. Add more cameras.
2. try to use multiview-based methods. such as: 4K4D: Real-Time 4D View Synthesis at 4K Resolution; or 3DGStream
3. wait for me to release a better 4DGS (?

[Lizhinwafu]

I have a video, how to make the dataset?