Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

run sv3d_u success but output mp4 can't play #326

Closed
hengshan123 opened this issue Mar 22, 2024 · 7 comments
Closed

run sv3d_u success but output mp4 can't play #326

hengshan123 opened this issue Mar 22, 2024 · 7 comments

Comments

@hengshan123
Copy link

hi, I run the script success:
python scripts/sampling/simple_video_sample.py --input_path assets/000.jpg --version sv3d_u

Initialized embedder #0: FrozenOpenCLIPImagePredictionEmbedder with 683800065 params. Trainable: False
Initialized embedder #1: VideoPredictionEmbedderWithEncoder with 83653863 params. Trainable: False
Initialized embedder #2: ConcatTimestepEmbedderND with 0 params. Trainable: False
Restored from checkpoints/sv3d_u.safetensors with 0 missing and 0 unexpected keys
############################## Sampling setting ##############################
Sampler: EulerEDMSampler
Discretization: EDMDiscretization
Guider: TrianglePredictionGuider
Sampling with EulerEDMSampler for 51 steps: 0%| | 0/51 [00:00<?, ?it/s]/home/j00668593/anaconda3/envs/py310/lib/python3.10/site-packages/torch/utils/checkpoint.py:31: UserWarning: None of the inputs have requires_grad=True. Gradients will be None
warnings.warn("None of the inputs have requires_grad=True. Gradients will be None")
Sampling with EulerEDMSampler for 51 steps: 98%|██████████████████████████████████████████████████████████████████████████████████████████▏ | 50/51 [00:59<00:01, 1.19s/it]

And i get the output in outputs/simple_video_sample/sv3d_u.
But the 000000.mp4 can't be played.

@wzds2015
Copy link

Same here for sv3d_p

@zijinY
Copy link

zijinY commented Mar 22, 2024

same here for sv3d_u

@hengshan123
Copy link
Author

I check the origin result vid, this is valid. the problem maybe in imageio
image

@wzds2015
Copy link

wzds2015 commented Mar 22, 2024

confirmed the issue is from imageio. Switch to cv2 solved the problem. fix: #327

@zijinY
Copy link

zijinY commented Mar 23, 2024

confirmed the issue is from imageio. Switch to cv2 solved the problem. fix: #327

Thanks for your advise, the issue is fixed !

@hengshan123
Copy link
Author

after install imageio-ffmpeg the problem is solved

@wyweiyangweiGh
Copy link

same question

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants