Video continunity consistently out of sync, abberant frame movements.

SchrodingerDeeps wrote on 2/13/2021, 10:26 AM

Hello all,

I am having issues that are making it impossible to produce videos with this software.

When I import an MP4 video and attempt to play it in Video pro X the content rapidly goes out of sync with sound. But it is more than that, as it appears the images on the timeline do not match up with the video content.

Further to this, as I move around the video I see constant stuttering and multiple frames "appear" in the incorrect place.

This stuttering occurs regardless of weather I make any cuts / edits. However, if I do the finished product is nothing like I intended. Images appear in the wrong place, and sound does not match up. It's as if previous frames overlap and jump about.

As a work around I found that I could immediately encode the video (after making changes to volume for balancing voice against footage audio for example) and the export would not have this issue. Of course, I have then lost multiple audio tracks and they have been combined into one. I also tested it with only one audio track, it has made no difference.

I also checked and unchecked "automatically create frame table during import" and dissabled and enabled hardware support in all combinations but alas no difference.

This "workaround" is no longer workable, as the multiple encoding passes have resulted in artifact in videos and they are unworkable. So I am starting projects again.

I have just spent a considerable amount of time using handbrake to perform a lossless conversion in case it was somehow connected to Streamlabs. This has had no benefit, the problem persists.

If anyone here can help I will be enormously grateful, I am falling massively behind and it is hurting my channels progress - which incidentally was doing pretty well for it's age. But I can't have this awful quality polluting my work...

Please see the link to view a video of the issue.

Hardware/software spec:

OS: Windows 10 home

I7-6700K (overclocked 4.7Ghz)

RTX 3080

16GB RAM

Video Pro X version 18.01.89

P.S I have tried to solve this issue before, but alas I didn't get anywhere with support. A forum user told me it was a known streamlabs issue, hence the handbrake madness. I can not believe that software this expensive would be incompatible with streamlabs lol. To be fair, he is probably correct. The fact that the "re-encoded" version is fine is infuriating. I probably should have listened to the guy and ditched one or the other pieces of software. So here is too hoping the expert users can save me much heartache, last ditch effort.

I can't get all this footage again haha, many a tail of woe around here!

Very many thanks

Edit: Media Info for those that make sense of it ;).

General
\HorrorUpload.MP4
Format                                   : MPEG-4
Format profile                           : Base Media
Codec ID                                 : iso4 (iso4/hvc1)
File size                                : 8.87 MiB
Duration                                 : 7 s 917 ms
Overall bit rate mode                    : Variable
Overall bit rate                         : 9 398 kb/s
Encoded date                             : UTC 2021-02-13 16:09:28
Tagged date                              : UTC 2021-02-13 16:09:28

Video
ID                                       : 1
Format                                   : HEVC
Format/Info                              : High Efficiency Video Coding
Format profile                           : Main@L4.1@Main
Codec ID                                 : hvc1
Codec ID/Info                            : High Efficiency Video Coding
Duration                                 : 7 s 917 ms
Bit rate                                 : 9 277 kb/s
Width                                    : 1 920 pixels
Height                                   : 1 080 pixels
Display aspect ratio                     : 16:9
Frame rate mode                          : Constant
Frame rate                               : 60.000 FPS
Color space                              : YUV
Chroma subsampling                       : 4:2:0
Bit depth                                : 8 bits
Bits/(Pixel*Frame)                       : 0.075
Stream size                              : 8.75 MiB (99%)
Language                                 : English
Encoded date                             : UTC 2021-02-13 16:09:28
Tagged date                              : UTC 2021-02-13 16:09:28
Codec configuration box                  : hvcC

Audio
ID                                       : 2
Format                                   : AAC LC
Format/Info                              : Advanced Audio Codec Low Complexity
Codec ID                                 : mp4a-40-2
Duration                                 : 7 s 872 ms
Bit rate mode                            : Variable
Bit rate                                 : 117 kb/s
Channel(s)                               : 2 channels
Channel layout                           : L R
Sampling rate                            : 48.0 kHz
Frame rate                               : 46.875 FPS (1024 SPF)
Compression mode                         : Lossy
Stream size                              : 113 KiB (1%)
Language                                 : English
Encoded date                             : UTC 2021-02-13 16:09:28
Tagged date                              : UTC 2021-02-13 16:09:28

Comments

emmrecs wrote on 2/13/2021, 11:10 AM

@SchrodingerDeeps

I understand your frustration!

However, I don't have a solution for you, sorry!

But, since the video you uploaded is quite small can you post the original video file somewhere (not the forum or YouTube) and provide a link to download it so that other users can check on their machines? I have a very similar specced computer to yours, though with an AMD Radeon card (and i don't overclock my CPU to the same extent as you do).

Jeff
Forum Moderator

SchrodingerDeeps wrote on 2/13/2021, 11:55 AM

@SchrodingerDeeps

I understand your frustration!

However, I don't have a solution for you, sorry!

But, since the video you uploaded is quite small can you post the original video file somewhere (not the forum or YouTube) and provide a link to download it so that other users can check on their machines? I have a very similar specced computer to yours, though with an AMD Radeon card (and i don't overclock my CPU to the same extent as you do).

Jeff
Forum Moderator

Thank you for looking at it!

I can't send that particular original file, because the start of the video has my desktop and various other bits.

However the following one is exactly the same (everything is). It has been through handbrake although that didn't make a difference.

https://sendgb.com/zsK4W6muPFf

Please note it doesn't appear immediately obvious, if you are looking at then minute 6.50 just before a torpedo is dropped is a good place to play... And it seems to change as you move about (may be imagining that who knows)

But thank you very much, I hope that link works!

emmrecs wrote on 2/13/2021, 1:18 PM

@SchrodingerDeeps

The file you uploaded is more than 1GB! That really is too big to allow other users to easily download it!

I specifically mentioned the file you uploaded to YT because it was only a few seconds long. And we really need it as it is before you use any conversion software on it, I think.

So, do you have a short clip (a maximum of about 30 seconds) exactly as it comes from streamlabs? I assume streamlabs actually records at variable frame rate - which your MediaInfo data does not show: I assume that is being read from your file after conversion in Handbrake - if so, this causes problems for the vast majority of video editing apps.

Jeff

SchrodingerDeeps wrote on 2/13/2021, 1:22 PM

I did think it was way too big!

I will have to make a new video for the example (the one with the clip is even bigger).

It is being read after conversion, but I was using a CBR in streamlabs as well. I didn't think that could cause it. But I have no idea to be honest, so thank you!

I will make a clip. I have an idea, I will record a metronome for 10 seconds on youtube...

SchrodingerDeeps wrote on 2/13/2021, 1:46 PM

@SchrodingerDeeps

The file you uploaded is more than 1GB! That really is too big to allow other users to easily download it!

I specifically mentioned the file you uploaded to YT because it was only a few seconds long. And we really need it as it is before you use any conversion software on it, I think.

So, do you have a short clip (a maximum of about 30 seconds) exactly as it comes from streamlabs? I assume streamlabs actually records at variable frame rate - which your MediaInfo data does not show: I assume that is being read from your file after conversion in Handbrake - if so, this causes problems for the vast majority of video editing apps.

Jeff

Here is a link to an original file, no handbrake or anything, straight from streamlabs.

I have tested it and the problem occurs. Also I made better sense of your last message, I can confirm I am using CBR in stream labs too. The variable was causing hell in fast moving scenes.

https://sendgb.com/vTab0YW4DX9

Much smaller ;).

Note: It doesn't tend to occur in the first play through, I scrolled about a bit (made not cuts) and then suddenly the images went awry. Although the sound did stay in time...

I am sorry for that 1 gig monster...

johnebaker wrote on 2/13/2021, 3:09 PM

@SchrodingerDeeps

. . . . I can not believe that software this expensive would be incompatible with streamlabs lol. To be fair, he is probably correct . . .

I think that may have been me, and yes there are issues with the video/audio sync - there is rather long topic in which this was discussed following another users issues 2 months after yours here .

I have looked at both original video clips in VPX 12 v18.0.1.89.

Syncbeat.mp4 - I can see no issue with the sync at all between the beep and rotating icon, which is what I would expect given the MediaInfo data.

HELOATTACK.mkv - the audio is creeping ahead of the video - the MediaInfo indicates the audio is sampled at 44.1 kHz, video standard is 48 kHz - this would account for some of the audio creep, however I suspect there is more to this given the lengtn of the video clip.

The MediaInfo data also indicates that Streamlabs is actually a version of OBS.

Try setting the Desktop (?) Audio offset to 100ms in SLOBS, do a test recording, check how much it drifts and repeat the adjusting/testing until you get it to sync as close as possible.

. . . . but I was using a CBR in streamlabs as wel . . . .

Constant Bitrate (CBR) is not necessary - Variable Bitrate (VBR) is better as the available data bits can be allocated where they are needed, increasing the perceived video quality where necessary.

You do need to:

record at Constant Framerate (CFR) and check in the OBS log that no frames have been dropped
record the audio at 48 kHz sample rate

HTH

John EB

SchrodingerDeeps wrote on 2/13/2021, 3:17 PM

Thank you!

However the audio is only a small part of the issue, since watching the screen the images themselves jump about.

When I watched the sync beat, the image would jump between 4 and 3 "pips" for example. So I don't think it's the audio that's drifting, but rather the video footage it self is the problem.

I think I am about to give up, I am currently trying to learn HIT FILM PRO and ouch... A learning curve is upon me!

emmrecs wrote on 2/14/2021, 8:49 AM

@SchrodingerDeeps

Like @johnebaker, having downloaded and run your syncbeat file I can neither see nor hear any sync problem, sorry! And I've tested it in both Cyberlink Power DVD and VPX (latest version).

Have you tried what John suggested to do with HELOATTACK.mkv? I fully agree with John that audio at 44.1kHz and Variable Frame Rate are most definitely NOT going to help with sync issues.

Jeff

CubeAce wrote on 2/14/2021, 11:30 AM

@SchrodingerDeeps

I don't think you really understand the problems of video editing. You can find your problem repeated across all video editing program forums and the replies, and the cure, are always the same. Listen to what people are telling you here or you will find yourself in the same situation again as this (one of many) users of Hit Film Pro with their query.

The fact of the matter is video editors were initially meant to edit video content from cameras, not screen capture devices. Not the space saving codecs found in more modern phones. Even Go-Pro have issued advice on using their variable frame rate codec on the Hero 9 and it's implications and need for conversion to a constant frame rate for video editing.

Maybe one day, maybe soon, the situation may arise when video editors can cope better with such footage, but for now it remains a problem that has not been rectified sufficiently well and needs additional steps to alleviate.

Please feel free to check other video editing forums as well.

[Edit] I do agree though the audio sample rate should not be a problem in itself and that the standard 48KHz sample rate for video was for historic reasons and more to do with the need for more audio channels to be incorporated for multi channel audio content. It may only become a problem if editing footage within a project containing multiple clips with different sample rates and should only effect the quality of sections of the audio in such situations.

Ray.