Uncompressed AVI files give very large data rate

jak.willis wrote on 9/27/2021, 3:15 PM

Hello,

I have a question regarding uncompressed AVI files. When you export a video as uncompressed AVI, why is it that the bit rate is very large? If the original video has a certain bit rate, then why does it get increased dramatically when exporting as uncompressed AVI? This is just a general question that I'm asking out of curiosity. I do not intend to actually use this export option for any of my projects.

Comments

CubeAce wrote on 9/27/2021, 3:35 PM

@jak.willis

Hi Jak.

Because there is no compression. Each pixel will be recorded individually even if it's neighboring pixels has exactly the same 'setting'. Nothing is grouped or shared, so a frame that could have 'shared' 90% of its information with another frame will not share that information and be recorded again. That results in a huge amount of extra data being produced.

Ray.

 

Windows 10 Enterprise. Version 22H2 OS build 19045.5737

Direct X 12.1 latest hardware updates for Western Digital hard drives.

Asus ROG STRIX Z390-F Gaming motherboard Rev 1.xx with Supreme FX inboard audio using the S1220A code. Driver No 6.0.8960.1 Bios version 1401

Intel i9900K Coffee Lake 3.6 to 5.1GHz CPU with Intel UHD 630 Graphics .Driver version Graphics Driver 31.0.101.2135 for 7th-10th Gen Intel® with 64GB of 3200MHz Corsair DDR4 ram.

1000 watt EVGA modular power supply.

1 x 250GB Evo 970 NVMe: drive for C: drive backup 1 x 1TB Sabrent NVMe drive for Operating System / Programs only. 1X WD BLACK 1TB internal SATA 7,200rpm hard drives.1 for internal projects, 1 for Library clips/sounds/music/stills./backup of working projects. 1x500GB SSD current project only drive, 2x WD RED 2TB drives for latest footage storage. Total 31TB of 10 external WD drives for backup.

ASUS NVIDIA GeForce RTX 3060 12GB. nVidia Studio driver version 572.60 - 3584xCUDA cores Direct X 12.1. Memory interface 192bit Memory bandwidth 360.05GB/s 12GB of dedicated GDDR6 video memory, shared system memory 16307MB PCi Express x8 Gen3. Two Samsung 27" LED SA350 monitors with 5000000:1 contrast ratios at 60Hz.

Running MMS 2024 Suite v 23.0.1.182 (UDP3) and VPX 14 - v20.0.3.180 (UDP3)

M Audio Axiom AIR Mini MIDI keyboard Ver 5.10.0.3507

VXP 14, MMS 2024 Suite, Vegas Studio 16, Vegas Pro 18, Vegas Pro 21,Cubase 4. CS6, NX Studio, Mixcraft 9 Recording Studio. Mixcraft Pro 10 Studio. CS6 and DXO Photolab 8, OBS Studio.

Audio System 5 x matched bi-wired 150 watt Tannoy Reveal speakers plus one Tannoy 15" 250 watt sub with 5.1 class A amplifier. Tuned to room with Tannoy audio application.

Ram Acoustic Studio speakers amplified by NAD amplifier.

Rogers LS7 speakers run from Cambridge Audio P50 amplifier

Schrodinger's Backup. "The condition of any backup is unknown until a restore is attempted."

jak.willis wrote on 9/27/2021, 4:35 PM

@jak.willis

Hi Jak.

Because there is no compression. Each pixel will be recorded individually even if it's neighboring pixels has exactly the same 'setting'. Nothing is grouped or shared, so a frame that could have 'shared' 90% of its information with another frame will not share that information and be recorded again. That results in a huge amount of extra data being produced.

Ray.

Ah, I see. So it’s not like it’s un-compressing the source video and reverting it back to it’s raw form, how it was before it was compressed in-camera?

CubeAce wrote on 9/27/2021, 4:59 PM

@jak.willis

Correct. There is neither no gain or loss. Any 'lossy' compression codec means exactly that. Some information is irrecoverably lost. Even if you have a camera that records raw, if the camera is set up wrong and either over exposes or under exposes, highlight or shadow detail is still lost. Same as in a digital still raw file.

Last changed by CubeAce on 9/27/2021, 5:02 PM, changed a total of 1 times.

 

Windows 10 Enterprise. Version 22H2 OS build 19045.5737

Direct X 12.1 latest hardware updates for Western Digital hard drives.

Asus ROG STRIX Z390-F Gaming motherboard Rev 1.xx with Supreme FX inboard audio using the S1220A code. Driver No 6.0.8960.1 Bios version 1401

Intel i9900K Coffee Lake 3.6 to 5.1GHz CPU with Intel UHD 630 Graphics .Driver version Graphics Driver 31.0.101.2135 for 7th-10th Gen Intel® with 64GB of 3200MHz Corsair DDR4 ram.

1000 watt EVGA modular power supply.

1 x 250GB Evo 970 NVMe: drive for C: drive backup 1 x 1TB Sabrent NVMe drive for Operating System / Programs only. 1X WD BLACK 1TB internal SATA 7,200rpm hard drives.1 for internal projects, 1 for Library clips/sounds/music/stills./backup of working projects. 1x500GB SSD current project only drive, 2x WD RED 2TB drives for latest footage storage. Total 31TB of 10 external WD drives for backup.

ASUS NVIDIA GeForce RTX 3060 12GB. nVidia Studio driver version 572.60 - 3584xCUDA cores Direct X 12.1. Memory interface 192bit Memory bandwidth 360.05GB/s 12GB of dedicated GDDR6 video memory, shared system memory 16307MB PCi Express x8 Gen3. Two Samsung 27" LED SA350 monitors with 5000000:1 contrast ratios at 60Hz.

Running MMS 2024 Suite v 23.0.1.182 (UDP3) and VPX 14 - v20.0.3.180 (UDP3)

M Audio Axiom AIR Mini MIDI keyboard Ver 5.10.0.3507

VXP 14, MMS 2024 Suite, Vegas Studio 16, Vegas Pro 18, Vegas Pro 21,Cubase 4. CS6, NX Studio, Mixcraft 9 Recording Studio. Mixcraft Pro 10 Studio. CS6 and DXO Photolab 8, OBS Studio.

Audio System 5 x matched bi-wired 150 watt Tannoy Reveal speakers plus one Tannoy 15" 250 watt sub with 5.1 class A amplifier. Tuned to room with Tannoy audio application.

Ram Acoustic Studio speakers amplified by NAD amplifier.

Rogers LS7 speakers run from Cambridge Audio P50 amplifier

Schrodinger's Backup. "The condition of any backup is unknown until a restore is attempted."

jak.willis wrote on 9/28/2021, 7:50 AM

@jak.willis

Correct. There is neither no gain or loss. Any 'lossy' compression codec means exactly that. Some information is irrecoverably lost. Even if you have a camera that records raw, if the camera is set up wrong and either over exposes or under exposes, highlight or shadow detail is still lost. Same as in a digital still raw file.

Yeah, I see. So, in simple terms, if you decide to export your project as an uncompressed AVI file, then why is it that the data rate ends up being huge? Sorry to keep going on about this but, as you can probably tell, I am very keen to learn and understand these things.

Also, out of curiosity, I took a random 720x576 MPG file from my PC hard drive, imported it into MEP, exported a small chunk of the video as uncompressed AVI, then put the file on to a USB Flash Drive so that I could then attempt to play it on my TV & Blu-ray Player to see what happens. And what happened was it came up with "Resolution not supported" with only the audio playing - but that was stuttering. Any ideas as to why this happened?

CubeAce wrote on 9/28/2021, 8:01 AM

@jak.willis

Basically the data rate is too huge for the TVs processor to keep up with, even if it could read an AVI encoded file.

Or the usb flash drive is not fast enough which could be another reason. Last but not least, a lot of digital TVs only support a few codecs. Normally listed in their manuals.

Normal use of such an AVI file would be purely archival in nature. A base file that can be re-edited at a later stage if need be. Typically for me it would be a waist of time producing them if I had the original files.

 

Last changed by CubeAce on 9/28/2021, 8:10 AM, changed a total of 2 times.

 

Windows 10 Enterprise. Version 22H2 OS build 19045.5737

Direct X 12.1 latest hardware updates for Western Digital hard drives.

Asus ROG STRIX Z390-F Gaming motherboard Rev 1.xx with Supreme FX inboard audio using the S1220A code. Driver No 6.0.8960.1 Bios version 1401

Intel i9900K Coffee Lake 3.6 to 5.1GHz CPU with Intel UHD 630 Graphics .Driver version Graphics Driver 31.0.101.2135 for 7th-10th Gen Intel® with 64GB of 3200MHz Corsair DDR4 ram.

1000 watt EVGA modular power supply.

1 x 250GB Evo 970 NVMe: drive for C: drive backup 1 x 1TB Sabrent NVMe drive for Operating System / Programs only. 1X WD BLACK 1TB internal SATA 7,200rpm hard drives.1 for internal projects, 1 for Library clips/sounds/music/stills./backup of working projects. 1x500GB SSD current project only drive, 2x WD RED 2TB drives for latest footage storage. Total 31TB of 10 external WD drives for backup.

ASUS NVIDIA GeForce RTX 3060 12GB. nVidia Studio driver version 572.60 - 3584xCUDA cores Direct X 12.1. Memory interface 192bit Memory bandwidth 360.05GB/s 12GB of dedicated GDDR6 video memory, shared system memory 16307MB PCi Express x8 Gen3. Two Samsung 27" LED SA350 monitors with 5000000:1 contrast ratios at 60Hz.

Running MMS 2024 Suite v 23.0.1.182 (UDP3) and VPX 14 - v20.0.3.180 (UDP3)

M Audio Axiom AIR Mini MIDI keyboard Ver 5.10.0.3507

VXP 14, MMS 2024 Suite, Vegas Studio 16, Vegas Pro 18, Vegas Pro 21,Cubase 4. CS6, NX Studio, Mixcraft 9 Recording Studio. Mixcraft Pro 10 Studio. CS6 and DXO Photolab 8, OBS Studio.

Audio System 5 x matched bi-wired 150 watt Tannoy Reveal speakers plus one Tannoy 15" 250 watt sub with 5.1 class A amplifier. Tuned to room with Tannoy audio application.

Ram Acoustic Studio speakers amplified by NAD amplifier.

Rogers LS7 speakers run from Cambridge Audio P50 amplifier

Schrodinger's Backup. "The condition of any backup is unknown until a restore is attempted."

AAProds wrote on 9/28/2021, 8:36 AM

@jak.willis @CubeAce

I wouldn't be so sure about the data rate being too high. Uncompressed video does not need decoding. That is why editing it in say MEP is so easy. The program does not have to do any work to decode it, unlike an MP4, where MEP will have a much harder time decoding.

I agree with Cubace on the USB drive; it's data throughput speed is probably not enough. Put it on a portable SSD and you will have a better result. However, as CA says, I very much doubt any TV or Pluray player would even play it, as the codec wouldn't be supported.

AVI certainly has a role. For example, the best way to capture VHS (or nay analogue source) is to capture as an AVI. I will caveat this by saying we never capture "uncompressed", we capture "lossless" using a lossless codec such as Lagarith, HUFFYUV or MagicYUV. These codecs result in much smaller files (around 450mb per minute as opposed to 1gb per minute for uncompressed). Working with these lossless AVIs means you can do multiple saves and effectively, no quality is lost. I recently had a awful piece of video that I had to run through multiple programs to get it looking good, all in AVI format. You could never do that with MPEG 2 or 4 without losing quality along the way.

So, in simple terms, if you decide to export your project as an uncompressed AVI file, then why is it that the data rate ends up being huge? 

Cubeace gave you the answer above:

Because there is no compression. Each pixel will be recorded individually even if it's neighboring pixels has exactly the same 'setting'. Nothing is grouped or shared, so a frame that could have 'shared' 90% of its information with another frame will not share that information and be recorded again. That results in a huge amount of extra data being produced.

 

All my forum comments are based on or refer to my System 1.

My struggle is over! I built my (now) system 2 in 2011 when DV was king and MPEG 2 was just coming onto the scene and I needed a more powerful system to cope. Since then we've advanced to MP4 and to bigger and bigger resolutions. I was really suffering, not so much in editing (with proxies) but in encoding, which just took ages. A video, with Neat Video noise reduction applied, would encode at 12% of film speed. My new system 1 does the same job at 160% of film speed. Marvellous. I'm keeping my old system as a capture station for analogue video tapes and DV.

System 1

Windows 11 v23H2 severely modified by Openshell and ExplorerPatcher

Power supply: 850W Cooler Master (should have got modular)

CPU: Intel i7 13700K running at 3400mhz, cooled by a Kraken 2x140mm All In One liquid cooler.

RAM: 64gb (2x32gb sticks) G.Skill "Ripjaws" DDR4 3200Mhz

GPU 1: iGPU UHD 770

GPU 2: NVidia RTX 3060Ti Windforce 8gb

C drive: NVME 500gb

Bluray Burner: Pioneer BDR-212D

Various other SSD and HDDs.

Monitor: 27"/68cm Samsung, 2560 x 1440, 43 pixels/cm.

MEP 2021 version 20.0.1.80

Movie Studio 2025

Magix Video Easy version 7.0.1.145

System 2

(Still in use for TV and videotape capture)

Windows 10 v22H2

CPU: i5-750 at 2670mhz with 12gb RAM

Onboard IEEE1394 (Firewire) port

GPU: ATI Radeon HD 4770 (512mb) which is ignored by MEP

Hard drives: C Drive 256gb SSD, various other HDDs.

Monitor: Dell 22"/56cm, 1680x1050, 35 pixels/cm

MEP 2021 version 20.0.1.80

Movie Studio 2023 version 22.0.3.172

VPX 12

jak.willis wrote on 9/28/2021, 8:57 AM

@jak.willis @CubeAce

as the codec wouldn't be supported.

What codec? If it's uncompressed then it doesn't use a codec, does it?

That's why I was asking because I used to assume that if you chose to export a project as uncompressed AVI, that the original bit rate of the video file would be retained because there's no compression. A bit like how Smart Render works. So I got confused wondering why it was that the bit rate of the uncompressed file would be much larger than the source file sitting on the timeline.

 

CubeAce wrote on 9/28/2021, 9:50 AM

@AAProds

Good ol' Anna Logg.

I knew I had forgotten a good reason to have avi. In that instance it does make a lot of sense to use before the final edit.

Ray.

 

 

Windows 10 Enterprise. Version 22H2 OS build 19045.5737

Direct X 12.1 latest hardware updates for Western Digital hard drives.

Asus ROG STRIX Z390-F Gaming motherboard Rev 1.xx with Supreme FX inboard audio using the S1220A code. Driver No 6.0.8960.1 Bios version 1401

Intel i9900K Coffee Lake 3.6 to 5.1GHz CPU with Intel UHD 630 Graphics .Driver version Graphics Driver 31.0.101.2135 for 7th-10th Gen Intel® with 64GB of 3200MHz Corsair DDR4 ram.

1000 watt EVGA modular power supply.

1 x 250GB Evo 970 NVMe: drive for C: drive backup 1 x 1TB Sabrent NVMe drive for Operating System / Programs only. 1X WD BLACK 1TB internal SATA 7,200rpm hard drives.1 for internal projects, 1 for Library clips/sounds/music/stills./backup of working projects. 1x500GB SSD current project only drive, 2x WD RED 2TB drives for latest footage storage. Total 31TB of 10 external WD drives for backup.

ASUS NVIDIA GeForce RTX 3060 12GB. nVidia Studio driver version 572.60 - 3584xCUDA cores Direct X 12.1. Memory interface 192bit Memory bandwidth 360.05GB/s 12GB of dedicated GDDR6 video memory, shared system memory 16307MB PCi Express x8 Gen3. Two Samsung 27" LED SA350 monitors with 5000000:1 contrast ratios at 60Hz.

Running MMS 2024 Suite v 23.0.1.182 (UDP3) and VPX 14 - v20.0.3.180 (UDP3)

M Audio Axiom AIR Mini MIDI keyboard Ver 5.10.0.3507

VXP 14, MMS 2024 Suite, Vegas Studio 16, Vegas Pro 18, Vegas Pro 21,Cubase 4. CS6, NX Studio, Mixcraft 9 Recording Studio. Mixcraft Pro 10 Studio. CS6 and DXO Photolab 8, OBS Studio.

Audio System 5 x matched bi-wired 150 watt Tannoy Reveal speakers plus one Tannoy 15" 250 watt sub with 5.1 class A amplifier. Tuned to room with Tannoy audio application.

Ram Acoustic Studio speakers amplified by NAD amplifier.

Rogers LS7 speakers run from Cambridge Audio P50 amplifier

Schrodinger's Backup. "The condition of any backup is unknown until a restore is attempted."

AAProds wrote on 9/28/2021, 6:55 PM

@jak.willis

What codec? If it's uncompressed then it doesn't use a codec, does it?

Yes, technically you're right. My point was TVs and BD players are (I assume) not designed to play uncompressed video.

@CubeAce Anna Logg. I like it!

All my forum comments are based on or refer to my System 1.

My struggle is over! I built my (now) system 2 in 2011 when DV was king and MPEG 2 was just coming onto the scene and I needed a more powerful system to cope. Since then we've advanced to MP4 and to bigger and bigger resolutions. I was really suffering, not so much in editing (with proxies) but in encoding, which just took ages. A video, with Neat Video noise reduction applied, would encode at 12% of film speed. My new system 1 does the same job at 160% of film speed. Marvellous. I'm keeping my old system as a capture station for analogue video tapes and DV.

System 1

Windows 11 v23H2 severely modified by Openshell and ExplorerPatcher

Power supply: 850W Cooler Master (should have got modular)

CPU: Intel i7 13700K running at 3400mhz, cooled by a Kraken 2x140mm All In One liquid cooler.

RAM: 64gb (2x32gb sticks) G.Skill "Ripjaws" DDR4 3200Mhz

GPU 1: iGPU UHD 770

GPU 2: NVidia RTX 3060Ti Windforce 8gb

C drive: NVME 500gb

Bluray Burner: Pioneer BDR-212D

Various other SSD and HDDs.

Monitor: 27"/68cm Samsung, 2560 x 1440, 43 pixels/cm.

MEP 2021 version 20.0.1.80

Movie Studio 2025

Magix Video Easy version 7.0.1.145

System 2

(Still in use for TV and videotape capture)

Windows 10 v22H2

CPU: i5-750 at 2670mhz with 12gb RAM

Onboard IEEE1394 (Firewire) port

GPU: ATI Radeon HD 4770 (512mb) which is ignored by MEP

Hard drives: C Drive 256gb SSD, various other HDDs.

Monitor: Dell 22"/56cm, 1680x1050, 35 pixels/cm

MEP 2021 version 20.0.1.80

Movie Studio 2023 version 22.0.3.172

VPX 12

CubeAce wrote on 9/29/2021, 1:29 AM

@jak.willis

Any 'codec' is an instruction set that tells the computer how to construct the data into a file that can be read by another program. In this case to show a video. Compression or not does not come into the equation. It is still an encoding of another file or in AAProds case the digitized signal he gets from the convertor he uses to capture the analog signal from his VHS tapes.

[Edit] The file will still need to contain frame rate information, picture size, audio sampling rates, type of audio codec used, etc.

Ray.

Last changed by CubeAce on 9/29/2021, 2:16 AM, changed a total of 3 times.

 

Windows 10 Enterprise. Version 22H2 OS build 19045.5737

Direct X 12.1 latest hardware updates for Western Digital hard drives.

Asus ROG STRIX Z390-F Gaming motherboard Rev 1.xx with Supreme FX inboard audio using the S1220A code. Driver No 6.0.8960.1 Bios version 1401

Intel i9900K Coffee Lake 3.6 to 5.1GHz CPU with Intel UHD 630 Graphics .Driver version Graphics Driver 31.0.101.2135 for 7th-10th Gen Intel® with 64GB of 3200MHz Corsair DDR4 ram.

1000 watt EVGA modular power supply.

1 x 250GB Evo 970 NVMe: drive for C: drive backup 1 x 1TB Sabrent NVMe drive for Operating System / Programs only. 1X WD BLACK 1TB internal SATA 7,200rpm hard drives.1 for internal projects, 1 for Library clips/sounds/music/stills./backup of working projects. 1x500GB SSD current project only drive, 2x WD RED 2TB drives for latest footage storage. Total 31TB of 10 external WD drives for backup.

ASUS NVIDIA GeForce RTX 3060 12GB. nVidia Studio driver version 572.60 - 3584xCUDA cores Direct X 12.1. Memory interface 192bit Memory bandwidth 360.05GB/s 12GB of dedicated GDDR6 video memory, shared system memory 16307MB PCi Express x8 Gen3. Two Samsung 27" LED SA350 monitors with 5000000:1 contrast ratios at 60Hz.

Running MMS 2024 Suite v 23.0.1.182 (UDP3) and VPX 14 - v20.0.3.180 (UDP3)

M Audio Axiom AIR Mini MIDI keyboard Ver 5.10.0.3507

VXP 14, MMS 2024 Suite, Vegas Studio 16, Vegas Pro 18, Vegas Pro 21,Cubase 4. CS6, NX Studio, Mixcraft 9 Recording Studio. Mixcraft Pro 10 Studio. CS6 and DXO Photolab 8, OBS Studio.

Audio System 5 x matched bi-wired 150 watt Tannoy Reveal speakers plus one Tannoy 15" 250 watt sub with 5.1 class A amplifier. Tuned to room with Tannoy audio application.

Ram Acoustic Studio speakers amplified by NAD amplifier.

Rogers LS7 speakers run from Cambridge Audio P50 amplifier

Schrodinger's Backup. "The condition of any backup is unknown until a restore is attempted."

jak.willis wrote on 9/29/2021, 8:00 AM

@jak.willis

What codec? If it's uncompressed then it doesn't use a codec, does it?

Yes, technically you're right. My point was TVs and BD players are (I assume) not designed to play uncompressed video.

@CubeAce Anna Logg. I like it!

Yeah, I believe you’re right there. When I’ve tried playing uncompressed videos on my Blu-ray Player in the past, either they wouldn’t play at all, or they would play but would be all stuttery. Most probably due to the player being unable to cope with the amount of data coming at it.