Smart Chunking – Bitmovin https://bitmovin.com Bitmovin provides adaptive streaming infrastructure for video publishers and integrators. Fastest cloud encoding and HTML5 Player. Play Video Anywhere. Wed, 13 Mar 2024 17:31:54 +0000 en-GB hourly 1 https://bitmovin.com/wp-content/uploads/2023/11/bitmovin_favicon.svg Smart Chunking – Bitmovin https://bitmovin.com 32 32 Split-and-Stitch Encoding with incredible speed, quality and scale https://bitmovin.com/blog/split-and-stitch-encoding/ https://bitmovin.com/blog/split-and-stitch-encoding/#respond Wed, 13 Mar 2024 17:09:44 +0000 https://bitmovin.com/?p=277993 Introduction In the early days of digital video, encoding a full-length movie could take several hours or even days to complete, depending on the settings and techniques that were used. Over time, as processor speeds increased and specialized hardware was introduced, encoding turnaround times decreased, but it was usually an incremental, linear response to the...

The post Split-and-Stitch Encoding with incredible speed, quality and scale appeared first on Bitmovin.

]]>
Introduction

In the early days of digital video, encoding a full-length movie could take several hours or even days to complete, depending on the settings and techniques that were used. Over time, as processor speeds increased and specialized hardware was introduced, encoding turnaround times decreased, but it was usually an incremental, linear response to the advancements in technology. Once cloud computing resources became readily available and opened new possibilities, cloud-native encoding services like Bitmovin disrupted the status quo with massive gains for encoding speed and turnaround times. This potential was unlocked by developing an innovative new technique known as split-and-stitch encoding. 

What is split-and-stitch encoding? 

As the name suggests, split-and-stitch encoding is a method of encoding that involves splitting a file into smaller chunks, encoding those chunks separately, and then stitching them back together. These smaller chunks being encoded in parallel with separate cloud computing resources led to huge leaps in shortening turnaround times. Prior to that, digital videos were processed linearly, which was an unnecessary limitation carried over from film and tape processing workflows, where the physical medium was actually a limiting factor.  

Bitmovin's split-and-stitch encoding process

How fast is split-and-stitch encoding?

Back in 2015 when Bitmovin first implemented our encoder on the Google Compute Engine (now Google Cloud Platform) we were able to achieve encoding speeds of 66x real-time running in their cloud, as mentioned here. With some further optimization, we became the first to reach 100x real-time encoding speeds. 

The actual turn-around times for your encoding jobs will depend on a lot of factors including source format, codec(s), resolution, duration and advanced features like Dolby Vision, but even with very complex 4K HDR workflows, your encodes will run faster than real-time using split and stitch. Below is a real-world example of an H.264/AAC encoding that ran faster than 92x real-time.

screenshot of bitmovin dashboard showing a Split-and-stitch encoding job ran 92.38 times faster than real-time

Running split-and-stitch encoding in the cloud means your individual encoding jobs run faster than real-time, but it also means that you can scale to run many jobs in parallel which allows large backlogs to be cleared in hours instead of weeks. You also have the capacity to handle spikes of content with no impact on queue time.

What are the advantages of Bitmovin’s split-and-stitch encoding?

Bitmovin has over a decade of experience developing and refining our split-and-stitch implementation. We built our system to take advantage of spot and preemptible instances to keep costs down, while surpassing the quality of single instance encodes with innovations like 3-pass encoding and Smart Chunking.  Our intelligent workload orchestration allows you to manage priority and resource scheduling with capacity for thousands of jobs per hour.

Bitmovin also supports using multiple codecs and packaging formats together with split-and-stitch, including H.264 (AVC), H265 (HEVC), VP9 and AV1 with both HLS and DASH, where other platforms may be limited to H.264 and HLS. We’ve also implemented fast decode enhancements for large J2K and ProRes mezzanine source files that reduce the overall turnaround time even further. 

What is Smart Chunking?

In 2023, Bitmovin made some key changes and updates to our VOD Encoder with a new feature called Smart Chunking. This further increased the potential visual quality and turnaround times that were possible with split and stitch by decoupling the split-and-stitch chunk duration from the user-defined segment duration. This allows for variable chunk size depending on the type of codec and the complexity of encoding, enabling many immediate improvements and future optimizations. Using Smart Chunking means we can segment chunks at the optimal points with better bitrate distribution, providing more consistent quality without any noticeable dips. 


In the graph below, you can see a comparison of an encoding job run with and without Smart Chunking. While the overall quality is similar, in the blue version (without Smart Chunking) there are several lower quality outlier frames. By using Smart Chunking (orange version) the lowest 1% of frames in terms of quality were improved by an average of 6 VMAF points, which is a noticeable difference. The lowest 0.1% improved by 22 VMAF points and the single worst frame gained a massive 60 VMAF points.

- Bitmovin

Is split-and-stitch always the best approach? 

The steps of analyzing, splitting and reassembling chunks of video do add some overhead processing time to the encoding process. For longer episodic content or movies, the added time is negligible compared to the time saved by using split-and-stitch. But, for shorter videos like ads and news clips that are time-sensitive, the pre-processing can make using split-and-stitch less advantageous. 

For these cases, Bitmovin has 2 solutions. First, we’ve added support for hardware encoding with Nvidia T4 GPUs. They can deliver the same quality of video encoding, up to four times faster than CPUs, with H.264 (AVC) and H.265 (HEVC) codec support. We also have a new “accelerated mode” that uses pre-warmed cloud compute resources, so you no longer have to wait for new instances to be started. This has made a huge impact on overall encoding job turnaround time, lowering queuing times from minutes to <10 seconds.

Ready to get started with split-and-stitch encoding?

Bitmovin’s split-and-stitch encoding with Smart Chunking is enabled by default and doesn’t require any special configuration. You can get started quickly with our dashboard encoding wizard without any coding required. Get going today with our free trial and see the results for yourself by clicking here!

The post Split-and-Stitch Encoding with incredible speed, quality and scale appeared first on Bitmovin.

]]>
https://bitmovin.com/blog/split-and-stitch-encoding/feed/ 0
Bitmovin’s Smart Chunking: the evolution of the split and stitch algorithm https://bitmovin.com/blog/smart-chunking-encoding/ https://bitmovin.com/blog/smart-chunking-encoding/#comments Thu, 02 Mar 2023 13:23:19 +0000 https://bitmovin.com/?p=253405 Speed, quality and scale are always top of mind when it comes to providing the highest quality  of viewing experiences. In this blog, we are joined by Markus Hafellner (Senior Product Manager, VOD Encoding), who takes us through a key update to the Bitmovin Next-Generation VOD Encoder and advancements made to the split and stitch algorithm allowing users to enjoy content at the highest possible quality.

The post Bitmovin’s Smart Chunking: the evolution of the split and stitch algorithm appeared first on Bitmovin.

]]>

Speed, quality and scale are always top of mind when it comes to providing the highest quality of viewing experiences. In this blog, we are joined by Markus Hafellner (Senior Product Manager, VOD Encoding), who takes us through a key update to the Bitmovin Next-Generation VOD Encoder and advancements made to the split and stitch algorithm allowing users to enjoy content at the highest possible quality.

Q:  Markus, thanks for joining us today. To start with, can you go into detail what our Smart Chunking functionality enables?

A:  To start with, we have made changes and key updates to our VOD Encoder with Smart Chunking to further increase the quality and turnaround times with split and stitch. We have decoupled the chunk duration which allows for variable chunk size depending on the type of codec and the complexity of encoding allowing many immediate improvements and future optimizations.

Q:  What were the reasons for creating this?

A:  A key driver for us was to deliver improvements to our customers without the need to change their workflow. A lot of really beneficial changes require workflow changes, which are costly and need dedicated efforts..We looked to answer the question “how do we improve quality and ideally speed and have as few tradeoffs as possible?” And this is something we’re very happy with. 

For context, if you process an entire file on a single machine you will encode in the best possible quality but the downside is, it will be incredibly slow. Especially for codecs like HEVC or AV1. By using split and stitch you see the benefit of splitting the job into multiple parallel encodings but you also face the general challenge that segmented encoding faces when it comes to fixed GOP and segment sizes. Smart Chunking addresses this issue by making optimizations to chunk lengths and bitrate distribution which has an overall positive impact on the visual quality throughout the whole asset and achieving this at an even faster pace than before. 

Q:  As of today, how do Bitmovin customers get access to the Smart Chunking functionality?

A:  The great news is that everyone benefits from this immediately if you are using the most up to date encoder version (which is automatically the case for all encodings created in our dashboard). It is also worth mentioning that there are no additional costs to this. You can regard this as Bitmovin setting a new standard. Whether you’re working at a big broadcaster or a smaller sized company, the benefits of our Smart Chunking is going to be felt by all who are making use of our VOD Encoding product. 

Q:  Can you give us a more detailed example of this in action?

A:  Sure. This is where it gets a bit technical. Video quality is nowadays often measured with VMAF. An objective quality metric created by Netflix and widely used in the video industry to compare quality. We created a comparison of a highly complex asset processed with the standard split and stitch approach vs the new Smart Chunking. The key numbers you can see are the lowest 1% frames are increased by 6 VMAF points (6 VMAF is exactly the noticeable difference for the human eye). The lowest 0.1% frames are increased by an impressive 22 VMAF points and the worst frame sees an increase of a ridiculous 60 VMAF points.

- Bitmovin

Now this is to say that what you see on the left is already what has won bake offs against any competition and has beaten several benchmarks. This goes to show just how much our customers gain from using the Bitmovin Encoder over in-house developments or competing encoders.

Not all assets will see exactly results as above, but it showcases the capabilities of Smart Chunking.

Q:  What is the next evolution of this? And what can Bitmovin users/customers think about after feeling the impact of our Smart Chunking?

A:  This announcement can very much be seen as a key step towards making Per-Shot Encoding available to all. This is something we are very excited about working towards. The upcoming launch of our Per-Shot Encoding capability will enable you to divide the video file into shots with variable duration. Each shot can then be further optimized which is another major step to driving highly optimized bitrates and flawless quality. 

Give it a try today by clicking here!

The post Bitmovin’s Smart Chunking: the evolution of the split and stitch algorithm appeared first on Bitmovin.

]]>
https://bitmovin.com/blog/smart-chunking-encoding/feed/ 3