image
 

Dup Scrubber
Currently, user generated content sites that host video are burdened by the significant extra cost to store and manage multiple duplicates of the same video on their servers.

Vercury's Dup Scrubber™ enables the UGC site to detect and purge unnecessary duplicates from its servers, and eliminate these extra costs.

It does not matter whether a duplicate has a different name, file size, resolution, aspect ratio, bit rate, bit order, frame rate, or format (codec). Dup Scrubber™ also identifies duplicates that are mostly the same (for example, two copies that are identical except one has an ad at the beginning or end).

When a video is loaded, Dup Scrubber™ identifies the video and within a fraction of a second compares the new video against a master index to determine whether it is a duplicate. If the new video is already on the server, Dup Scrubber™ notifies the content provider. If the new video is not already on the server, Dup Scrubber™ adds it to the index. If the new video is a higher quality video, Dup Scrubber™ can be configured to update the index with the new, higher quality video.

For example, a search on YouTube often results in many unnecessary duplicates:

The cost to store a video at the current $0.50/gigabyte depends on the quality of video:
Video QualityBit Rate (kbps) Pixel Resolution (W x H)Frame Rate (fps) Megabytes of Storage per Minute of Video Storage Cost per Minute of Video
High 900 480 X 360 30 7 0.35 ¢
Medium 600 320 X 240 15 5 0.25 ¢
Low 400 240 X 200 10 3 0.15 ¢

The typical online video is about 4 minutes long, 320 X 240 pixel resolution, 30 frames per second, and 400 kilobits per second. The cost to store the typical video is 0.15 ¢ / video minute, or 0.6 ¢ / video (plus power, A/C, space and human costs).

Lets say a UGC site has over 100 million videos, adding 100,000 videos every day, on each of its 25 server locations (points).

If 30% of the videos are duplicates, with Dup Scrubber™, the UGC site could save $4.5 million if it scrubbed existing duplicates off of its servers, and $4,500 / day if it prevented duplicates from being loaded each day. Heres the math:

If the UGC site scrubbed existing duplicates off its system, it would save:

  • 100 million videos x 30% x 0.6 ¢ / video = $180,000 / point
  • $180,000 / point X 25 points = $4.5 million total
Daily savings:
  • 100,000 videos x 30% x 0.6 ¢/ video = $180 / day X 25 points = $4,500 / day ($1,642,500 / year) X 25 = $4,500 / day ($1,642,500 / year)

In addition, there are environmental costs to store, maintain and manage multiple copies of a video, such as power, A/C, space and human costs.

And, as bandwidth connections and video quality improve, the costs savings will grow even greater. With HD and DVD quality (video on demand), the cost of storage 2- 10 times greater:

Video QualityBit Rate (kbps) Pixel Resolution (W x H)Frame Rate (fps) Megabytes of Storage per Minute of Video Storage Cost per Minute of Video
HD 1080p 8000 1920 X 1080 30 63 2.7 ¢
HD 720p 3500 1280 X 720 30 28 1.2 ¢
DVD 480p 1400 720 X 480 30 11 0.5 ¢

Dup Scrubber™ is turn-key, production ready software available today that takes less than an hour to install and begin using, and requires very low maintenance.

More Information

If you would like to learn more about Vercurys Dup Scrubber™ technology, please see a presentation here

Please also visit our FAQ page for DupScrubber™





 
image