•      
  • Garbage Burrito!An online internet web blog by Ben Kittrell
  • Blog
  • Tweets
  • Contact
  • Photos
  • Favorite Burrito
  • Burrito Shop
  • Cart
  • Login
  •      
 View Cart Login        

Garbage Burrito!

An online internet web blog by Ben Kittrell

  • Blog
  • Tweets
  • Contact
  • Photos
  • Favorite Burrito
  • Burrito Shop

 About Ben

Co-Founder of Doodlekit. Coder, Home Renovator, Enjoyer of Refreshing Beverages.

Sometimes I blog here, sometimes on Doodlekit, sometimes I tweet and now I podcast.

Most recently I've been doing software development strategy consulting for Kansas City businesses.  

 Doodlekit

Doodlekit is the easiest way for small businesses to create their own website.  Used by millions in over 180 countries.

Follow us for updates.

Doodlekit on Twitter
AngelList
LinkedIn
Facebook

160x600.gif

free website builder

 

 Blog Entries

  • Great Review of Doodlekit by Comparakeet
  • New Podcast Episode - Danny O'Neill - The Roasterie - Spare Room Radio
  • What I Wish Someone Told Me Before I Started Buying Podcast Equipment
  • Announcing Spare Room Radio - New Podcast
  • Google Fiber Experiment: Cloud Video Transcoding
more  

 Links


  • website reviewer
  • live on - sharing memories
  • kids website builder
  • resume website
  • martial arts website builder
  • affiliate website builder
  • teacher website

 Login

 Forgot Password?

 Forum Posts

  • rajablogid: RE: Stupid Simple, Yet Effective
  • julie mack: RE: JavaScripting with PDF's?
  • Megan Cunningham: RE: Java Generics
  • Deepika Sharma: RE: Grilled Cheese
  • German Byrd: RE: Grilled Cheese
more  

 Custom Login

 Forgot Password?
 Register

 Back to Blog

Google Fiber Experiment: Cloud Video Transcoding

Ben Kittrell
 06/11/2013 04:58PM

Screen_Shot_2013-06-11_at_8.47.06_AM.pngProblem: Need to convert all 195 episodes of Mystery Science Theater 3000 from Xvid to MPEG.  Other attempts to use Handbrake or ffmpeg were only partially successful due to the large amount of time required for encoding.  Each episode can take up to 50 minutes to transcode.  Transcoding at 24 hours a day that would take 6.7 days.  Also, Handbrake is unreliable at this volume.

Hypothesis: With Google Fiber, transferring a file to the cloud is just as fast as across an internal network.  Therefore it is feasible to move 80gb of data to the cloud for encoding which will greatly decrease the overall encoding time.

 

Solution: Write a script to automatically upload a directory of videos to the cloud, and use a transcoding service to convert them.

 

I first planned on using ZenCoder, since I had used them in the past and was happy with their service.  However since this is about 25k minutes worth of video and ZenCoder starts at $0.05/minute, I shopped around and found out that Amazon's Elastic Transcoder was only $0.015.  ZenCoder still has merits over Elastic Transcoder that make it worth the price, but not in this case.

 

Here's the Ruby script.

 

 

It basically uploads the files to an s3 bucket, starts a transcoding job, and waits for it to finish.  I had it setup to automatically download the file, but decided it would be just as easy to use an FTP App to download them all when it was done.

 

The core benefit of this solution is not just the increased transcoding speed, but the parallelism.  Elastic Transcoder will convert 4-5 videos simultaneously in one queue.

 

Results: I was able to transcode 11 seasons of MST3K, which is 417 hours of video, in 15 hours.  That includes upload and download times.  That's about 11x faster than the local transcoding estimate.

 

Conclusion: With gigabit internet, cloud services like video transcoding become more valuable to home users.  While it's certainly not free, services like Amazon allow anyone to start at the same price point large companies enjoy.  Not to mention the prices will continue to drop.  Of course not everyone wants to write a script to do this, but that's were developers can step in and create software to help the everyday user enjoy the true benefits of the cloud. 

Tags: google fiber, elastic transcoder, zencoder, video

 Comments

 David Bennett  06/19/2013 11:31PM 

You could also try encoding yourself with NVENC under MediaCoder. With an Nvidia Tesla or high end GPU you can encode video much faster than using a traditional CPU (computation performance is not even close). If you have the CUDA Toolkit you easily create a system to distribute encoding across multiple GPU's.

 squarefood.org My Website  02/10/2015 01:05PM 

A good informative post that you have shared and appreciate your work for sharing the information.

 Juli  02/19/2015 01:43PM 

The problem usually is very closed to nobody trust the people around them.
http://www.weddingsamui.org

 juliwilson My Website  02/20/2015 07:49AM 

Thanks you for another great article. Where else could anyone get that kind of information in such a perfect way of writing? I have a presentation next week, and I am on the look for such information.
http://www.mindsehealth.com

 Nancy  03/03/2015 06:49AM 

It was wondering if I could use this write-up on my other website, I will link it back to your website though.Great Thanks.
www.autoproj.org

 Amy  03/06/2015 10:38AM 

Thank you for another fantastic posting. Where else could anyone get that kind of information in such a perfect way of writing? I have a speech next week, and I was looking for more info ;)
http://www.jerryallentraveljets.com

  03/24/2015 12:32PM 

Web sites can be the function associated with an specific, a profitable business as well as various other firm, and are also generally specialized in a certain theme as well as goal.
http://www.webryzeseoservices.ca

 studio dentistico roma  04/01/2015 07:03AM 

Lo studio Dentistico Roma Dottori Damis Resta Rossi Iommetti è situato nell'elegante quartiere Prati di Roma ed opera nel settore odontoiatrico dal 2005. <b><a href="http://www.studiodentistico.roma.rm.it/">Studio Dentistico Roma</a></b>

 Amy  04/01/2015 12:44PM 

I'm impressed, I must say. Very rarely do I come across a blog that's both informative and entertaining, and let me tell you, you've hit the nail on the head. Your blog is important; the issue is something that not enough people are talking intelligently about.
http://www.sustainablenorfolk.co.uk

 Jas Saran  04/15/2015 03:56PM 

Google fiber indeed an awesome service launched by Google. Hope this service will be available in other countries too..

 Wandy My Website  04/19/2015 05:28PM 

That's a nice tip. Thank you ruby! And don't forget some great staff here <a href="http://www.bestsessays.biz/">professayservice </a>.

 Nimi  05/18/2015 09:23AM 

Interesting info, do you know where I can find similar information?
http://www.bearcrawlingnation.com

 Emma  05/18/2015 10:28AM 

copy so vibrant and I’m sure you’re going to go a long way ahead. Hope to read more such attention-grabbing blog postings.
http://www.fake2013oakleysunglasses.com

 Amy  05/19/2015 10:03AM 

From your blog it seems that you are en expert of writing article. Your contents are amazing and facts are true. I agree to all of your points that you have mentioned.
http://www.aauw-daw.org

 El Arte de Perder (2015) My Website  08/29/2015 12:02AM 

El Arte de Perder (2015) http://hd-peliculas.net/drama/6421-el-arte-de-perder-2015.html

  09/11/2015 09:54AM 

I hope everything is clear to all the users of this www.delegate-your-assignment.com blog provided services. The info is really informative and friendly tips given for the students.

 sabir  01/26/2016 01:19PM 

if you want to get facebook hack it is available at http://fbaccountrecoverer.com ,visit us and get them

 Mary My Website  01/26/2016 07:03PM 

If you don't have the writing service to order the resume from and don't know where to find it, you should check this one: http://topresumewriting.blogspot.com/. These guys are the best in this business and no one will do it better than they.

 gism  03/15/2016 09:34AM 

it is nice post for more android apps visit https://appspcdownloadhere.wordpress.com/
https://appspcdownloadhere.wordpress.com/2015/12/01/how-to-run-android-apps-forpc/
https://appspcdownloadhere.wordpress.com/2015/12/01/best-downloadervidmate-apptubemate-app-for-pc/
https://appspcdownloadhere.wordpress.com/2015/12/01/best-chatting-apps-for-pc/

 professional resume services online  03/30/2016 04:39PM 

In case you need a good resume and have no writing skills to do it on your own, you should definitely refer to the specialist to write it for you. But first of all I would recommend you to apply to the resume writing sites that post reviews about the writing companies

 Smantha  05/06/2016 10:45AM 

This is a great news which is about Google Fiber Experiment. I think google is doing a great work on technology and they are using the technology in right ways. With Google Fiber, transferring a file to the cloud is just as fast as across an internal network.
Get Coir Matting from http://coirmattinguk.co.uk/coir-matting.html

 credit reports from all three bureaus free My Website  05/21/2016 09:23AM 

Very useful post. This is my first time i visit here. I found so many interesting stuff in your blog especially its discussion. Really its great article. Keep it up

 aadhar card My Website  11/17/2016 01:43PM 

List of document for address proof, list Of documents for proof of relationship and other problem related to aadhar card. you can find all information here.

 www.assignment-help-sydney.com My Website  12/05/2016 08:33PM 

Debbie is right, me too. I like watching others do the hula hooping and i'm a bit envious with them. It's too easy for them to do it unlike me the hula hoop can't even stay 10 seconds in my waist.. haha funny but true.

 chiru150  12/06/2016 06:38AM 

The Entertainment magazines “The Film fare”, “ India Today ‘’ named him “Bigger than Amitabh Bachchan and since waiting, 9 years of gap when there was the news for release for the 150th movie ,his Fans all over the world were eagerly waiting for the movie details and with the first glimpse of the name given as “ KHAIDI NO. 150” in contrarily with his old movie “KHAIDI”
<a href="http://www.khaidino150movie.com/khaidi-no-150-songs-download/">khaidi no 150 movie review</a>

 Sissy Slut My Website  12/06/2016 09:33AM 

You could also try encoding yourself with NVENC under MediaCoder. With an Nvidia Tesla or high end GPU you can encode video much faster than using a traditional CPU (computation performance is not even close). If you have the CUDA Toolkit you easily create a system to distribute encoding across multiple GPU's.

 Bob My Website  12/10/2016 07:58PM 

Not so bad...
https://about.me/smartmil888

 <a href="https://vidmateapk.online/">Vidmate APK for Android</a> My Website  12/13/2016 08:48AM 

Vidmate Apk app video downloader for android mobile. Easily download youtube videos, movies, mp3 songs and etc to your andriod mobile.

 vidmate app download My Website  12/13/2016 08:49AM 

Vidmate Apk app video downloader for android mobile. Easily download youtube videos, movies, mp3 songs and etc to your andriod mobile.

 Redmi note 5 features My Website  12/13/2016 11:07AM 

It has a skin for its Android Phones and tablets

 Luca Roger  01/30/2017 10:53AM 

I was reading your article and wondered if you had considered creating an ebook on this subject. Your writing would sell it fast. You have a lot of writing talent.
http://apkhook.com/tutuapp-pokemon-go-tutuapp-apk/
http://apkhook.com/icq-chat-and-video-calls-messenger/
http://apkhook.com/vshare-market-apk-download-android-ios/

 sio  01/31/2017 10:40AM 

The core benefit of this solution is not just the increased transcoding speed, but the parallelism. Elastic Transcoder will convert 4-5 videos simultaneously in one queue.
http://www.smartdatacollective.com/user/1837667

 clash royale My Website  02/02/2017 03:05PM 

Game where the gems are so important.

 Obat Kanker Testis Tanpa Operasi My Website  02/11/2017 06:55AM 

Health Information
http://umarblogherbal.com/cara-membersihkan-endapan-dalam-usus/
http://www.ahlinyaterapikanker.com/cara-mengobati-kanker-testis-secara-alami-tanpa-operasi/
http://lecithinsoftgelgreenworld.blogspot.com/2015/05/cara-mengatasi-dan-mengobati-penyakit.html
http://www.obatasamuratalami.net/tips-yang-perlu-anda-lakukan-untuk-mengatasi-luka-bernanah/
http://caramengobatisegalamacampenyakit.blogspot.com/2017/02/cara-menyembuhkan-infeksi-tulang-yg.html

 sara My Website  02/25/2017 11:04PM 

Great post and thanks for sharing.

 iPad Pro 2 Features My Website  02/27/2017 10:20AM 

The upcoming iPad Pro 2 is definitely going to sport a first-rate outlook as it is expected to come up with a metal unibody chassis. http://ipadpro2s.com/

 akshay  03/23/2017 12:14PM 

http://jeeanswerkey.weebly.com/

  03/30/2017 05:13PM 

The GT made a name for itself in the 1960s, and the nameplate returned to Ford for the 2005 and 2006 models. Since then, the vehicle has truly evolved into a supercar, evident by it’s $100,000+ price tag.
The company has made some changes to the third-generation GT, prioritizing handling and track capabilities in their 2017 model. The result? Not only one of Ford’s most impressive cars ever, but perhaps one of the most innovative cars to ever be released.
For more information about the 2017 Ford GT checkout http://2017fordgtcar.com/2017-ford-gt-release-date/

 bradley  04/01/2017 09:01AM 

The company has made some changes to the third-generation GT, prioritizing handling and track capabilities in their 2017 model.http://www.abcmoney.co.uk

 Rokki My Website  04/02/2017 02:46PM 

Totally, the actual write-up is really the very best in that will worthwhile matter. I really fit in jointly http://aussiessayreviews.com/ with your results and certainly am going to keenly seem to be toward your own upcoming improvements. Just telling many thanks could not only be sufficient, for your exceptional readability as part of your composing.I'll use this information to provide term papers for my friends.

 Write Cheap Essay My Website  04/12/2017 04:07PM 

Probably not much, the people who contact them to get Google Fiber have probably mostly made their minds up to buy the product already, and most of the selling involved is through indirect marketing and advertising, I doubt that they would cold call people to sell them the product. They would need people who are good at customer service and are good on the phone, but there is no shortage of people like that so they wouldn't need to pay any more than any other telephone customer service job.

 rajeev23 My Website  04/23/2017 06:49PM 

Thank you for another great article. Where else could anyone get that kind of information

https://awalmartone.com/walmartone-associate-login-www-walmartone-com/

 NBA 2K18 Release Date My Website  04/24/2017 12:50PM 

Are you waiting for upcoming NBA 2K18 video game? This is the really great game with new design and technology.

 Galaxy Note 8 My Website  04/25/2017 10:40AM 

After the debacle of the Note 7 last year, Samsung is eager to regain the reputation of this coveted series by the upcoming Samsung Note 8. With an improved battery and better specs, Note 8 is going to be a beast of a device. Want to know more about Note 8? Check this website.

 PPSSPP Gold for PC My Website  04/29/2017 11:42AM 

https://ppssppgoldapks.com/

 faraday jhon  05/09/2017 12:20PM 

What a nice post is it. I really impressed to read the great information that you have shared with us through content of the post. Keep doing the great work up. http://callfloridaplumber.com/miami-florida-plumbers/ is the best place for plumbing services.

 Pregnancy Insider My Website  05/11/2017 07:13AM 

https://pregnancyinsider.org/

 samir satarke My Website  05/14/2017 05:11PM 

http://techios.org/

 Jack  06/20/2017 09:55AM 

A very useful post from which you made very easy to find solution of problem with Hypothesis, results & conclusion on Cloud Video Transcoding. This Ruby script will helpful to students who are learning such thinks and also taking academic writing services from the Quality Dissertation – http://www.qualitydissertation.co.uk where academic writers are providing non-plagiarised, fully referenced dissertation writing help. And they would love to know that by using gigabit internet, cloud services alike video transcoding become more appreciated to home users.

 instagram video downloader My Website  06/27/2017 11:08AM 

Thanks for providing us this great knowledge, i think i need this. Keep it up.

 Previous 1 2 3 4 Next 

 Search

Follow On...

  • Facebook
  • Twitter
  • LinkedIn
  • Google+
  • Pinterest
  • RSS Feeds
  • Blog Posts,
  • Gallery Images,
  • Forum Topics

Copyright © 2006 Garbage Burrito. All Rights Reserved.
hosted by doodlekit™- free website builder

 

 powered by Doodlekit™ Free Website Builder