Google Fiber Experiment: Cloud Video Transcoding
Ben Kittrell
06/11/2013 04:58PM
Problem: Need to convert all 195 episodes of Mystery Science Theater 3000 from Xvid to MPEG. Other attempts to use Handbrake or ffmpeg were only partially successful due to the large amount of time required for encoding. Each episode can take up to 50 minutes to transcode. Transcoding at 24 hours a day that would take 6.7 days. Also, Handbrake is unreliable at this volume.
Hypothesis: With Google Fiber, transferring a file to the cloud is just as fast as across an internal network. Therefore it is feasible to move 80gb of data to the cloud for encoding which will greatly decrease the overall encoding time.
Solution: Write a script to automatically upload a directory of videos to the cloud, and use a transcoding service to convert them.
I first planned on using ZenCoder, since I had used them in the past and was happy with their service. However since this is about 25k minutes worth of video and ZenCoder starts at $0.05/minute, I shopped around and found out that Amazon's Elastic Transcoder was only $0.015. ZenCoder still has merits over Elastic Transcoder that make it worth the price, but not in this case.
Here's the Ruby script.
It basically uploads the files to an s3 bucket, starts a transcoding job, and waits for it to finish. I had it setup to automatically download the file, but decided it would be just as easy to use an FTP App to download them all when it was done.
The core benefit of this solution is not just the increased transcoding speed, but the parallelism. Elastic Transcoder will convert 4-5 videos simultaneously in one queue.
Results: I was able to transcode 11 seasons of MST3K, which is 417 hours of video, in 15 hours. That includes upload and download times. That's about 11x faster than the local transcoding estimate.
Conclusion: With gigabit internet, cloud services like video transcoding become more valuable to home users. While it's certainly not free, services like Amazon allow anyone to start at the same price point large companies enjoy. Not to mention the prices will continue to drop. Of course not everyone wants to write a script to do this, but that's were developers can step in and create software to help the everyday user enjoy the true benefits of the cloud.
Comments
You could also try encoding yourself with NVENC under MediaCoder. With an Nvidia Tesla or high end GPU you can encode video much faster than using a traditional CPU (computation performance is not even close). If you have the CUDA Toolkit you easily create a system to distribute encoding across multiple GPU's.
A good informative post that you have shared and appreciate your work for sharing the information.
The problem usually is very closed to nobody trust the people around them.
http://www.weddingsamui.org
Thanks you for another great article. Where else could anyone get that kind of information in such a perfect way of writing? I have a presentation next week, and I am on the look for such information.
http://www.mindsehealth.com
It was wondering if I could use this write-up on my other website, I will link it back to your website though.Great Thanks.
www.autoproj.org
Thank you for another fantastic posting. Where else could anyone get that kind of information in such a perfect way of writing? I have a speech next week, and I was looking for more info ;)
http://www.jerryallentraveljets.com
Web sites can be the function associated with an specific, a profitable business as well as various other firm, and are also generally specialized in a certain theme as well as goal.
http://www.webryzeseoservices.ca
Lo studio Dentistico Roma Dottori Damis Resta Rossi Iommetti è situato nell'elegante quartiere Prati di Roma ed opera nel settore odontoiatrico dal 2005. <b><a href="http://www.studiodentistico.roma.rm.it/">Studio Dentistico Roma</a></b>
I'm impressed, I must say. Very rarely do I come across a blog that's both informative and entertaining, and let me tell you, you've hit the nail on the head. Your blog is important; the issue is something that not enough people are talking intelligently about.
http://www.sustainablenorfolk.co.uk
Google fiber indeed an awesome service launched by Google. Hope this service will be available in other countries too..
That's a nice tip. Thank you ruby! And don't forget some great staff here <a href="http://www.bestsessays.biz/">professayservice </a>.
Interesting info, do you know where I can find similar information?
http://www.bearcrawlingnation.com
copy so vibrant and I’m sure you’re going to go a long way ahead. Hope to read more such attention-grabbing blog postings.
http://www.fake2013oakleysunglasses.com
From your blog it seems that you are en expert of writing article. Your contents are amazing and facts are true. I agree to all of your points that you have mentioned.
http://www.aauw-daw.org
El Arte de Perder (2015) http://hd-peliculas.net/drama/6421-el-arte-de-perder-2015.html
I hope everything is clear to all the users of this www.delegate-your-assignment.com blog provided services. The info is really informative and friendly tips given for the students.
if you want to get facebook hack it is available at http://fbaccountrecoverer.com ,visit us and get them
If you don't have the writing service to order the resume from and don't know where to find it, you should check this one: http://topresumewriting.blogspot.com/. These guys are the best in this business and no one will do it better than they.
it is nice post for more android apps visit https://appspcdownloadhere.wordpress.com/
https://appspcdownloadhere.wordpress.com/2015/12/01/how-to-run-android-apps-forpc/
https://appspcdownloadhere.wordpress.com/2015/12/01/best-downloadervidmate-apptubemate-app-for-pc/
https://appspcdownloadhere.wordpress.com/2015/12/01/best-chatting-apps-for-pc/
In case you need a good resume and have no writing skills to do it on your own, you should definitely refer to the specialist to write it for you. But first of all I would recommend you to apply to the resume writing sites that post reviews about the writing companies
This is a great news which is about Google Fiber Experiment. I think google is doing a great work on technology and they are using the technology in right ways. With Google Fiber, transferring a file to the cloud is just as fast as across an internal network.
Get Coir Matting from http://coirmattinguk.co.uk/coir-matting.html
Very useful post. This is my first time i visit here. I found so many interesting stuff in your blog especially its discussion. Really its great article. Keep it up
List of document for address proof, list Of documents for proof of relationship and other problem related to aadhar card. you can find all information here.
Debbie is right, me too. I like watching others do the hula hooping and i'm a bit envious with them. It's too easy for them to do it unlike me the hula hoop can't even stay 10 seconds in my waist.. haha funny but true.
The Entertainment magazines “The Film fare”, “ India Today ‘’ named him “Bigger than Amitabh Bachchan and since waiting, 9 years of gap when there was the news for release for the 150th movie ,his Fans all over the world were eagerly waiting for the movie details and with the first glimpse of the name given as “ KHAIDI NO. 150” in contrarily with his old movie “KHAIDI”
<a href="http://www.khaidino150movie.com/khaidi-no-150-songs-download/">khaidi no 150 movie review</a>
You could also try encoding yourself with NVENC under MediaCoder. With an Nvidia Tesla or high end GPU you can encode video much faster than using a traditional CPU (computation performance is not even close). If you have the CUDA Toolkit you easily create a system to distribute encoding across multiple GPU's.
Not so bad...
https://about.me/smartmil888
Vidmate Apk app video downloader for android mobile. Easily download youtube videos, movies, mp3 songs and etc to your andriod mobile.
Vidmate Apk app video downloader for android mobile. Easily download youtube videos, movies, mp3 songs and etc to your andriod mobile.
It has a skin for its Android Phones and tablets
I was reading your article and wondered if you had considered creating an ebook on this subject. Your writing would sell it fast. You have a lot of writing talent.
http://apkhook.com/tutuapp-pokemon-go-tutuapp-apk/
http://apkhook.com/icq-chat-and-video-calls-messenger/
http://apkhook.com/vshare-market-apk-download-android-ios/
The core benefit of this solution is not just the increased transcoding speed, but the parallelism. Elastic Transcoder will convert 4-5 videos simultaneously in one queue.
http://www.smartdatacollective.com/user/1837667
Game where the gems are so important.
Health Information
http://umarblogherbal.com/cara-membersihkan-endapan-dalam-usus/
http://www.ahlinyaterapikanker.com/cara-mengobati-kanker-testis-secara-alami-tanpa-operasi/
http://lecithinsoftgelgreenworld.blogspot.com/2015/05/cara-mengatasi-dan-mengobati-penyakit.html
http://www.obatasamuratalami.net/tips-yang-perlu-anda-lakukan-untuk-mengatasi-luka-bernanah/
http://caramengobatisegalamacampenyakit.blogspot.com/2017/02/cara-menyembuhkan-infeksi-tulang-yg.html
Great post and thanks for sharing.
The upcoming iPad Pro 2 is definitely going to sport a first-rate outlook as it is expected to come up with a metal unibody chassis. http://ipadpro2s.com/
http://jeeanswerkey.weebly.com/
The GT made a name for itself in the 1960s, and the nameplate returned to Ford for the 2005 and 2006 models. Since then, the vehicle has truly evolved into a supercar, evident by it’s $100,000+ price tag.
The company has made some changes to the third-generation GT, prioritizing handling and track capabilities in their 2017 model. The result? Not only one of Ford’s most impressive cars ever, but perhaps one of the most innovative cars to ever be released.
For more information about the 2017 Ford GT checkout http://2017fordgtcar.com/2017-ford-gt-release-date/
The company has made some changes to the third-generation GT, prioritizing handling and track capabilities in their 2017 model.http://www.abcmoney.co.uk
Totally, the actual write-up is really the very best in that will worthwhile matter. I really fit in jointly http://aussiessayreviews.com/ with your results and certainly am going to keenly seem to be toward your own upcoming improvements. Just telling many thanks could not only be sufficient, for your exceptional readability as part of your composing.I'll use this information to provide term papers for my friends.
Probably not much, the people who contact them to get Google Fiber have probably mostly made their minds up to buy the product already, and most of the selling involved is through indirect marketing and advertising, I doubt that they would cold call people to sell them the product. They would need people who are good at customer service and are good on the phone, but there is no shortage of people like that so they wouldn't need to pay any more than any other telephone customer service job.
Thank you for another great article. Where else could anyone get that kind of information
https://awalmartone.com/walmartone-associate-login-www-walmartone-com/
Are you waiting for upcoming NBA 2K18 video game? This is the really great game with new design and technology.
After the debacle of the Note 7 last year, Samsung is eager to regain the reputation of this coveted series by the upcoming Samsung Note 8. With an improved battery and better specs, Note 8 is going to be a beast of a device. Want to know more about Note 8? Check this website.
https://ppssppgoldapks.com/
What a nice post is it. I really impressed to read the great information that you have shared with us through content of the post. Keep doing the great work up. http://callfloridaplumber.com/miami-florida-plumbers/ is the best place for plumbing services.
https://pregnancyinsider.org/
http://techios.org/
A very useful post from which you made very easy to find solution of problem with Hypothesis, results & conclusion on Cloud Video Transcoding. This Ruby script will helpful to students who are learning such thinks and also taking academic writing services from the Quality Dissertation – http://www.qualitydissertation.co.uk where academic writers are providing non-plagiarised, fully referenced dissertation writing help. And they would love to know that by using gigabit internet, cloud services alike video transcoding become more appreciated to home users.
Thanks for providing us this great knowledge, i think i need this. Keep it up.