I got distributed video encoding working with handbrake, gearman, and mkvtoolnix If anyone want...

[G+_Benjamin Webb]

I got distributed video encoding working with handbrake, gearman, and mkvtoolnix.  If anyone wants my rough bash code you are welcome to it.  Be funny to make a pi 3 video encoding super computer that is probably as fast as a normal computer lol. Although maybe I am underestimating the new pi3.

[G+_Steve Martin]

I suspect the word you are looking for us "overestimating."

[G+_Benjamin Webb]

Well they said the new Pi3 is equal to a computer from 2004 I don't know how many fold that is away from a normal one. My algorithm does scale linearly.

[G+_Steve Martin]

Well, remember that video encoding is one of the toughest chores there is on a CPU. The ARM doesn't have much cache and the RasPi doesn't have much system memory. It would be a bit like running video encoding on a smart phone today.

 

As for comparing to a modern desktop x86_64 CPU: I did some benchmarks. The desktop CPU will be 4 to 10 times faster than the RaspPi depending on the benchmark. Not taking into account limited memory.

 

[G+_Benjamin Webb]

That's about how many I figured.  This is definitely best served with a 64 bit system but it would still be fun to goof with a bunch of pis

[G+_Steve Martin]

I'd be interested in how it works if you try it.

[G+_Benjamin Webb]

Well it is actually pretty simple take a single video file mounted on a NFS share then tell each computer to encode one chapter of the file then use mkvtoolnix to put files together.  Gearman is used to feed the encode jobs to each available computer as they finish.  Your only limit should be the write speed of the NFS share.