Tasty » Adam Sampson's pipeline bookmarks

dgsh — directed graph shell

DDS's shell allowing the construction of arbitrary graphs of pipes. I like the examples, which range from "Directory listing" to "Nuclear magnetic resonance processing".

to pipeline shell software unix ... on 26 February 2017

Command-line tools can be 235x faster than your Hadoop cluster

Nothing wrong with a bit of 1970s technology in the right context -- how to solve a not-very-big-data problem the right way.

to awk cloud cluster hadoop performance pipeline unix ... on 14 September 2016

Hints for writing Unix tools

Another set of advice on Unix tool design.

to design patterns pipeline toolbox unix ... on 22 March 2015