Every app you've built is an ETL pipeline (you just didn't call it that)
4 points by Linell
4 points by Linell
An ETL pipeline is an extremely broad concept. You could reword it to unmarshal, process, marshal. You could also say every program is an OODA loop (observe, orient, decide, act) or the process/transform step is an OODA loop etc.
the OODA loop is vague enough that its defenders and attackers can each see what they want to see in it. For some, the OODA concept's flexibility is its strength, but for others it becomes so generalized as to lose its usefulness.
Going further, a function receives inputs, does stuff and outputs something (or side effects but...) and what's really the difference between a program and a function?
No. Is a game an etl? Is an interactive app where users place orders an etl?
Is a game an etl?
If one squints really, really hard: it extracts the current game state and the user’s input with the identity function, transforms it with the game logic and then loads a new game state into a state register.
I like to joke that every game is a turn-based game, it's just that some have a 16ms turn length limit.