> BI tools are generally incredibly poor at dealing with the bag-of-spanners heterogeneous data landscapes
It's not that they are poor, it's that they eventually require some moderately-challenging coding - because there is only so much complexity you can hide behind point&click before things become untractable. Programmers get bored doing BI plumbing, and those commercial ecosystems are quite secretive and often expensive to train in; so the talent pool is small and costs can skyrocket pretty quickly, making the whole proposition unappealing.
Maybe if we accepted that "BI Programmer" is a respectable career and something that is fundamentally unavoidable, providing clear career paths inside companies for it, instead of trying so hard (and failing) to get rid of such figures as soon as they progress a bit, there would be more predictability and less angst in the space.
It's not that they are poor, it's that they eventually require some moderately-challenging coding - because there is only so much complexity you can hide behind point&click before things become untractable. Programmers get bored doing BI plumbing, and those commercial ecosystems are quite secretive and often expensive to train in; so the talent pool is small and costs can skyrocket pretty quickly, making the whole proposition unappealing.
Maybe if we accepted that "BI Programmer" is a respectable career and something that is fundamentally unavoidable, providing clear career paths inside companies for it, instead of trying so hard (and failing) to get rid of such figures as soon as they progress a bit, there would be more predictability and less angst in the space.