Did you know vast majority of AI development happening right now is on python? The thing that literally consumes billions of dollars of even-beefier-than-4090 GPUs like A100. Don't you think if they could do this more efficiently and better on C or assembly, they would do it? They would save billions.

Reality is that it makes no benefit to move away from python to lower level languages. There is no poor optimization you seek. In fact if they were to try this in lower level languages, they'll take even longer to optimize and yield worse results.

[–] Alexstarfire@lemmy.world 2 points 1 hour ago

TBF, using AI as an example isn't the best choice when it consumes an ungodly amount of power.