LLMs for software product development: I have much more experience in this than I’d like to admit, and I’m ready to issu...

LLMs for software product development: I have much more experience in this than I’d like to admit, and I’m ready to issue a judgement:The impact on overall product quality (like, how good in sum total from soup to nuts is what we’re making?) is minimal to nil.It comes down to this: LLMs have not changed the fundamental bottleneck in product making a single iota.That bottleneck is knowing what we want.Knowing what users want. Knowing what we want to make for them. Knowing how it ought to work. Knowing how it ought to be made.In order to make a high quality product with an #LLM you need to know what product you would make without an LLM.And we still don’t (or, at least, it’s still just as hard).It make engineers go fast, but that may disrupt more than improve the overall outcome. And the promise of “learning from fast iterations” requires a culture of learning in the first place, and, well, if you had that…So, a lot of investment, not a lot of progress.