(FYI: this is going to be a thread discussing practical AI-coding problems, not the deeper problems. If you want to argue about never using AI, please don't do so here.)
#LLVM has a proposal to ban using AI to draft PR descriptions and comments (and some other things), no matter how much human-in-the-loop. I've felt pretty good at getting (with sadly large amounts of effort) these tools to write first drafts for me, and I shared that on the LLVM discussion thread[1]. Now I'm working on a follow-up, and brainstorming here first -- comments and discussion welcome!
After some private push back that I was wrong about how even my current efforts were working (thanks BTW!!), I tried something, and I think I'm changing my mind.
First, I spent some fun coding time using these tools, but switching to always drafting PR descriptions and comments myself. I also had the first drafts for a some of these PRs already written and I _thought_ edited into a better form from quite some time ago, so I could compare the results.
Two observations that surprised me:
1) They were much more different than I expected.
2) The differences weren't the kind of differences I expected.
(continued below, even my word limit isn't high enough)