LLMs are bad at vibing specifications

I feel the same way about specifications and writing: LLMs should be used way more carefully there, if at all.

With writing, I'm specifically trying to communicate something - I have to read it word for word to make sure my intent is being communicated correctly. LLMs are way less effective here. Sure, I could use them to spruce some parts up a bit, but I just don't.

With specs, you're literally describing correctness criteria. Checking for correctness on a spec that you're not intimately familiar with is a recipe for disaster. You can be "proving" things left and right that are totally vacuous or not what you meant at all. Even if an LLM helps bootstrap a spec, I have to read it and become familiar with it in and out, and at that point I may as well just maintain it myself.