The problem I have is that an exclamation mark alone could mean all kinds of things. Like I once clicked it and it came out saying something like "Yes, I see what you mean. Interesting." Something that I hadn't wanted to say at all
.
The trouble I find with this is that it goes to the opposite extreme. Instead of directing a character's speech exactly (which you argue against doing) I have almost no idea what the character is going to say. And that makes me feel like I've lost control completely.