I agree. I think most players want to be there for the story the DM intends to tell. The worst thing that usually happens is that the players get over-invested in a throwaway NPC and the DM has to make up some lore.
The one group I was part of that did just want to goof off ended up flaming out after they inadvertently summoned the avatar of Gruumsh, but that's a story for another time.
"Jesus wants a hug!"