You made me curious, so I checked the source code for both comments and posts. This information isn't available to anybody without direct database access, but your admins in theory could check in the database what you've voted on.
Presumably this is necessary for debug reasons and to avoid double-voting, or even worse spam-voting. Reddit has this info in their databases too, I'm pretty sure, for similar reasons.
I'm pretty confident that only vote totals are federated, not who voted for what, so this is restricted to your own instance admin