Can you drill a thick ish square of wood in the drill press and then use that as a guide for the big piece? (Clamping it down). That's about what I would do. (I might use a metal insert on the guide if it's super super critical)
Note: I'm Not an experienced woodworker, I've used this before for drilling 3d printed pieces.