It is true that he likely received special treatment because of his parents, and it is just as true that it is dismissive to call him a nepo baby.
That's a specifically derogatory infantilizing name that dismisses the entirety of an actor's own work and attributes it solely and dismissively to their genetic legacy.
Successful movie stars, especially those with successful parents, do need to be coddled, but infantilizing someone and misattributing all of their success and their very personhood is dismissive and insulting.