Pretty much; although, (more importantly IMO) it also removes their economic support from oil companies. GHG's are still produced when obtaining lithium for the batteries, aluminium for the body, etc. There's as well the break and tyre particles that are still major pollutants regardless... despite all that it's still better then using a gas engine.
It's also not easy to convince someone to change their preferred mode of transport and EV's provide an acceptable (and in many ways superior) alternative. Not to mention taking the bus or riding a bike just isn't feasible for some people, similarly some places (like Japan with three separate voltage standards) don't have the necessary infrastructure and capacity to support EV's.