If anything it's the car-dependent infrastructure that is ableist, as many people with disabilities cannot drive. I can't, and if I didn't live in a place where alternative modes of transport were a thing, I would either be stuck at home, or have to waste money on buying a specially made car.
Far from all disabled people use wheelchairs or have mobility issues. Some have problems with their sight, concentration, fine motor skills etc. which prevent them from driving safely. Even if you cannot walk or ride a bike, and have trouble getting on/off public transport by yourself, living in an environment that is walkable and bikeable usually means that it is also easier/safer to get around in a wheelchair or on a moped.
I haven't seen this option mentioned yet but you can also order your groceries online, and have them delivered. That's what I do at the moment, because I live outside the city and my nearest grocery store is 2 km away. I could bike or hop on a bus, and I do sometimes, but ordering online is just really convenient.