Sun-earth Lagrange points vs earth-moon Lagrange points vs elsewhere

Where should people mostly live?

I'm thinking it should be chosen to allow room for asteroid-catching
and other industrial operations to throw off a lot of junk in a
relatively uncontrolled manner, without having it be in anyone's flight
path. So today I feel like having the big center of civilization be at
earth-sun Lagrange points.