Things to worry about: general street noise, not pleasant if you are near the garbage removal area, or loading area of the building, car pollution if near busy street, usually views are not great, etc.
Sometimes there's good things too. Some buildings (like mine) have "ground floor" penthouses...