The size of the ship has little to do with how it rides, its the design.
San Francisco port is in the main downtown, about 30 or so minutes from the airport, lots of hotels to choose from, lots of activities in the immediate area, but more expensive. LA Harbor (called San Pedro) is 40 or so minutes, a smallish town area, with a few hotels and activities, far less than SF.
Sailing under the Golden Gate in SF is a special event.
All of these things are commonly discussed on the West Coast Departures board.