I love Portland, but moved to SoCal 5 years ago to escape the constant rain and gloomy skies. If it wasn't for the weather I'd still be there. I miss it so much.
I've lived EVERY where in that town from NW, to downtown, to gangland NE, Meth central SE, Sellwood, Beaverton, Lake O, ect. ect. I've never had a problem in any area except NE (the gangs had gun battles every night). NW is awesome if you can afford it. Beaverton and Lake Owsego are nice suburbs to live in.
The girls party hard in Portland. Because of the rain they prefer "indoor sports".

Plus there's a strip club on every corner!
Downtown Portland is an awesome town. Love the culture, and it's very pretty. Yes, there are street kids, but they're easy enough to deal with.
Oh, and something I totally miss down here in SoCal..... when you let someone in your lane in traffic they give you the wave. Damn I miss the wave.