Player, (as a female) i have a Crumpler bag that i sometimes use that doubles as a handbag if i need to carry a purse and the extra lenses. but i usually only do that when i'm going out to shoot and nothing else. otherwise, it's just too small to be practical... as for stashing everything in a regular handbag, i rarely dare do that. if you saw my purse, you'd understand (i was pulled over once by the french police who thought i was carrying a bomb in it)! there's enough gunk that i'd be petrified of damaging a lens or getting dust, etc., in it.
Lili, i use the neckstrap. yes, the ugly Ricoh one and do just fine with it. it takes some getting used to (and vanity be damned), but it works quite nicely. for street shots, i've almost got the angles figured out so i don't even need to look at the screen or VF. my hand is always on the shutter, both to secure it and be ready to take a picture if the need arises. for that special shot, i'll take it off and vow that i'll chop off all my hair!
i'm personally very interested in any more elegant versions of neckstraps that people come up with. i am a little sick of looking like a total dork...