P&S cameras have come a long, long way in the last few years...
But DSLRs in general still use much larger sensors and produce far better images.
If you only ever use the images for small to moderate size prints, at most, a P&S might be fine.
Pick up a cheap, used P&S to have some fun with... but keep your DSLR.
I've got a G5 (5MP, about 6 or 8 years old) that cost me all of $40 with the telephoto auxiliary lens and have since gotten a good deal on and added the wide angle aux lens as well. I also plan to pick up a small flash to use with it.
I like that the G5 can shoot RAW (a lot of the G series that came later couldn't, but the latest G models can... most of the other Canon P&S A and S series only do JPEGs, AFAIK). I also like that it shares memory cards (CF) with my other cameras... and even uses the same BP511 batteries some of my other cameras use. I agree, the shutter lag and slow AF is a bit of a pain some of the time. And ISO is limited... 50 to 400, and 400 is not really very usable. Later cameras improve on both of these.
There's no reason to feel like you are "working" with your 60D. Take it out with fewer lenses and accessories, when you don't want to haul around the whole kit... Use the highly automated modes it offers, when you feel like it.
Or just pick up a small P&S to use at times you don't want to hassle with the DSLR.