I remember hearing Joel mention in the podcast that he'd barely ever used a foreign key (if I remember correctly). However, to me they seem pretty vital to avoid duplication and subsequent data integrity problems throughout your database.

Do people have some solid reasons as to why (to avoid a discussion in lines with SO principals)?

Edit: "I've yet to have a reason to create a foreign key, so this might be my first reason to actually set up one."