Yes, there are some differences. Exp/loot preys expires as you kill monsters, damage expires as you hit something, and def as you get hit.
As per the comments below I'm updating answer with additional info: timers are the same as for exp/loot afaik, the only difference is the action which trigger it.