Yeah money gets around, which means once you exchange it, it loses all connection to you. Merchants don't track serial numbers, and there's no guarantee those bills will be picked up in the next deposit to the bank.
That's why banks use dye packs, because once it's gone there's no actual way to track it. If there were, they wouldn't use dye packs...