Rights over debt collection agencies?

If a debt agency takes over my debt from another company - do I have the right to say I have no debt with them as I haven't spoken to them and definately not signed a contract with them? I had a debt with a bank - now an agency seems to have 'bought it' from them. Do they legally have the right to claim it from me?