A family says the company behind HS2 has not paid them for their farm despite them being forced to hand over the keys on Friday.