Do I need to know my recipient’s physical address?

Yes. When transferring, a recipient address will be requested and is mandatory.