How to raise rent and keep current tenant info

I just raised rent on most of our properties. How do I apply the new rent amounts correctly? If I use the rent adjustment button it assumes there is a new tenant. If I change the rent amount in the current lease it is retroactive to the start of the lease and shows the tenant with large deficit. I need to be able to document the rent change and have it correct moving forward without having to re-add all tenant info.