Have a new classification for the app (same as 'prototype' ect) like 'old' or 'archived', so you can keep your production/test and old apps away from each other.
So that the feeling of tidying up your apps is less likely to apply.
Because then there is always a likeliness that you delete the wrong app.