Yes, the inner panels are necessary.They add stuctural rigidity to the entire rear section. Including, ultimately, the rear spring attachments.
It's your car, do what you want to it.
Incidentally, the reason the round wheel arch cars were changed back to square arches was that the semi ellipic rear springs loaded the structure differently, and there was a possibility of failure.
Jeff