Check the appliance's hostname, it may have reset to localhost even though you changed it. Give it a FQDN and of course make certain DNS records exists in AD. Enabling AD on the appliance should now work.
This happened to me on VMware-vCenter-Server-Appliance-5.1.0.10100-1123965_OVF10.ova and prior.