Logging for embedded ApacheDS servers broken (log4j.properties is deleted)

Errors starting an embedded server (after configuration is edited) aren't being logged anywhere so it's hard to figure out why a server isn't starting.

From Stefan Seelmann (user mailing list):

When creating a server there is a conf/log4j.properties file where logging is
configured. When starting the server immediately after creation the
"admin password" warning is logged to logs/apacheds.log. But, as soon as
one changes the configuration via the config editor in Studio the
conf/log4j.properties file is deleted and afterwards nothing is logged
at all! Workaround would be create the server, save the log4j.properties
file, and restore it after changes in configuration but before starting
the server.