I seem to have lost the OSX Server configuration app, which made trying to turn off Apache a little tricky. The solution is to use launchctl:
sudo launchctl unload /System/Library/LaunchDaemons/org.apache.httpd.plist
See man launchctl for details.
