What you back up depends on how you configured your dedicated server. For standard installations it is a good idea to back up your website directories.
On Linux dedicated servers, back up the /home
directory.
On Windows dedicated servers, back up the C:Inetpub
directory.