On the Customer Setup the Departments tab will look like the below window:
On this screen you can add new departments by selecting the Add button.