Departments are the departments within your organization, i.e. support, billing, sales.
Groups are access level permissions for staff (i.e. member/moderator/admin) on a forum. You can set whether groups can create tickets, add new staff, access departments (outside of the ones the individual users may belong to), that sort of thing.