Yes, there is always one default department that cannot be deleted. By default, it's called "Support" but, while you can't remove it, you can edit it and rename it to whatever you like. The system needs at least one established department in order to function.
