Also check the physical capacity of your various
hardware components. Neither "the number of CPUs" nor "the amount of memory" really helps you
at all in this case. What matters very much is: how fast the devices can physically perform their task,
and how fast the computer's internal buses (and external wiring) can get the data to them. This is an
I/O bound activity, not CPU-bound.
Many "off the shelf" computers economize on their I/O structure, which is to say they're dog-and-pony slow. Unfortunately, there are a lot of cheap tape-drives out there too. You don't say anything about what kind of hardware you're using. But to give you an example, some computers would only be able to execute a disk I/O operation
or a tape I/O operation, but not both, at any one moment in time. Other device configurations would be capable of full parallelism.
Backup speeds can also, generally speaking, be affected by contention for the database itself. A "great big fat lock"

will obviously allow a backup to be more efficient but will lock out other activities wholesale.