You have run out of free memory on the machine. DB2 cannot use virtual memory, real memory must be available.
You will need to temporarily override your bufferpool sizes, then you can connect into the database and alter bufferpool size(s) via SQL, then reset the override back to null (so the override is no longer in effect).
These are the steps:
db2stop
db2set DB2_OVERRIDE_BPF=1000
db2start
db2 connect to <database-name>
db2 ALTER bufferpool <oversized-bufferpool-name> SIZE <some reasonable number of pages based on real memory available>
db2 terminate
db2stop
db2set DB2_OVERRIDE_BPF=
db2start
db2 connect to <database-name>