OK, fair enough. Well your issue is really one of tuning the underlying query, not with the pagination as such. Have you used autotrace to see what it is doing?
Since you are displaying a pagination result set, you are more interested in getting some rows back early rather than getting the whole result set quickly, so you could try adding a FIRST_ROWS hint.