You can do a google search on B-Tree indexes to understand what the tree looks like, and why there are levels. Obviously, a very large table may require an index tree to have more levels than a small table.
The number of levels usually does not affect the access path selection, since on additional level requires only one addition page I/O, which may be in bufferpool memory already.