Hi Frank,
I was looking for the same request and I found this very good solution:
http://mjawaid.wordpress.com/2011/12/05/displaying-all-categories-and-sub-categories-in-category-box-in-oscommerce/
I think that this is very important property for this contribution.