Remove ordering dropdown box from category page

If you only have a few products on each category page, the ordering dropdown box can be removed to give a  less cluttered look. You can set the default ordering with the order by date, price or title code snippet.