Then the Search Settings - search number per page, template for prev and next page etc. - needs to be altered.
that is exactly the problem why these kind of nice additions don't make it to a next version.
If you want to do it right, you need extra data for a template block, backend template modifications, extra language translations, on/off switches, etc..
As long as there are not a lot of requests for something like this, it will not happen. It takes too much time of the very limited manpower.
Right now you can only set the results per page by setting the "max" value in the initial search form.
Use <input type="hidden" name="max" value="5" /> to get 5 results per page.