There are a few ways to make your photos and thumbnails all look uniform in size in your catalog.
Go to the admin, then click on configuration, then click on image, then go to small image width and click on edit and make sure the box is blank, then click update. Then go to small image height and click edit and make sure the box is blank and click update.
Here is another way to try it:
In osCommerce you can set the sizes of images to what you want. You can delete out one of the numbers. I believe it is the width you can delete -- as in leaving the box empty with nothing in it. What that does will force the image you are using to a height of 150 and regardless of square or rectangle it will automatically set the width for you. You can do that with all the image sizing elements. And it works the same in zen cart, too, for those of you that use it.