Note: For some reason the entries on specific jazz instruments are searching poorly in Grove. If you are interested in this use the linked essays here or ask Jessica.
Like physical browsing? Check out the library's Jazz section at M1366 in the 2nd floor CD collection
The library has a handful of handbooks of jazz recordings that will give you nice highlights of the elements of each album and some information on their significance within an artistic output. These are mostly arranged under artist. They are also older and will not provide information on albums in the last 15 years. These books have been placed on reserve for your class behind the Circulation Desk
If you search the name of an artist and recording in Primo, you will most typically see album reviews published in magazines. This will particularly be helpful for newer albums that aren't represented in the print handbooks.