Try to get some kind of power tool to help you. Before polishing, you will need to sand with progressively finer papers. I take the last little machining marks out with 280 grit, then 320, then 400, then 500, then 800, and last I go for the 1000 grit carbide paper. With the 1000 grit paper, I will wet it with oil or WD40 and oil sand. The 1000 paper will leave the aluminum shiny, and let you see any imperfections. Once satisfied with the sanding, its time to polish. You can buy felt bobs that go in the chuck of a cordless drill. Get some and a drill, a dremel (even chinese clone) and dremel polishing bobs will be handy too. You will need some polish. This looks like colored waxy sticks, for the dremel it comes in a little container. It comes in several different grades. I use the red and the white. (rouge and diamond) Spin up the felt bob in the drill, and rub the polish stick on the spinning felt to transfer some polish. Now gently work the spinning bob against your aluminum and the bob will polish it. Buff periodically with a clean rag to check your progress. I have the same host as you, and mine has a bluray in it too. The knurling is a pain to clean out. If desperate to remove anodize, a sodium hydroxide bath can be used. (With caution - corrosive) If you do so, make sure not to dissolve too much aluminum.