Something that you have to do in Reykjavik is go to the top of Hallgrímskirkja. It is absolutely beautiful!
There is an admission fee of 700isk (€7) that you buy in the shop just past the entrance.
There are four sides of the tower to get a panoramic view of the city. But three of them are the best.