The majority of experienced paddlers wear paddling shorts and either a Lycra or thermal long sleeved top. I have always used thermals and find it amazing how they can wick the sweat away and provide sun protection, yet keep you warm in winter.
Cotton clothing is generally not advised.