I played rugby at school, finished after 6th form though. I enjoyed it, but unless you're committed to playing to a decent standard it really is shite. Played a few games for a mates team a few years ago, which was the equivalent of local pub Sunday league standard and I may as well have been a spectator. I was playing 13 and just watched a series of reset scrums, fumbles, knock ons, wonky line outs...it was horrible.
As far as injuries are concerned, don't think you're especially likely to get contact injuries as long as you're smart enough to play at the level you're suited to. Obviously the higher up you go the bigger the blokes you're playing against and more brutal the contact.