What did my Grandpa mean when he said this? Was it ual innuendo?

I am 12 years old. It was my Grandparent's 50th anniversary celebration and we were all at a resort, the whole family. My parents surprised them with tickets to a golf resort and my Grandpa winked and said, "I'll tell you how lucky I get, and not just in golf!" and my Grandma giggled and blushed. My cousin said this was talk. But my Grandpa is in his mid-late seventies! What the?!