Do you consider the name Rory a boys name or a girls?

Are you my long lost twin... lol... I wanted Rory soooooo badly! For either a boy or girl, but liked it espeshally for a girl, due to most likely gilmore girls, (my fav show) but either way I love that name and had my husband let me, my daughter would have had that name, and again if he'd let me my son would have that name! LOL but he wont budge. I think it's either, but heard from many more of a boys name.