I remembered that my aunt has compiled a family tree for my paternal side. It's mostly German, so there are some different names. Here are a few of the less common ones (less common for here, anyways):
Men:
Friedrich (I've always liked this variation of Fredrick)
Joachim
Otto Julius
Wilhelm
Horst.
Women:
Gisela
Erna
Katalin (I like this actually)
Lisette (I like this, too)
Constantia
Friederike
Eva Louise
These are all people born before 1937, though most of them are at least two generations earlier than that.
Men:
Friedrich (I've always liked this variation of Fredrick)
Joachim
Otto Julius
Wilhelm
Horst.
Women:
Gisela
Erna
Katalin (I like this actually)
Lisette (I like this, too)
Constantia
Friederike
Eva Louise
These are all people born before 1937, though most of them are at least two generations earlier than that.