Pay attention, this could be fun

I visited my grandpa today, and here’s a conversation I had with him:

Grandpa: Where’s your brother?

Me: He’s doing a school project.

Grandpa: Oh, what’s her name?

Either I took this the wrong way, or he has a very dirty mind.