So, what should I do now? He's a Gemini, if that matters.?

He might finally decided to take it slow. But since he has already had you it sounds that you two are just a little above friend level.