The guy, you got together must have gone through a certain number of similar experiences. He'd meet a young dude and both would agree on 'the meaningful relationship', the same taste in music and movies. Soon, the younger dude would start believing that he might have really found a mate. 
After couple of dates in public, all decent, sweet, romantic and no sex, there comes the third, dinner date at his place. It is now a foregone conclusion that you have become 'friends' and that you want to test the sexual waters, so to say, in order to see, if you are compatible and if the further dating makes sense or if it is a sheer waste of time, energy and cash. 
You had every right to say 'NO' and you certainly did well in protecting yourself and your integrity. Forcing anything is entirely unacceptable. Period. 
Yet, being a gay guy, you want to learn some of the basic tenents of the prevailing gay culture. Agree with them or not, but learn them nonetheless. 
Few guys will date for a very long time, if no sexual gratification is involved. They may rightly fear that something might be wrong with you and/or that you are asexual and that they are simply wasting their time. This did happen to yours truly here and trust me, I did learn the hard way about gay guys being great mates and being totally asexual, too. I wasted quite some time, energy and cash on someone, who was disingenious enough as not to spill out his beans. He wanted a friendship, while saying that he wanted a lover, too. He lied. I paid. 
Very few people will invite you to their homes and cook you a dinner after couple of dates only to impress you with their haute cuisine. Obviously, you want to know this basic rule and either stick with meeting in the public or warn the guy very much ahead of time of your intentions to go home after the coffees. 
Last but not least. A way into a relationship cannot be sped up. Yet, you also want to exhibit a level of emotional maturity here. You are willing a ready to wait till you start getting intimate with a guy. Fine. So, how long is it? Or are you going to let him know, once you feel comfortable enough, and he'll have to wait till then? 
This may sound romantic and impractical. Think of the other dude, too. It takes two to tango and if you are the one, who is always saying, 'wait and no', that soon will be your own destiny, too. 
SC