Obviously, it’s not a good idea to have a meeting about something that isn’t going on and is certainly not official. On the other hand, if it’s something that isn’t happening, nobody is going to stop you from having a casual conversation about it over lunch. Not even if you happen to be eating at the same place your boss is… Just like he told you to.