Don’t get too excited by the (site) of that restaurant.
’site’ refers to a place or position while ‘sight’ means manage to see or observe (someone or something). The narrator is explaining someone to not to get too excited by the sight (glimpse) of that restaurant.