What could it mean if someone is extremely standoffish with you at a group dinner but keeps staring at you at the same time?

Basically, this person was very aloof and would converse with everyone else in the group but me. However, every time I would look up or look near him, he would keep staring at me.