Can you get into legal trouble for staring at someone?

This is basically old lady bullying. Do what your mommy taught you in grade school and ignore it. The more you show them it affects you the more they will do. So don't give them the satisfaction.