The boss will remain focused on his job with speculation over his position at Villa Park following a dire start to the season.
Villa host Swansea on Saturday second bottom of the Barclays Premier League and without a win since the opening day of the season with David Moyes having been linked to Sherwood's role.
While Sherwood joked he will be looking for any out of work managers in the crowd he knows it is a situation he must handle.
He said: "You just get on with it
It's purely speculation
I'll be checking over my shoulder to see if anyone is positioning themselves in the director's box tomorrow.
"I'm easy with it
My job doesn't change
I still need to win a football match which I'm aware of
I'll be taking full responsibility for the team's performance and we'll win tomorrow.
"You just deal with it because it's part and parcel of the job
If you don't win games and you come under pressure and someone else gets linked to your job.
"I've been linked with a lot of jobs myself, I can't stop myself being linked and I can't stop, while I'm sitting in the seat, other people being linked
Sherwood has a fully-fit squad for the first time this season with Gabby Agbonlahor available after a calf injury.
Mark Bunn could replace Brad Guzan in goal after the American's error in Saturday's 2-0 defeat at Chelsea.
Sherwood added: "Everyone is fit
There are a few who haven't done as much training as we would've liked so will have to assess whether they're going to be ready but it's all quiet in the treatment room."
Source : PA