Villa were on the receiving end of a 6-0 hammering by the Magpies in August with Carroll netting a hat-trick during a memorable performance.
Carroll made the ?35million switch to Liverpool during the January transfer window but Reo-Coker said: "You can't take Newcastle lightly, even though they have lost Andy Carroll. They are a still a threat. Every club has a goal threat.
"With that result earlier in the season we were still regrouping as a team (after O'Neill quit as manager).
"There were so many changes and so many things going on at the club. But it is a different position we are in now.
"It is different situation now and there is a lot more at stake for us. I truly believe we can win with fans being behind us and with the atmosphere generated at Villa Park."
Source: PA
Source: PA