Caleb Taylor had given the Baggies an early lead.
Goals from Ryan Yates and Ramon Sosa sent Forest into the fourth round.
The Foxes ended a five-match losing run in style.
Wolves sealed passage into the fourth round of the FA Cup as Rayan Aït-Nouri and Rodrigo Gomes scored in their 2-1 win at Bristol City