Tottenham maintained their 100 per cent start to the season as Roberto Soldado scored the winner from the penalty spot for the second successive week.
But Bale was not present for the victory as he was pictured 1,000 miles away in Marbella.
Some of Tottenham's players sit on the back row of the bench during games at White Hart Lane, but Real Madrid target Bale was not there on Sunday.
"We allowed him two days off," Villas-Boas said.
"It's not the first time this has come up. We never force non-selected players to come to our games. I decided that last season."
Bale has been linked with Madrid all summer, but if the two clubs do not agree a deal by Monday then Villas-Boas expects the 24-year-old to be back at the Spurs training ground on Tuesday for treatment on the foot injury which has supposedly prevented him from playing for the north London club.
"There is interest from Real Madrid. Whether the transfer will happen or not, hopefully you will have more news in the next couple of days but at the moment there is nothing I can tell you," Villas-Boas added.
"Tomorrow is a day off. Tuesday is training so I would expect him to be there."
Spurs have scored seven times in the three matches they have been without Bale, but they could have done with their star man on the field on Sunday.
Swarbrick awarded a free-kick outside the area instead, but after the break he did give the hosts a penalty when Townsend went over after the slightest of touches - again from Shelvey.
"The free-kick was given outside and maybe it should have been a penalty, but the penalty in the second half wasn't a penalty," Laudrup said.
A strong performance from Tottenham's midfield denied Swansea the chance to play the possession football they love so much, but they did restrict the hosts to long-range shots for most of the encounter, much to their manager's delight.
"Tottenham are a very good team but they didn't create many chances on goal and they score from that very light penalty," Laudrup said.
"They had a couple of chances at the end of the first half but they were created by ourselves, and apart from that they had nothing."
- Sports & Recreation
- Real Madrid