Justin Baldoni claims Blake Lively sent him down to the basement