I totally understand your stance. Thing is, he can afford to still keep up his rent payments regardless of how many fans show up on a Saturday.
I’d consider the same approach as you if I knew it would impact him but it doesn’t. For as long as there is The Venue, there will be rent payments.
That’s why I think well if me going or not doesn’t affect him then me not doing something I enjoy is really just cutting my nose off to spite my face.