Maybe the Big Lebowski is normally a really nice generous guy, but (unfortunately) when we see him he's really stressed out because of his money problems.

Not to mention his wife is definitely the issue here. No older rich guy really expects fidelity from their trophy wife, but bringing your co-star from the beaver picture over to use the pool is a bit too much.