Do you think I am in the wrong for not letting my partner visit me at my friends whilst I’m house sitting?

Hi, for context I’m housesitting for a friend for a couple of days. My friend has just gone through an extremely bad time. I’m on my own looking after the property and the pets. Awhile ago, I did ask her if it was okay if he could come I would’ve preferred it if it could overnight and then felt funny about it and said it it’s okay I’ll just come on my own. My friend has now left for the weekend . My boyfriend just text to say he was on his way to visit me. I said I don’t think that’s a good idea as I’ve not okayed it with my friend. It’s not my house and it doesn’t feel right to me. Just bringing somebody in that she’s not even met. I wondered if people thought if I was in the wrong here, I feel pretty bad now on him . Thanks.