Everyone says that mushroom is such a fungi, so why didn't they have the party at his house?

three wooden, hand-painted, red mushrooms standing on a mossy surface

Because he didn't have mushroom there.