Yes, it was bitter! What if all this time we were eating the unripe fruit? Maybe it's also supposed to look purple...
I found an old picture I had taken of a flower of the plant. It's when we were staying at a seaside hotel. All these bushes were in bloom and a bird liked to pollinate the flowers with its long, thin beak.