You are technically correct. However, “polygamy” as become strongly connoted towards cultish, radically patriarchal communities in which a man subjugates several women in an abusive relationship. If you actually want to be understood without fuss, “polyamory” will get your point across much more smoothly. All resistance to the haphazard evolution of language is futile.