"Call of Duty" starts using artificial intelligence to evaluate harmful speech in voice chats.

2023-09-01

Almost any online multiplayer game can become a tool for harassment, but the "Call of Duty" series is unfortunately more prone to this than most games. Activision Blizzard announced in a blog post on Wednesday that they have started using artificial intelligence to address "disruptive behavior" in voice chats. Conversations between North American players in "Call of Duty: Modern Warfare 2" and "Call of Duty: Warzone" are already being managed, with other regions and games to follow in the coming months.

This tool is called ToxMod and is developed by Modulate, claiming to be the "leader in combating harmful online behavior." According to Modulate's website, ToxMod identifies potential harmful conversations and evaluates them. This process sometimes removes background noise for more accurate analysis. Then, ToxMod assesses the "tone, pitch, emotion, and context" of phrases or conversations to determine if a player's behavior is harmful. While the tool does perform keyword analysis, this more nuanced approach ensures that the entire conversation is considered before taking action against players.

Image source: Activision Blizzard

ToxMod forwards flagged harmful conversations of a certain type or severity to the game's moderation team, who decide whether to take action against specific players. This means that behind every warning or ban in "Call of Duty" game voice chats, there is human involvement. According to Activision, the first warning only partially prevents players from reoffending, as 20% of players still do so after receiving the first warning. Repeat offenders will face chat restrictions and temporary account limitations as punishment, although Activision has not disclosed the specifics of these penalties.

ToxMod represents Activision's second significant effort in the past year to combat harmful speech within the game. In November of last year, the company introduced a new reporting system that allows players to report individuals using offensive text or language. The new interface reflects the game's code of conduct, which players must agree to abide by before starting the next game, even if they have already read or agreed to it in the past.

Activision's ToxMod is currently undergoing testing in North America for conversations in "Call of Duty: Modern Warfare 2" and "Call of Duty: Warzone." When "Call of Duty: Modern Warfare 3" is released on November 10th, ToxMod will be rolled out to all players worldwide, except in the Asian region.

RECENT AI NEWS

RECENT AI TOOLS