Bloomberg Law’s® extensive network of reporters and editors helps subscribers to stay ahead of legal
By Jessica DaSilva
Jan. 5 — Social media websites do not have the technological ability to comply with a bill that would require technology companies to report on “actual knowledge of terrorist activity,” according to industry analysts.
The bill, introduced by Sen. Dianne Feinstein (D-Calif.) in December 2015, spans a little more than two pages. The bill states that it is designed to mirror the existing law governing reporting requirements for electronic communication service providers in regard to child pornography—a comprehensive statute far exceeding the detail of Feinstein's bill, these analysts say.
Feinstein's bill is “technically and legally very different,” said Emma Llanso, director of the free expression project at the Center for Democracy and Technology.
Mainly, Llanso said a purely technological solution exists to bring companies into compliance with reporting requirements for child pornography storage.
Law enforcement agencies share sophisticated photo data called “hash algorithms” with companies that are required to report, Llanso explained. The companies then use the algorithms for ongoing searches of their users' content for image matches, she said.
Those image matches can include facial features, body characteristics, or a person's size, explained David LeDuc, senior director of public policy for the Software & Information Industry Association. The SIIA is a trade association representing digital companies affected by Feinstein's bill.
No such technological answer exists for Feinstein's bill, both Llanso and LeDuc said.
What the bill is asking these companies to do is a “fine-grained assessment of political views,” Llanso said.
Most of these companies already engage in content moderation to enforce compliance with their terms of service, Llanso said. Those terms typically ban users engaging in hate speech, promoting violence, or making violent threats. Therefore, companies regularly review content for terrorist activities, she said.
LeDuc stated that review of current speech for terms of service compliance is not done with technology, but involves “many human beings and a lot of continuous monitoring by actual people.”
“Given the challenges of wide ranges of languages, slang, and dialects, it's simply not practical that there's any technological approach to monitor posts rising to the level of terrorist activities,” he said. “With respect to speech, sarcasm or irony or things that are satirical or mocking could be brought in under the guise of terrorism.”
For that reason, Llanso said she is concerned about the lack of details in the bill, which does not address consequences for companies' failures to report, consequences for users who are reported, how the government will treat false threats, and more.
“With no definition of ‘terrorist activity,' how do you find it?” Llanso asked.
Tom Mentzer, communications director for Feinstein, told Bloomberg BNA in an e-mail that the bill does not require companies to monitor speech, so any technological concern “isn't an issue.”
“Companies already monitor their networks and routinely remove posts, delete accounts, etc. when they come across terrorism-related material,” Mentzer wrote. “They do this because they have rules that prohibit this type of material on their networks. That's what they would be required to report. If they come across it, they have to report it.”
When asked if social media companies currently failed to report actual knowledge of terrorist activities, Mentzer linked to a press release on Feinstein's website listing two examples of failures to report.
“Prior to his death, Syrian-based terrorist Junaid Hussein contacted and radicalized individuals and incited attempted terrorist attacks in the United States and the United Kingdom,” the release states. “He regularly used social media sites like Twitter and switched among multiple user accounts to continue posting after Twitter shut down individual accounts.”
The release also mentions one of the San Bernardino, Calif., shooters' Facebook posts announcing her allegiance to the Islamic State. Facebook removed the account but did not turn over the information to authorities, the press release states.
LeDuc said part of the problem with the bill is that companies see it as creating a liability for those that fail in their endeavors.
Llanso said this fear of liability could have two potential consequences: Large companies will try to comply and will need to dedicate more resources to come into compliance. Meanwhile, small companies without resources may become willfully blind so they never reach the intent element of the statute, she said.
Llanso added that even if companies used keyword filtering or automated processing to “narrow down the fire hose” of information, they would still collect an overwhelming amount of data through which private companies must sift.
Additionally, creating those algorithms presents a new risk in biased searches by focusing on language that Muslim users could be using, she said. That in itself could allow domestic terrorists, such as white supremacist groups, to evade scrutiny, she said.
Yet any initial screening would still result in human review of whatever data it produced, Llanso said.
“Speech with any hint of nuance or context dependence will need humans involved” to determine whether specific content is “an isolated statement from a user or an actual terrorist plot,” Llanso said.
Futhermore, LeDuc stated that employees of private Internet communication companies do not have the qualifications for sussing out actual terrorist threats. National security professionals are better equipped to investigate speech, and companies do not have access to well-trained individuals, he said.
“This is essentially putting companies in the position of being judges on free speech,” LeDuc said. “At the end of the day, it's fundamentally a limit on free speech.”
The discussion around the bill is mostly lacking in data necessary to understand how terrorists use social media, said Jeff Kosseff, an assistant professor in the U.S. Naval Academy's Cyber Science Department who wrote an article analyzing the bill. Without that, it will be difficult to determine what kind of regulation is within Congress's power, said Kosseff, who clarified he wasn't speaking on behalf of the Naval Academy.
Llanso compared the risks of a government and private company partnership to the U.K.'s Internet Referral Units currently under fire from the European Union. Those units have law enforcement officers reviewing speech on companies' websites and reporting terms-of-service violations when the officers believe individuals are engaging in terrorist activities.
This circumvents the protection of fundamental rights by allowing the government to recommend speech for censorship, she explained.
“It calls into question the democratic process and the rule of law system promoting fundamental rights when you see democratic governments moderating speech,” she said.
To contact the reporter on this story: Jessica DaSilva at firstname.lastname@example.org
To contact the editor responsible for this story: C. Reilly Larson at email@example.com
All Bloomberg BNA treatises are available on standing order, which ensures you will always receive the most current edition of the book or supplement of the title you have ordered from Bloomberg BNA’s book division. As soon as a new supplement or edition is published (usually annually) for a title you’ve previously purchased and requested to be placed on standing order, we’ll ship it to you to review for 30 days without any obligation. During this period, you can either (a) honor the invoice and receive a 5% discount (in addition to any other discounts you may qualify for) off the then-current price of the update, plus shipping and handling or (b) return the book(s), in which case, your invoice will be cancelled upon receipt of the book(s). Call us for a prepaid UPS label for your return. It’s as simple and easy as that. Most importantly, standing orders mean you will never have to worry about the timeliness of the information you’re relying on. And, you may discontinue standing orders at any time by contacting us at 1.800.960.1220 or by sending an email to firstname.lastname@example.org.
Put me on standing order at a 5% discount off list price of all future updates, in addition to any other discounts I may quality for. (Returnable within 30 days.)
Notify me when updates are available (No standing order will be created).
This Bloomberg BNA report is available on standing order, which ensures you will all receive the latest edition. This report is updated annually and we will send you the latest edition once it has been published. By signing up for standing order you will never have to worry about the timeliness of the information you need. And, you may discontinue standing orders at any time by contacting us at 1.800.372.1033, option 5, or by sending us an email to email@example.com.
Put me on standing order
Notify me when new releases are available (no standing order will be created)