Unveiling the Controversy Surrounding AI Conversation Data Collection
Profound, a burgeoning startup, markets itself as a tool that enables businesses to gauge how they are perceived when AI systems respond to customer inquiries. However, concerns have emerged from AI industry experts who allege that Profound may be harvesting data from users’ AI interactions without explicit permission.
Expert Insights on Data Privacy Risks in AI Analytics
Lee S. Dryburgh, a specialist in AI transparency for consumer brands in the health and longevity sectors, has raised alarms about Profound’s data acquisition methods. According to Dryburgh, Profound heavily depends on browser extensions that capture conversations between users and chatbots. He likened this practice to notorious data collection scandals such as Onavo and Jumpshot, but with a deeper intrusion into users’ private dialogues.
Company’s Stance on Data Ethics and Compliance
In response, Profound’s representatives firmly denied any wrongdoing, emphasizing that all data utilized is obtained through explicit user opt-in and complies fully with stringent regulations like the European Union’s General Data Protection Regulation (GDPR) and the California Consumer Privacy Act (CCPA). The company dismissed the allegations as baseless, underscoring their commitment to ethical data practices.
The Shift from Traditional SEO to AI Optimization (AIO)
As AI-powered tools become increasingly integrated into consumer interactions, the landscape of search engine optimization (SEO) is evolving into what is now termed AI Optimization (AIO). Recent research from OpenAI highlights a growing trend where professionals leverage AI assistants like ChatGPT to support decision-making processes. This shift has expanded brand reputation management beyond conventional online platforms to include AI-driven environments.
Profound’s Promise and the Mystery of Its Data Sources
Profound offers companies a window into how they are represented within AI interactions. Yet, Dryburgh points out that the startup has not been transparent about its data origins. He suspects that some information may be sourced from Datos, a data aggregation service owned by Semrush. According to Dryburgh, Datos’ privacy policies permit data aggregation, anonymization, and sharing with partners for market research purposes. However, without cooperation from Profound, it remains unclear whether clickstream data is obtained directly from Datos or through specific browser extensions.
Alternative Data Channels and Their Implications
Another potential data source includes mobile applications on iOS and Android that interface with AI model APIs such as OpenAI’s. Despite this, Dryburgh argues that browser extensions provide richer, more valuable data over time, making them particularly attractive to marketers seeking insights into user behavior.
Industry Reactions and Privacy Concerns
Attempts to clarify the relationship between Datos, Semrush, and Profound have so far gone unanswered. Meanwhile, evidence suggests Datos has shown interest in chatbot data. Matt Frisbie, creator of the ChatGPT Assistant browser extension, revealed that Datos approached him with a proposal to collect anonymized clickstream data for resale to clients like business analysts and hedge funds. Frisbie declined the offer, highlighting a broader trend where developers of popular extensions are often solicited to monetize their access to sensitive user information.
Privacy Risks Posed by Browser Extensions
Browser extensions frequently request extensive permissions, such as the ability to “Read and change all your data on websites,” which can pose significant privacy threats. For instance, the Semrush AI Writer and Editor extension prompts users for such access. Security researcher Belejevas noted that many AI-related Chrome extensions request sensitive permissions like ‘activeTab’ and ‘scripting,’ enabling them to access active browser tabs and inject code into websites. These capabilities raise serious concerns about potential misuse and user privacy violations.
Regulatory Standards and Legal Challenges
While Profound maintains that its data collection methods are lawful and consensual, Dryburgh emphasizes that GDPR’s consent requirements are stringent. Consent must be freely given, specific, informed, and unambiguous-criteria that broad permission requests from browser extensions often fail to meet. Similarly, the CCPA mandates that users have the right to opt out of data sales or sharing, an option typically absent during extension installation. Dryburgh predicts that regulatory bodies will eventually impose stricter controls on the collection of clickstream data from AI interactions.
Legal Perspectives on Data Processing Practices
Alexander Hanff, managing director of privacy consultancy Hanff & Co. AB, highlights that GDPR’s Article 5 enshrines principles such as fairness, transparency, and purpose limitation. He warns that any lack of transparency in Profound’s data collection could render the processing of personal data unlawful. Furthermore, under the ePrivacy Directive (PECR), processing traffic data like TCP/IP and HTTP headers is generally prohibited except for specific telecommunications purposes, suggesting that Profound’s practices might face legal scrutiny in both the EU and UK.
Implications for Brands and the Future of AI Data Ethics
Beyond legal ramifications, Dryburgh points out that questionable data collection methods undermine the quality and reliability of insights brands seek when evaluating their presence in AI-driven conversations. He plans to delve deeper into these issues in an upcoming LinkedIn article, advocating for greater transparency and ethical standards in AI data analytics.
Additional Industry Developments
- Oracle reportedly needs to secure at least $25 billion annually to fund its AI ambitions.
- ChatGPT has raised concerns by requesting teenagers’ consent for parental monitoring.
- Former U.S. President Donald Trump has called for Microsoft to dismiss its global affairs chief.
- Consulting giant Accenture has warned employees that inability to utilize AI tools could jeopardize their positions.
