“"We consider the scenario where a user is looking for recommendations for affordable coffee machines. The LLM prompt consists of three main components: the system prompt, the product information extracted from the knowledge base (list of coffee machines), and the user query. The system prompt sets the context of the conversation and controls the behavior …”
Manipulating Large Language Models to Increase Product Visibility
Large language models (LLMs) are increasingly being integrated into search engines to provide natural language responses tailored to user queries. Customers and end-users are also becoming more dependent on these models for quick and easy purchase decisions. In this work, we investigate whether recommendations from LLMs can be manipulated to enhance a product's visibility. We demonstrate that adding a strategic text sequence (STS) -- a carefully crafted message -- to a product's information page can significantly increase its likelihood of being listed as the LLM's top recommendation. To understand the impact of STS, we use a catalog of fictitious coffee machines and analyze its effect on two target products: one that seldom appears in the LLM's recommendations and another that usually ranks second. We observe that the strategic text sequence significantly enhances the visibility of both products by increasing their chances of appearing as the top recommendation. This ability to manipulate LLM-generated search responses provides vendors with a considerable competitive advantage and has the potential to disrupt fair market competition. Just as search engine optimization (SEO) revolutionized how webpages are customized to rank higher in search engine results, influencing LLM recommendations could profoundly impact content optimization for AI-driven search services. Code for our experiments is available at https://github.com/aounon/llm-rank-optimizer.
候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。
HN 书评
没有评论直接链到它;下面是它被提交的讨论串里回复最多的评论(不计入统计)“I was using Claude the other day and I was asking it like what LLMs support a certain functionality. It said OpenAI, myself (Claude) and Groq etc. I then asked it to give me an example of how it could be used (vague, I didn't specify what LLM) and the example it gave me was for OpenAI. I thought that was kinda refreshing.”
- Manipulating Large Language Models to Increase Product Visibility ↗gjvc · 2024-04-13 · 2 分
- Manipulating Large Language Models to Increase Product Visibility ↗fauigerzigerk · 2024-04-25 · 2 分
- Manipulating large language models to increase product visibility ↗bookofjoe · 2024-09-06 · 45 分