Tag Archives: trust

More about the eBay feedback model and trust metrics attacks

My last post reminded myself of some paragraphs I wrote in a paper some time ago. I know my writing ability is not comparable to Shakespeare’s one but maybe you find some interesting information in this passage from A Survey of Trust Use and Modeling in Current Real Systems reported below:

EBay’s feedback ecology is a large and realistic example of a technology mediated market. The advantage of this is that a large amount of data about users’ interactions and behaviors can be recorded in a digital format and can be studied. In fact, there have been many studies on eBay and in particular on how the feedback system influences the market, see for example (Resnick and Zeckhauser, 2002). A very interesting observation is related to the distribution of feedback values: “Of feedback provided by buyers, 0.6% of comments were negative, 0.3% were neutral, and 99.1% were positive” (Resnick and Zeckhauser, 2002). This disproportion of positive feedbacks suggests two considerations: the first is actually a challenge and consists of verifying if these opinions are to be considered realistic or distorted by the interaction with the media and the interface. We will discuss this point later in Section 3. The second is about possible weaknesses of the eBay model. The main weakness of this approach is that it considers the feedback of every user with the same weight, and this could be exploited by the malicious user. Since on eBay there are so few negative feedbacks, a user with just few negative feedbacks is seen as highly suspicious and it is very likely nobody will risk into engaging in a commercial transaction with her. Moreover, having an established and reputable identity helps a lot the business activity. A controlled experiment on eBay (Resnick et al., 2003) found that an high reputation identity is able to get a selling price 7.6% higher than a newcomer identity with little reputation. For this reason, there are users who threaten to leave a negative feedback (and therefore destroy the other user’s reputation) unless they get a discount on their purchase.
This activity is called “feedback extortion” on eBay’s help pages (“EBay help: Feedback extortion”, n.d.) and in a November 2004 survey (Steiner, 2004) 38% of the total respondents stated that they had “received retaliatory feedback within the prior 6 months, had been victimized by feedback extortion, or both“.
These users are “attacking” the system: as eBay’s help page puts it “Feedback is the foundation of trust on eBay. Using eBay feedback to attempt to extort goods or services from another member undermines the integrity of the feedback system” (“EBay help: Feedback extortion”, n.d.). The system could defend itself by weighting in different ways the feedback of different users. For example, if Alice has been directly threatened by CoolJohn12 and thinks the feedback provided by him is not reliable, his feedback about other users should not be taken into account when
computing the trust Alice could place in the other users. In fact, a possible way to overcome this problem is to use Local Trust Metric (Massa and Avesani, 2005, Ziegler and Lausen, 2004), that considers only (or mainly) trust statements given by users trusted by the active user and not all the trust statements with the same, undifferentiated weight. In this way, receiving negative feedback from CoolJohn12 does not influence reputations as seen by the active user if the active user does not trust explicitly CoolJohn12. For a short discussion of Global and Local Trust Metrics, see Section 3. However, eBay at the moment uses the Global Trust Metric we described before, which is very simple. This simplicity is surely an advantage because it is easy for users to understand it and the big success of eBay is also due to the fact users easily understand how the system works and hence trust it (note that the meaning of “to trust” here means “to consider reliable and predictable an artifact” and not, as elsewhere on this chapter, “to put some degree of trust in another user”). Nevertheless, in November 2004, a survey on eBay’s feedback system (Steiner, 2004) found that only 3% of the respondents found it excellent, 19% felt the system was very good, 39% thought it was adequate and 39% thought eBay’s feedback system was fair or poor. These results are even more interesting when compared with numbers from a January 2003 identical survey. The portion of “excellent” went from 7% to 3%, the “very good” from 29% to 19%, the “adequate” from 35% to 39%, the “fair or poor” from 29% to 39%. Moreover, the portion of total respondents who stated that they had received retaliatory feedback within the prior 6 months passed from 27% of 2003 survey to 38% of 2004 survey. These shifts seem to suggest that the time might have come for more sophisticated (and, as a consequence, more complicated to understand) Trust Metrics.

Bibliography for this portion:
– Resnick, P., & Zeckhauser, R. (2002). Trust Among Strangers in Internet Transactions: Empirical Analysis of eBay’s Reputation System. The Economics of the Internet and Ecommerce. Advances in Applied Microeconomics, 11.
– Resnick, P., & Zeckhauser, R., & Swanson, J., & Lockwood, K. (2003). The value of reputation on eBay: A controlled experiment.
– eBay help: Feedback extortion. (n.d.) Retrieved December 28, 2005, from http://pages.ebay.co.uk/help/policies/feedback-extortion.html
– Steiner, D. (2004). Auctionbytes survey results: Your feedback on eBay’s feedback system. Retrieved December 28, 2005, from http://www.auctionbytes.com/cab/abu/y204/m11/abu0131/s02
– Massa, P., & Avesani, P. (2005). Controversial users demand local Trust Metrics: an experimental study on Epinions.com community. In Proceedings of 25th AAAI Conference.
– Ziegler, C., & Lausen, G. (2004). Spreading activation models for trust propagation. In IEEE International Conference on e-Technology, e-Commerce, and e-Service (EEE’04).

You can buy a positive feedback on eBay for 29 cents, so how much is it worth?

There is an interesting paper from John Morgan and Jennifer Brown of Berkeley which analyzes the Illicit “market for trust” on eBay. They onserved how on eBay there are a lot of listings with a Buy-It-Now option and a price of 1 penny. A Buy-It-Now sale for 1 cent automatically results in the seller losing 29 cents because eBay charges a 25-cent listing fee and 5 cents for the Buy-It-Now option. So, why should I sell something for 1 cent if this means I’m going to lose 29 cents? Well, basically I’m buying a positive feedback and paying it 29 cents. It is very interesting to note that the item being sold is actually a 1-cent “Free positive feedback ebook and recipe no shipping” which advised buying 100 different items on eBay that cost almost nothing in order to “get your feedback score up to 100 in just a few days.”
Free positive feedback ebook and recipe no shipping image.
(the image is from the same authors paper “Reputation in Online Markets: Some Negative Feedback”).
Does such a listing make sense? Well, it depends. The article goes on saying that the sellers, after getting a wonderful reputation, are probably going to move in very profitable markets such as selling cars or lands. For example, the authors found one particular seller, whom they dubbed the landseller, who had accumulated hundreds of feedback points by posting 304 offers for feedback enhancement on eBay (and losing $87.64). Then, after his feedback rating reached 598, the landseller went on to try to sell several parcels of undeveloped land in the southern U.S. on eBay.
This is one more example of a trust metric attack: every time someone provide a system based on reputation, some people will try to fool and attack it. No system is totally attack resistant. And this is uber interesting.