What term refers to any change in a subjects behavior caused by the awareness of being studied?

The Hawthorne effect is a term referring to the tendency of some people to work harder and perform better when they are participants in an experiment. The term is often used to suggest that individuals may change their behavior due to the attention they are receiving from researchers rather than because of any manipulation of independent variables.

The Hawthorne effect has been widely discussed in psychology textbooks, particularly those devoted to industrial and organizational psychology. However, research suggests that many of the original claims made about the effect may be overstated.

The Hawthorne effect was first described in the 1950s by researcher Henry A. Landsberger during his analysis of experiments conducted during the 1920s and 1930s. The phenomenon is named after the location where the experiments took place, Western Electric’s Hawthorne Works electric company just outside of Hawthorne, Illinois.

The electric company had commissioned research to determine if there was a relationship between productivity and work environments. The original purpose of the Hawthorne studies was to examine how different aspects of the work environment, such as lighting, the timing of breaks, and the length of the workday, had on worker productivity.

In the most famous of the experiments, the focus of the study was to determine if increasing or decreasing the amount of light that workers received would have an effect on how productive workers were during their shifts. In the original study, employee productivity seemed to increase due to the changes but then decreased once the experiment was over.

What the researchers in the original studies found was that almost any change to the experimental conditions led to increases in productivity. For example, productivity increased when illumination was decreased to the levels of candlelight, when breaks were eliminated entirely, and when the workday was lengthened.

The researchers concluded that workers were responding to the increased attention from supervisors. This suggested that productivity increased due to attention and not because of changes in the experimental variables.

Landsberger defined the Hawthorne effect as a short-term improvement in performance caused by observing workers. Researchers and managers quickly latched on to these findings. Later studies suggested, however, that these initial conclusions did not reflect what really happening.

The term Hawthorne effect remains widely in use to describe increases in productivity due to participation in a study, yet additional studies have often offered little support or have even failed to find the effect at all.

Later research into the Hawthorne effect suggested that the original results may have been overstated. In 2009, researchers at the University of Chicago reanalyzed the original data and found that other factors also played a role in productivity and that the effect originally described was weak at best.

Researchers also uncovered the original data from the Hawthorne studies and found that many of the later reported claims about the findings are simply not supported by the data. They did find, however, more subtle displays of a possible Hawthorne effect.

While some additional studies failed to find strong evidence of the Hawthorne effect, a 2014 systematic review published in the Journal of Clinical Epidemiology found that research participation effects do exist. After looking at the results of 19 different studies, the researchers concluded that these effects clearly happen, but more research needs to be done in order to determine how they work, the impact they have, and why they occur.

While the Hawthorne effect may have an influence on participant behavior in experiments, there may also be other factors that play a part in these changes. Some factors that may influence improvements in productivity include:

  • Demand characteristics: In experiments, researchers sometimes display subtle clues that let participants know what they are hoping to find. As a result, subjects will alter their behavior to help confirm the experimenter’s hypothesis.
  • Novelty effects: The novelty of having experimenters observing behavior might also play a role. This can lead to an initial increase in performance and productivity that may eventually level off as the experiment continues.
  • Performance feedback: In situations involving worker productivity, increased attention from experimenters also resulted in increased performance feedback. This increased feedback might actually lead to an improvement in productivity.

While the Hawthorne effect has often been overstated, the term is still useful as a general explanation for psychological factors that can affect how people behave in an experiment.

In order for researchers to trust the results of experiments, it is essential to minimize potential problems and sources of bias like the Hawthorne effect. So what can researchers do to minimize these effects in their experimental studies?

  • Conduct experiments in natural settings: One way to help eliminate or minimize demand characteristics and other potential sources of experimental bias is to utilize naturalistic observation techniques. However, this is simply not always possible.
  • Make responses completely anonymous: Another way to combat this form of bias is to make the participants' responses in an experiment completely anonymous or confidential. This way, participants may be less likely to alter their behavior as a result of taking part in an experiment.

Many of the original findings of the Hawthorne studies have since been found to be either overstated or erroneous, but the term has become widely used in psychology, economics, business, and other areas. More recent findings support the idea that these effects do happen, but how much of an impact they actually have on results remains in question. Today, the term is still often used to refer to changes in behavior that can result from taking part in an experiment.

The Hawthorne effect is a type of reactivity in which individuals modify an aspect of their behavior in response to their awareness of being observed.[1][2] The effect was discovered in the context of research conducted at the Hawthorne Western Electric plant; however, some scholars feel the descriptions are apocryphal.[3]

The original research involved workers who made electrical relays at the Hawthorne Works, a Western Electric plant in Cicero, Illinois. Between 1924 and 1927, the lighting study was conducted. Workers experienced a series of lighting changes in which productivity was said to increase with almost any change in the lighting. This turned out not to be true.[3] In the study that was associated with Elton Mayo, which ran from 1928 to 1932, a series of changes in work structure were implemented (e.g., changes in rest periods) in a group of five women. However, this was a methodologically poor, uncontrolled study that did not permit any firm conclusions to be drawn.[4]

One of the later interpretations by Landsberger suggested that the novelty of being research subjects and the increased attention from such could lead to temporary increases in workers' productivity.[5] This interpretation was dubbed "the Hawthorne effect".

 

Aerial view of the Hawthorne Works, ca. 1925

The term "Hawthorne effect" was coined in 1958 by Henry A. Landsberger[5] when he was analyzing the Hawthorne studies conducted between 1924 and 1932 at the Hawthorne Works (a Western Electric factory in Cicero, outside Chicago). The Hawthorne Works had commissioned a study to determine if its workers would become more productive in higher or lower levels of light. The workers' productivity seemed to improve when changes were made, and slumped when the study ended. It was suggested that the productivity gain occurred as a result of the motivational effect on the workers of the interest being shown in them.[6]

This effect was observed for minute increases in illumination. In these lighting studies, light intensity was altered to examine its effect on worker productivity. Most industrial or occupational psychology and organizational behavior textbooks refer to the illumination studies when discussing the Hawthorne effect.[7] Only occasionally are the rest of the studies mentioned.[7]

Although illumination research of workplace lighting formed the basis of the Hawthorne effect, other changes such as maintaining clean work stations, clearing floors of obstacles, and even relocating workstations resulted in increased productivity for short periods. Thus the term is used to identify any type of short-lived increase in productivity.[5][8][9]

Relay assembly experiments

In one of the studies, researchers chose two women as test subjects and asked them to choose four other workers to join the test group. Together the women worked in a separate room over the course of five years (1927–1932) assembling telephone relays.

Output was measured mechanically by counting how many finished relays each worker dropped down a chute. This measuring began in secret two weeks before moving the women to an experiment room and continued throughout the study. In the experiment room they had a supervisor who discussed changes with their productivity. Some of the variables were:

  • Giving two 5-minute breaks (after a discussion with them on the best length of time), and then changing to two 10-minute breaks (not their preference). Productivity increased, but when they received six 5-minute rests, they disliked it and reduced output.
  • Providing food during the breaks.
  • Shortening the day by 30 minutes (output went up); shortening it more (output per hour went up, but overall output decreased); returning to the first condition (where output peaked).

Changing a variable usually increased productivity, even if the variable was just a change back to the original condition. However, it is said that this is the natural process of the human being adapting to the environment, without knowing the objective of the experiment occurring. Researchers concluded that the workers worked harder because they thought that they were being monitored individually.

Researchers hypothesized that choosing one's own coworkers, working as a group, being treated as special (as evidenced by working in a separate room), and having a sympathetic supervisor were the real reasons for the productivity increase. One interpretation, mainly due to Elton Mayo,[10] was that "the six individuals became a team and the team gave itself wholeheartedly and spontaneously to cooperation in the experiment." (There was a second relay assembly test room study whose results were not as significant as the first experiment.)

Bank wiring room experiments

The purpose of the next study was to find out how payment incentives would affect productivity. The surprising result was that productivity actually decreased. Workers apparently had become suspicious that their productivity may have been boosted to justify firing some of the workers later on.[11] The study was conducted by Elton Mayo and W. Lloyd Warner between 1931 and 1932 on a group of fourteen men who put together telephone switching equipment. The researchers found that although the workers were paid according to individual productivity, productivity decreased because the men were afraid that the company would lower the base rate. Detailed observation of the men revealed the existence of informal groups or "cliques" within the formal groups. These cliques developed informal rules of behavior as well as mechanisms to enforce them. The cliques served to control group members and to manage bosses; when bosses asked questions, clique members gave the same responses, even if they were untrue. These results show that workers were more responsive to the social force of their peer groups than to the control and incentives of management.

Richard Nisbett has described the Hawthorne effect as "a glorified anecdote," saying that "once you have got the anecdote, you can throw away the data."[12] Other researchers have attempted to explain the effects with various interpretations. J. G. Adair warned of gross factual inaccuracy in most secondary publications on the Hawthorne effect and that many studies failed to find it.[13] He argued that it should be viewed as a variant of Orne's (1973) experimental demand effect. For Adair, the Hawthorne effect depended on the participants' interpretation of the situation. An implication is that manipulation checks are important in social sciences experiments. He advanced the view that awareness of being observed was not the source of the effect, but participants' interpretation of the situation is critical. How did the participants' interpretation of the situation interact with the participants' goals?

Possible explanations for the Hawthorne effect include the impact of feedback and motivation towards the experimenter. Receiving feedback on their performance may improve their skills when an experiment provides this feedback for the first time.[14] Research on the demand effect also suggests that people may be motivated to please the experimenter, at least if it does not conflict with any other motive.[15] They may also be suspicious of the purpose of the experimenter.[14] Therefore, Hawthorne effect may only occur when there is usable feedback or a change in motivation.

Parsons defined the Hawthorne effect as "the confounding that occurs if experimenters fail to realize how the consequences of subjects' performance affect what subjects do" [i.e. learning effects, both permanent skill improvement and feedback-enabled adjustments to suit current goals]. His key argument was that in the studies where workers dropped their finished goods down chutes, the participants had access to the counters of their work rate.[14]

Mayo contended that the effect was due to the workers reacting to the sympathy and interest of the observers. He did discuss the study as demonstrating an experimenter effect but as a management effect: how management can make workers perform differently because they feel differently. He suggested that much of the Hawthorne effect concerned the workers feeling free and in control as a group rather than as being supervised. The experimental manipulations were important in convincing the workers to feel this way, that conditions in the special five-person work group was really different from the conditions on the shop floor. The study was repeated with similar effects on mica-splitting workers.[10]

Clark and Sugrue in a review of educational research reported that uncontrolled novelty effects cause on average 30% of a standard deviation (SD) rise (i.e. 50–63% score rise), with the rise decaying to a much smaller effect after 8 weeks. In more detail: 50% of a SD for up to 4 weeks; 30% of SD for 5–8 weeks; and 20% of SD for > 8 weeks, (which is < 1% of the variance).[16]: 333 

Harry Braverman pointed out that the Hawthorne tests were based on industrial psychology and the researchers involved were investigating whether workers' performance could be predicted by pre-hire testing. The Hawthorne study showed "that the performance of workers had little relation to their ability and in fact often bore an inverse relation to test scores...".[17] Braverman argued that the studies really showed that the workplace was not "a system of bureaucratic formal organisation on the Weberian model, nor a system of informal group relations, as in the interpretation of Mayo and his followers but rather a system of power, of class antagonisms". This discovery was a blow to those hoping to apply the behavioral sciences to manipulate workers in the interest of management.[17]

The economists Steven Levitt and John A. List long pursued without success a search for the base data of the original illumination experiments (they were not true experiments but some authors labeled them experiments), before finding it in a microfilm at the University of Wisconsin in Milwaukee in 2011.[18] Re-analysing it, they found slight evidence for the Hawthorne effect over the long-run, but in no way as drastic as suggested initially.[19] This finding supported the analysis of an article by S R G Jones in 1992 examining the relay experiments.[20][21] Despite the absence of evidence for the Hawthorne effect in the original study, List has said that he remains confident that the effect is genuine.[22]

Gustav Wickström and Tom Bendix (2000) argue that the supposed "Hawthorne effect" is actually ambiguous and disputable, and instead recommend that to evaluate intervention effectiveness, researchers should introduce specific psychological and social variables that may have affected the outcome.[23]

It is also possible that the illumination experiments can be explained by a longitudinal learning effect. Parsons has declined to analyse the illumination experiments, on the grounds that they have not been properly published and so he cannot get at details, whereas he had extensive personal communication with Roethlisberger and Dickson.[14]

Evaluation of the Hawthorne effect continues in the present day.[24][25][26][27] Despite the criticisms, however, the phenomenon is often taken into account when designing studies and their conclusions.[28] Some have also developed ways to avoid it. For instance, there is the case of holding the observation when conducting a field study from a distance, from behind a barrier such as a two-way mirror or using an unobtrusive measure.[29]

Greenwood, Bolton, and Greenwood (1983) interviewed some of the participants in the experiments and found that the participants were paid significantly better.[30]

Various medical scientists have studied possible trial effect (clinical trial effect) in clinical trials.[31][32][33] Some postulate that, beyond just attention and observation, there may be other factors involved, such as slightly better care; slightly better compliance/adherence; and selection bias. The latter may have several mechanisms: (1) Physicians may tend to recruit patients who seem to have better adherence potential and lesser likelihood of future loss to follow-up. (2) The inclusion/exclusion criteria of trials often exclude at least some comorbidities; although this is often necessary to prevent confounding, it also means that trials may tend to work with healthier patient subpopulations.

Despite the observer effect as popularized in the Hawthorne experiments being perhaps falsely identified (see above discussion), the popularity and plausibility of the observer effect in theory has led researchers to postulate that this effect could take place at a second level. Thus it has been proposed that there is a secondary observer effect when researchers working with secondary data such as survey data or various indicators may impact the results of their scientific research. Rather than having an effect on the subjects (as with the primary observer effect), the researchers likely have their own idiosyncrasies that influence how they handle the data and even what data they obtain from secondary sources. For one, the researchers may choose seemingly innocuous steps in their statistical analyses that end up causing significantly different results using the same data; e.g., weighting strategies, factor analytic techniques, or choice of estimation. In addition, researchers may use software packages that have different default settings that lead to small but significant fluctuations. Finally, the data that researchers use may not be identical, even though it seems so. For example, the OECD collects and distributes various socio-economic data; however, these data change over time such that a researcher who downloads the Australian GDP data for the year 2000 may have slightly different values than a researcher who downloads the same Australian GDP 2000 data a few years later. The idea of the secondary observer effect was floated by Nate Breznau in a thus far relatively obscure paper.[34]

Although little attention has been paid to this phenomenon, the scientific implications are very large.[35] Evidence of this effect may be seen in recent studies that assign a particular problem to a number of researchers or research teams who then work independently using the same data to try and find a solution. This is a process called crowdsourcing data analysis and was used in a groundbreaking study by Silberzahn, Rafael, Eric Uhlmann, Dan Martin and Brian Nosek et al. (2015) about red cards and player race in football (i.e., soccer).[36][37]

  • Barnum effect
  • Demand characteristics
  • Goodhart's law
  • John Henry effect
  • Mass surveillance
  • Novelty effect
  • Panopticism
  • Placebo effect
  • Pygmalion effect
  • Quantum Zeno effect
  • Reflexivity (social theory)
  • Self-determination theory
  • Social facilitation
  • Stereotype threat
  • Subject-expectancy effect
  • Watching-eye effect

  1. ^ McCarney R, Warner J, Iliffe S, van Haselen R, Griffin M, Fisher P (2007). "The Hawthorne Effect: a randomised, controlled trial". BMC Med Res Methodol. 7: 30. doi:10.1186/1471-2288-7-30. PMC 1936999. PMID 17608932.
  2. ^ Fox NS, Brennan JS, Chasen ST (2008). "Clinical estimation of fetal weight and the Hawthorne effect". Eur. J. Obstet. Gynecol. Reprod. Biol. 141 (2): 111–114. doi:10.1016/j.ejogrb.2008.07.023. PMID 18771841.
  3. ^ a b Levitt, S. D.; List, J. A. (2011). "Was there really a Hawthorne effect at the Hawthorne plant? An analysis of the original illumination experiments" (PDF). American Economic Journal: Applied Economics. 3: 224–238. doi:10.1257/app.3.1.224.
  4. ^ Schonfeld, I. S.; Chang, C.-H. (2017). Occupational health psychology: Work, stress, and health. New York: Springer. ISBN 978-0-8261-9967-6.
  5. ^ a b c Landsberger, H. A. (1958). Hawthorne Revisited. Ithaca. OCLC 61637839.
  6. ^ Cox, Erika (2000). Psychology for AS Level. Oxford: Oxford University Press. p. 158. ISBN 0198328249.
  7. ^ a b Olson, R.; Verley, J.; Santos, L.; Salas, C. (2004). "What We Teach Students About the Hawthorne Studies: A Review of Content Within a Sample of Introductory I-O and OB Textbooks" (PDF). The Industrial-Organizational Psychologist. 41: 23–39. Archived from the original (PDF) on 2011-11-03.
  8. ^ Elton Mayo, Hawthorne and the Western Electric Company, The Social Problems of an Industrial Civilisation, Routledge, 1949.
  9. ^ Bowey, Dr. Angela M. "Motivation at Work: a key issue in remuneration". Archived from the original on 1 July 2007. Retrieved 22 November 2011.{{cite web}}: CS1 maint: bot: original URL status unknown (link)
  10. ^ a b Mayo, Elton (1945) Social Problems of an Industrial Civilization. Boston: Division of Research, Graduate School of Business Administration, Harvard University, p. 72
  11. ^ Henslin, James M. (2008). Sociology: a down to earth approach (9th ed.). Pearson Education. p. 140. ISBN 978-0-205-57023-2.
  12. ^ Kolata, G. (December 6, 1998). "Scientific Myths That Are Too Good to Die". New York Times.
  13. ^ Adair, J.G. (1984). "The Hawthorne Effect: A reconsideration of the methodological artifact" (PDF). Journal of Applied Psychology. 69 (2): 334–345. doi:10.1037/0021-9010.69.2.334. Archived from the original (PDF) on 2013-12-15. Retrieved 2013-12-12.
  14. ^ a b c d Parsons, H. M. (1974). "What happened at Hawthorne?: New evidence suggests the Hawthorne effect resulted from operant reinforcement contingencies". Science. 183 (4128): 922–932. doi:10.1126/science.183.4128.922. PMID 17756742. S2CID 38816592.
  15. ^ Steele-Johnson, D.; Beauregard, Russell S.; Hoover, Paul B.; Schmidt, Aaron M. (2000). "Goal orientation and task demand effects on motivation, affect, and performance". The Journal of Applied Psychology. 85 (5): 724–738. doi:10.1037/0021-9010.85.5.724. PMID 11055145.
  16. ^ Clark, Richard E.; Sugrue, Brenda M. (1991). "30. Research on instructional media, 1978–1988". In G.J.Anglin (ed.). Instructional technology: past, present, and future. Englewood, Colorado: Libraries Unlimited. pp. 327–343.
  17. ^ a b Braverman, Harry (1974). Labor and Monopoly Capitalism. New York: Monthly Review Press. pp. 144–145. ISBN 978-0853453406.
  18. ^ BBC Radio 4 programme More Or Less, "The Hawthorne Effect", broadcast 12 October 2013, presented by Tim Harford with contributions by John List
  19. ^ Levitt, Steven D.; List, John A. (2011). "Was There Really a Hawthorne Effect at the Hawthorne Plant? An Analysis of the Original Illumination Experiments" (PDF). American Economic Journal: Applied Economics. 3 (1): 224–238. doi:10.1257/app.3.1.224. S2CID 16678444.
  20. ^ "Light work". The Economist. June 6, 2009. p. 80.
  21. ^ Jones, Stephen R. G. (1992). "Was there a Hawthorne effect?" (PDF). American Journal of Sociology. 98 (3): 451–468. doi:10.1086/230046. JSTOR 2781455. S2CID 145357472.
  22. ^ Podcast, More or Less 12 October 2013, from 6m 15 sec in
  23. ^ Wickström, Gustav; Bendix, Tom (2000). "The "Hawthorne effect" – what did the original Hawthorne studies actually show?". Scandinavian Journal of Work, Environment & Health. Scandinavian Journal of Work, Environment and Health. 26 (4): 363–367. doi:10.5271/sjweh.555.
  24. ^ Kohli E, Ptak J, Smith R, Taylor E, Talbot EA, Kirkland KB (2009). "Variability in the Hawthorne effect with regard to hand hygiene performance in high- and low-performing inpatient care units". Infect Control Hosp Epidemiol. 30 (3): 222–225. doi:10.1086/595692. PMID 19199530. S2CID 19058173.
  25. ^ Cocco G (2009). "Erectile dysfunction after therapy with metoprolol: the hawthorne effect". Cardiology. 112 (3): 174–177. doi:10.1159/000147951. PMID 18654082. S2CID 41426273.
  26. ^ Leonard KL (2008). "Is patient satisfaction sensitive to changes in the quality of care? An exploitation of the Hawthorne effect". J Health Econ. 27 (2): 444–459. doi:10.1016/j.jhealeco.2007.07.004. PMID 18192043.
  27. ^ "What is Hawthorne Effect?". MBA Learner. 2018-02-22. Archived from the original on 2018-02-26. Retrieved 2018-02-25.
  28. ^ Salkind, Neil (2010). Encyclopedia of Research Design, Volume 2. Thousand Oaks, CA: Sage Publications, Inc. p. 561. ISBN 978-1412961271.
  29. ^ Kirby, Mark; Kidd, Warren; Koubel, Francine; Barter, John; Hope, Tanya; Kirton, Alison; Madry, Nick; Manning, Paul; Triggs, Karen (2000). Sociology in Perspective. Oxford: Heinemann. pp. G-359. ISBN 978-0435331603.
  30. ^ Greenwood, Ronald G.; Bolton, Alfred A.; Greenwood, Regina A. (1983). "Hawthorne a Half Century Later: Relay Assembly Participants Remember". Journal of Management. 9 (2): 217–231. doi:10.1177/014920638300900213. S2CID 145767422.
  31. ^ Menezes P, Miller WC, Wohl DA, Adimora AA, Leone PA, Eron JJ (2011), "Does HAART efficacy translate to effectiveness? Evidence for a trial effect", PLoS ONE, 6 (7): e21824, Bibcode:2011PLoSO...621824M, doi:10.1371/journal.pone.0021824, PMC 3135599, PMID 21765918.
  32. ^ Braunholtz DA, Edwards SJ, Lilford RJ (2001), "Are randomized clinical trials good for us (in the short term)? Evidence for a "trial effect"", J Clin Epidemiol, 54 (3): 217–224, doi:10.1016/s0895-4356(00)00305-x, PMID 11223318.
  33. ^ McCarney R, Warner J, Iliffe S, van Haselen R, Griffin M, Fisher P (2007), "The Hawthorne Effect: a randomised, controlled trial", BMC Medical Research Methodology, 7: 30, doi:10.1186/1471-2288-7-30, PMC 1936999, PMID 17608932.
  34. ^ Breznau, Nate (2016-05-03). "Secondary observer effects: idiosyncratic errors in small-N secondary data analysis". International Journal of Social Research Methodology. 19 (3): 301–318. doi:10.1080/13645579.2014.1001221. ISSN 1364-5579. S2CID 145402768.
  35. ^ Shi, Yuan; Sorenson, Olav; Waguespack, David (2017-01-30). "Temporal Issues in Replication: The Stability of Centrality-Based Advantage". Sociological Science. 4: 107–122. doi:10.15195/v4.a5. ISSN 2330-6696.
  36. ^ Silberzahn, Raphael; Uhlmann, Eric L.; Martin, Daniel P.; Nosek, Brian A.; et al. (2015). "Many analysts, one dataset: Making transparent how variations in analytical choices affect". OSF.io. Retrieved 2016-12-07.
  37. ^ "Crowdsourcing Data to Improve Macro-Comparative Research". Policy and Politics Journal. 2015-03-26. Retrieved 2016-12-07.

  • Ciment, Shoshy. “Costco Is Offering an Additional $2 an Hour to Its Hourly Employees across the US as the Coronavirus Outbreak Causes Massive Shopping Surges.” Business Insider, Business Insider, 23 Mar. 2020, www.businessinsider.com/costco-pays-workers-2-dollars-an-hour-more-coronavirus-2020-3.
  • Miller, Katherine, and Joshua Barbour. Organizational Communication: Approaches and Processes 7th Edition. Cengage Learning, 2014.
  • Evan Davis on the Hawthorne Effect, OpenLearn from The Open University
  • The Hawthorne, Pygmalion, placebo and other expectancy effects: some notes, by Stephen W. Draper, Department of Psychology, University of Glasgow.
  • BBC Radio 4: Mind Changers: The Hawthorne Effect
  • Harvard Business School and the Hawthorne Experiments (1924–1933), Harvard Business School.

Retrieved from "//en.wikipedia.org/w/index.php?title=Hawthorne_effect&oldid=1093472124"

Toplist

Latest post

TAGs