Bots on Amazon’s task service may be souring psych studies

» Top New Products

Diabetes Freedom At The Age Of 60
cs_image_0

Learn  How  A  Grandfather  Melts  44  Lbs  And  Fixes  Blood  Sugar  With  This  Unlikely  Diet  Hack                         

$37.00
Tiny House Made Easy
cs_image_1

How  to  Build  a  Tiny  House  Easily,  Cheaply  and  in  Just  Days                                                                                   

$47.00
Georgia Fishing Guide
cs_image_2

Get  Your  complete  guide  to  fishing  in  the  waters  of  Unicoi  State  Park  And  Enjoy  Fishing  By  Your  Own 

$9.50
Mountain Driving Guide
cs_image_3

Learn  the  locations  and  descriptions  of  over  400  mountain  passes  in  eleven  western  states.                   

$17.00
200+ Bicycle Repair Videos
cs_image_4

Learn  How  To  Fix    and    Maintain  Your  Bike  With  Over  200  Step-by-step  Videos                                                 

$47.00
Divorce Advice for Women
cs_image_5

The  Divorce  Survival  Guide  for  Women.  Helps  them  intelligently  prepare  for  divorce.                                 

$19.95
The Bonus Bagging Loophole
cs_image_6

Make  Money  Online  Using  Our  Bonus  Bagging  System                                                                                                       

$27.00
SaleHoo Wholesale Directory
cs_image_7

Find  Trusted,  Reliable  Sources  for  Wholesale    and    Dropship  Products                                                               

$67.00
How To Declutter Your Home
cs_image_8

Discover  The  Joy  And  Power  Of  Order.                                                                                                                               

$14.77
Drawing video course
cs_image_9

Course  is  been  developed  to  accelerate  learning  by  teaching  to  different  learning  styles.                     

$30.00
BBQ recipes
cs_image_10

Competition  BBQ  secrets  reveals  professional  barbecue  recipes,competition  ribs  etc.                                 

$29.95
Feel Emotional Freedom
cs_image_11

Discover  Emotional  Freedom  Techniques  Which  Releases  Stress,  Heal  Your  Heart    and    Master  Your  Mind.

$19.00

It’s not uncommon for scientists to use Amazon’s Mechanical Turk for research — they can quickly gather survey data in return for a small outlay to participants. Academics are quickly discovering the limits of the task service with the modern bot-happy internet, however. Numerous psychology researchers have reported a sharp rise in the number of junk responses to their questions, many of which appear to come from bots. The offenders not only spam nonsensical answers to questions (such as “nice” or “good”), but tend to originate from the same location. And while anti-bot measures like captchas are in use, they aren’t always reliable.

There’s a chance that these could be people copying and pasting text, or using some form of automation to find the surveys (which Amazon allows). However, Amazon wouldn’t provide evidence one way or the other. The company told Wired in a statement that it had “automated and manual mechanisms” to fight bots, but it wouldn’t comment on bot activity levels or specific incidents.

Whatever the cause, the psychology study problems underscore deeper issues with Mechanical Turk. Bots are a reality on the service, and Amazon doesn’t always appear to acknowledge them even after multiple reports. And then there’s Mechanical Turk’s low per-task pay. While that can help scientists worried that large rewards could skew results, it encourages completing tasks en masse rather than providing high-quality answers. It may be increasingly difficult to conduct meaningful surveys on Amazon’s service, at least without tossing out many of the responses.

Via: Wired, New Scientist

Source: (Max) Hui Bai

Post Author: martin

Avatar
Martin is an enthusiastic programmer, a webdeveloper and a young entrepreneur. He is intereted into computers for a long time. In the age of 10 he has programmed his first website and since then he has been working on web technologies until now. He is the Founder and Editor-in-Chief of BriefNews.eu and PCHealthBoost.info Online Magazines. His colleagues appreciate him as a passionate workhorse, a fan of new technologies, an eternal optimist and a dreamer, but especially the soul of the team for whom he can do anything in the world.

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.