Initial Business Response / [redacted] (1000, 11, 2015/03/31) */ Customers license the CrowdFlower platform to post discreet online tasks to Contributors around the worldThousands of tasks are posted to tens of thousands of Contributors daily and these Contributors get paid for each individual task they complete In order for our Customers to guarantee that they are receiving quality work from Contributors, our platform enables our Customers to utilize a variety of quality control mechanismsOne such mechanism is to seed the task with "known answers" (Test Questions), which are designed to verify that a Contributor is following the instructions and thus completing the task properlyIf a Contributor's accuracy when answering these Test Questions falls below a certain threshold, they are expelled from the task and can no longer work on itThey are still paid for the work completed before their accuracy fell below that threshold CrowdFlower provides guidance and training to Customers regarding the best practices for setting up a task and providing clear instruction to the Contributor as to how to successfully complete the taskThis includes some training as to how to set up Test QuestionsProper application of this training, however, will certainly vary by CustomerAs a result, CrowdFlower has set up a very accessible dispute system for Contributors to alert the CrowdFlower Contributor Support Team of any perceived unfairness in the application of Test Questions or any other quality control mechanismBecause we know that a Contributor's success on Test Questions has bearing on their access to Tasks, we make it very easy for a Contributor to submit a dispute and we try to properly resolve them as quickly as possibleThe Support Team frequently corrects accuracy for Contributors on Test Questions that were either unfair or did not properly account for all correct answersThe Support Team, however, does set some thresholds for when a Test Question dispute will be manually reviewedThese thresholds include the percentage of other Contributors who also missed the Test Question being disputedIf the Test Question is missed by a relatively high percentage of Contributors it will be reviewedIf it is not missed by a relatively high percentage of Contributors it will not be reviewed initiallyWith every response in the latter case, however, we do indicate that if the Contributor did provide a strong case for why their answers should be considered correct they are welcome to reopen their support ticket by responding with "REOPEN TICKET" and their ticket will absolutely be reviewed by a member of the Support Team Regarding the specific task mentioned by this Contributor (Job ID: XXXXXX), in the instructions the Customer requested that the Contributor search for a variety of business names on the website www.offers.com and indicate whether that business had a presence on the siteFor each Test Question missed and disputed the Contributor had indicated that they were able to find a presence for those businesses on the websiteThe Customer, on the other hand, had selected that their was no presence for those businesses on that website and thus the Contributor was considered incorrectIn their support ticket (XXXXXX) the Contributor provided what they concluded were the links for the businesses on www.offers.com as evidence that those businesses had a presence on the site Those links are provided belowAt the time of writing this response, if one visits any of the links below one receives the following error message "404: Page not found." This indicates that the webpage does not exist, which means it is reasonable to conclude that the businesses are not present on www.offers.comAs a result, it would appear that the Contributor did not provide the correct answers in this task and thus the Customer (task maker) was not intentionally acting unfairly There is a chance that the website is dynamic in a way in that certain pages only exist when content is 'active.' In this case the Customer could have created the Test Questions when content for those businesses WAS NOT active while the Contributor encountered the Test Questions when content for those businesses WAS activeThe Support Team will review if this is the case and make any updates to the Contributor's account accordingly QualitySmith http://www.offers.com/ [redacted] / 2: Brighter Blooms Nursery http://www.offers.com/ [redacted] / 3: Chefwear http://www.offers.com/ [redacted] / 4: Hair Wig Harlem http://www.offers.com/ [redacted] / 5: Woolly Pocket http://www.offers.com/w [redacted] / 6: MegaMacs http://www.offers.com/ [redacted] / 7: AirRattle http://www.offers.com/ [redacted] / 8: Glamour Kills http://www.offers.com/ [redacted] / 9: eHobby Asia http://www.offers.com/ [redacted] / Initial Consumer Rebuttal / [redacted] (2000, 13, 2015/04/01) */ (The consumer indicated he/she ACCEPTED the response from the business.) I hope they really review this!
Initial Business Response /* (1000, 11, 2015/03/31) */
Customers license the CrowdFlower platform to post discreet online tasks to Contributors around the world. Thousands of tasks are posted to tens of thousands of Contributors daily and these Contributors get paid for each individual task...
they complete.
In order for our Customers to guarantee that they are receiving quality work from Contributors, our platform enables our Customers to utilize a variety of quality control mechanisms. One such mechanism is to seed the task with "known answers" (Test Questions), which are designed to verify that a Contributor is following the instructions and thus completing the task properly. If a Contributor's accuracy when answering these Test Questions falls below a certain threshold, they are expelled from the task and can no longer work on it. They are still paid for the work completed before their accuracy fell below that threshold.
CrowdFlower provides guidance and training to Customers regarding the best practices for setting up a task and providing clear instruction to the Contributor as to how to successfully complete the task. This includes some training as to how to set up Test Questions. Proper application of this training, however, will certainly vary by Customer. As a result, CrowdFlower has set up a very accessible dispute system for Contributors to alert the CrowdFlower Contributor Support Team of any perceived unfairness in the application of Test Questions or any other quality control mechanism. Because we know that a Contributor's success on Test Questions has bearing on their access to Tasks, we make it very easy for a Contributor to submit a dispute and we try to properly resolve them as quickly as possible. The Support Team frequently corrects accuracy for Contributors on Test Questions that were either unfair or did not properly account for all correct answers. The Support Team, however, does set some thresholds for when a Test Question dispute will be manually reviewed. These thresholds include the percentage of other Contributors who also missed the Test Question being disputed. If the Test Question is missed by a relatively high percentage of Contributors it will be reviewed. If it is not missed by a relatively high percentage of Contributors it will not be reviewed initially. With every response in the latter case, however, we do indicate that if the Contributor did provide a strong case for why their answers should be considered correct they are welcome to reopen their support ticket by responding with "REOPEN TICKET" and their ticket will absolutely be reviewed by a member of the Support Team.
Regarding the specific task mentioned by this Contributor (Job ID: XXXXXX), in the instructions the Customer requested that the Contributor search for a variety of business names on the website www.offers.com and indicate whether that business had a presence on the site. For each Test Question missed and disputed the Contributor had indicated that they were able to find a presence for those businesses on the website. The Customer, on the other hand, had selected that their was no presence for those businesses on that website and thus the Contributor was considered incorrect. In their support ticket (XXXXXX) the Contributor provided what they concluded were the links for the businesses on www.offers.com as evidence that those businesses had a presence on the site.
Those links are provided below. At the time of writing this response, if one visits any of the links below one receives the following error message "404: Page not found." This indicates that the webpage does not exist, which means it is reasonable to conclude that the businesses are not present on www.offers.com. As a result, it would appear that the Contributor did not provide the correct answers in this task and thus the Customer (task maker) was not intentionally acting unfairly.
There is a chance that the website is dynamic in a way in that certain pages only exist when content is 'active.' In this case the Customer could have created the Test Questions when content for those businesses WAS NOT active while the Contributor encountered the Test Questions when content for those businesses WAS active. The Support Team will review if this is the case and make any updates to the Contributor's account accordingly.
1. QualitySmith
http://www.offers.com/[redacted]/
2: Brighter Blooms Nursery
http://www.offers.com/[redacted]/
3: Chefwear
http://www.offers.com/[redacted]/
4: Hair Wig Harlem
http://www.offers.com/[redacted]/
5: Woolly Pocket
http://www.offers.com/w[redacted]/
6: MegaMacs
http://www.offers.com/[redacted]/
7: AirRattle
http://www.offers.com/[redacted]/
8: Glamour Kills
http://www.offers.com/[redacted]/
9: eHobby Asia
http://www.offers.com/[redacted]/
Initial Consumer Rebuttal /* (2000, 13, 2015/04/01) */
(The consumer indicated he/she ACCEPTED the response from the business.)
I hope they really review this!
Initial Business Response / [redacted] (1000, 11, 2015/03/31) */ Customers license the CrowdFlower platform to post discreet online tasks to Contributors around the worldThousands of tasks are posted to tens of thousands of Contributors daily and these Contributors get paid for each individual task they complete In order for our Customers to guarantee that they are receiving quality work from Contributors, our platform enables our Customers to utilize a variety of quality control mechanismsOne such mechanism is to seed the task with "known answers" (Test Questions), which are designed to verify that a Contributor is following the instructions and thus completing the task properlyIf a Contributor's accuracy when answering these Test Questions falls below a certain threshold, they are expelled from the task and can no longer work on itThey are still paid for the work completed before their accuracy fell below that threshold CrowdFlower provides guidance and training to Customers regarding the best practices for setting up a task and providing clear instruction to the Contributor as to how to successfully complete the taskThis includes some training as to how to set up Test QuestionsProper application of this training, however, will certainly vary by CustomerAs a result, CrowdFlower has set up a very accessible dispute system for Contributors to alert the CrowdFlower Contributor Support Team of any perceived unfairness in the application of Test Questions or any other quality control mechanismBecause we know that a Contributor's success on Test Questions has bearing on their access to Tasks, we make it very easy for a Contributor to submit a dispute and we try to properly resolve them as quickly as possibleThe Support Team frequently corrects accuracy for Contributors on Test Questions that were either unfair or did not properly account for all correct answersThe Support Team, however, does set some thresholds for when a Test Question dispute will be manually reviewedThese thresholds include the percentage of other Contributors who also missed the Test Question being disputedIf the Test Question is missed by a relatively high percentage of Contributors it will be reviewedIf it is not missed by a relatively high percentage of Contributors it will not be reviewed initiallyWith every response in the latter case, however, we do indicate that if the Contributor did provide a strong case for why their answers should be considered correct they are welcome to reopen their support ticket by responding with "REOPEN TICKET" and their ticket will absolutely be reviewed by a member of the Support Team Regarding the specific task mentioned by this Contributor (Job ID: XXXXXX), in the instructions the Customer requested that the Contributor search for a variety of business names on the website www.offers.com and indicate whether that business had a presence on the siteFor each Test Question missed and disputed the Contributor had indicated that they were able to find a presence for those businesses on the websiteThe Customer, on the other hand, had selected that their was no presence for those businesses on that website and thus the Contributor was considered incorrectIn their support ticket (XXXXXX) the Contributor provided what they concluded were the links for the businesses on www.offers.com as evidence that those businesses had a presence on the site Those links are provided belowAt the time of writing this response, if one visits any of the links below one receives the following error message "404: Page not found." This indicates that the webpage does not exist, which means it is reasonable to conclude that the businesses are not present on www.offers.comAs a result, it would appear that the Contributor did not provide the correct answers in this task and thus the Customer (task maker) was not intentionally acting unfairly There is a chance that the website is dynamic in a way in that certain pages only exist when content is 'active.' In this case the Customer could have created the Test Questions when content for those businesses WAS NOT active while the Contributor encountered the Test Questions when content for those businesses WAS activeThe Support Team will review if this is the case and make any updates to the Contributor's account accordingly QualitySmith http://www.offers.com/ [redacted] / 2: Brighter Blooms Nursery http://www.offers.com/ [redacted] / 3: Chefwear http://www.offers.com/ [redacted] / 4: Hair Wig Harlem http://www.offers.com/ [redacted] / 5: Woolly Pocket http://www.offers.com/w [redacted] / 6: MegaMacs http://www.offers.com/ [redacted] / 7: AirRattle http://www.offers.com/ [redacted] / 8: Glamour Kills http://www.offers.com/ [redacted] / 9: eHobby Asia http://www.offers.com/ [redacted] / Initial Consumer Rebuttal / [redacted] (2000, 13, 2015/04/01) */ (The consumer indicated he/she ACCEPTED the response from the business.) I hope they really review this!
Initial Business Response /* (1000, 11, 2015/03/31) */
Customers license the CrowdFlower platform to post discreet online tasks to Contributors around the world. Thousands of tasks are posted to tens of thousands of Contributors daily and these Contributors get paid for each individual task...
they complete.
In order for our Customers to guarantee that they are receiving quality work from Contributors, our platform enables our Customers to utilize a variety of quality control mechanisms. One such mechanism is to seed the task with "known answers" (Test Questions), which are designed to verify that a Contributor is following the instructions and thus completing the task properly. If a Contributor's accuracy when answering these Test Questions falls below a certain threshold, they are expelled from the task and can no longer work on it. They are still paid for the work completed before their accuracy fell below that threshold.
CrowdFlower provides guidance and training to Customers regarding the best practices for setting up a task and providing clear instruction to the Contributor as to how to successfully complete the task. This includes some training as to how to set up Test Questions. Proper application of this training, however, will certainly vary by Customer. As a result, CrowdFlower has set up a very accessible dispute system for Contributors to alert the CrowdFlower Contributor Support Team of any perceived unfairness in the application of Test Questions or any other quality control mechanism. Because we know that a Contributor's success on Test Questions has bearing on their access to Tasks, we make it very easy for a Contributor to submit a dispute and we try to properly resolve them as quickly as possible. The Support Team frequently corrects accuracy for Contributors on Test Questions that were either unfair or did not properly account for all correct answers. The Support Team, however, does set some thresholds for when a Test Question dispute will be manually reviewed. These thresholds include the percentage of other Contributors who also missed the Test Question being disputed. If the Test Question is missed by a relatively high percentage of Contributors it will be reviewed. If it is not missed by a relatively high percentage of Contributors it will not be reviewed initially. With every response in the latter case, however, we do indicate that if the Contributor did provide a strong case for why their answers should be considered correct they are welcome to reopen their support ticket by responding with "REOPEN TICKET" and their ticket will absolutely be reviewed by a member of the Support Team.
Regarding the specific task mentioned by this Contributor (Job ID: XXXXXX), in the instructions the Customer requested that the Contributor search for a variety of business names on the website www.offers.com and indicate whether that business had a presence on the site. For each Test Question missed and disputed the Contributor had indicated that they were able to find a presence for those businesses on the website. The Customer, on the other hand, had selected that their was no presence for those businesses on that website and thus the Contributor was considered incorrect. In their support ticket (XXXXXX) the Contributor provided what they concluded were the links for the businesses on www.offers.com as evidence that those businesses had a presence on the site.
Those links are provided below. At the time of writing this response, if one visits any of the links below one receives the following error message "404: Page not found." This indicates that the webpage does not exist, which means it is reasonable to conclude that the businesses are not present on www.offers.com. As a result, it would appear that the Contributor did not provide the correct answers in this task and thus the Customer (task maker) was not intentionally acting unfairly.
There is a chance that the website is dynamic in a way in that certain pages only exist when content is 'active.' In this case the Customer could have created the Test Questions when content for those businesses WAS NOT active while the Contributor encountered the Test Questions when content for those businesses WAS active. The Support Team will review if this is the case and make any updates to the Contributor's account accordingly.
1. QualitySmith
http://www.offers.com/[redacted]/
2: Brighter Blooms Nursery
http://www.offers.com/[redacted]/
3: Chefwear
http://www.offers.com/[redacted]/
4: Hair Wig Harlem
http://www.offers.com/[redacted]/
5: Woolly Pocket
http://www.offers.com/w[redacted]/
6: MegaMacs
http://www.offers.com/[redacted]/
7: AirRattle
http://www.offers.com/[redacted]/
8: Glamour Kills
http://www.offers.com/[redacted]/
9: eHobby Asia
http://www.offers.com/[redacted]/
Initial Consumer Rebuttal /* (2000, 13, 2015/04/01) */
(The consumer indicated he/she ACCEPTED the response from the business.)
I hope they really review this!