[1]
An Explorative Approach for Crowdsourcing Tasks Design
SOCM 2015
/
Brambilla, Marco
/
Ceri, Stefano
/
Mauri, Andrea
/
Volonterio, Riccardo
Companion Proceedings of the 2015 International Conference on the World Wide
Web
2015-05-18
v.2
p.1125-1130
© Copyright 2015 ACM
Summary: Crowdsourcing applications are becoming widespread; they cover very
different scenarios, including opinion mining, multimedia data annotation,
localised information gathering, marketing campaigns, expert response
gathering, and so on. The quality of the outcome of these applications depends
on different design parameters and constraints, and it is very hard to judge
about their combined effects without doing some experiments; on the other hand,
there are no experiences or guidelines that tell how to conduct experiments,
and thus these are often conducted in an ad-hoc manner, typically through
adjustments of an initial strategy that may converge to a parameter setting
which is quite different from the best possible one. In this paper we propose a
comparative, explorative approach for designing crowdsourcing tasks. The method
consists of defining a representative set of execution strategies, then execute
them on a small dataset, then collect quality measures for each candidate
strategy, and finally decide the strategy to be used with the complete dataset.
[2]
Community-based crowdsourcing
Theory and practice of social machines 2014 workshop
/
Brambilla, Marco
/
Ceri, Stefano
/
Mauri, Andrea
/
Volonterio, Riccardo
Companion Proceedings of the 2014 International Conference on the World Wide
Web
2014-04-07
v.2
p.891-896
© Copyright 2014 ACM
Summary: This paper is focused on community-based crowdsourcing applications, i.e.
the ability of spawning crowdsourcing tasks upon multiple communities of
performers, thus leveraging the peculiar characteristics and capabilities of
the community members. We show that dynamic adaptation of crowdsourcing
campaigns to community behaviour is particularly relevant. We demonstrate that
this approach can be very effective for obtaining answers from communities,
with very different size, precision, delay and cost, by exploiting the social
networking relations and the features of the crowdsourcing task. We show the
approach at work within the CrowdSearcher platform, which allows configuring
and dynamically adapting crowdsourcing campaigns tailored to different
communities. We report on an experiment demonstrating the effectiveness of the
approach.
[3]
Reactive crowdsourcing
Research papers
/
Bozzon, Alessandro
/
Brambilla, Marco
/
Ceri, Stefano
/
Mauri, Andrea
Proceedings of the 2013 International Conference on the World Wide Web
2013-05-13
v.1
p.153-164
© Copyright 2013 ACM
Summary: An essential aspect for building effective crowdsourcing computations is the
ability of "controlling the crowd", i.e. of dynamically adapting the behaviour
of the crowdsourcing systems as response to the quantity and quality of
completed tasks or to the availability and reliability of performers. Most
crowdsourcing systems only provide limited and predefined controls; in
contrast, we present an approach to crowdsourcing which provides fine-level,
powerful and flexible controls. We model each crowdsourcing application as
composition of elementary task types and we progressively transform these high
level specifications into the features of a reactive execution environment that
supports task planning, assignment and completion as well as performer
monitoring and exclusion. Controls are specified as active rules on top of data
structures which are derived from the model of the application; rules can be
added, dropped or modified, thus guaranteeing maximal flexibility with limited
effort.
We also report on our prototype platform that implements the proposed
framework and we show the results of our experimentations with different rule
sets, demonstrating how simple changes to the rules can substantially affect
time, effort and quality involved in crowdsourcing activities.
[4]
EDITED BOOK
Search Computing: Broadening Web Search
Lecture Notes in Computer Science 7538
/
Ceri, Stefano
/
Brambilla, Marco
2012
n.16
p.254
Springer Berlin Heidelberg
DOI: 10.1007/978-3-642-34213-4
== Extraction and Integration ==
Web Data Reconciliation: Models and Experiences (1-15)
+ Blanco, Lorenzo
+ Crescenzi, Valter
+ Merialdo, Paolo
+ Papotti, Paolo
A Domain Independent Framework for Extracting Linked Semantic Data from Tables (16-33)
+ Mulwad, Varish
+ Finin, Tim
+ Joshi, Anupam
Knowledge Extraction from Structured Sources (34-52)
+ Unbehauen, Jörg
+ Hellmann, Sebastian
+ Auer, Sören
+ Stadler, Claus
Extracting Information from Google Fusion Tables (53-67)
+ Brambilla, Marco
+ Ceri, Stefano
+ Cinefra, Nicola
+ Sarma, Anish Das
+ Forghieri, Fabio
+ et al
Materialization of Web Data Sources (68-81)
+ Bozzon, Alessandro
+ Ceri, Stefano
+ Zagorac, Srdan
== Query and Visualization Paradigms ==
Natural Language Interfaces to Data Services (82-97)
+ Guerrisi, Vincenzo
+ Torre, Pietro La
+ Quarteroni, Silvia
Mobile Multi-domain Search over Structured Web Data (98-110)
+ Aral, Atakan
+ Akin, Ilker Zafer
+ Brambilla, Marco
Clustering and Labeling of Multi-dimensional Mixed Structured Data (111-126)
+ Brambilla, Marco
+ Zanoni, Massimiliano
Visualizing Search Results: Engineering Visual Patterns Development for the Web (127-142)
+ Morales-Chaparro, Rober
+ Preciado, Juan Carlos
+ Sánchez-Figueroa, Fernando
== Exploring Linked Data ==
Extending SPARQL Algebra to Support Efficient Evaluation of Top-K SPARQL Queries (143-156)
+ Bozzon, Alessandro
+ Valle, Emanuele Della
+ Magliacane, Sara
Thematic Clustering and Exploration of Linked Data (157-175)
+ Castano, Silvana
+ Ferrara, Alfio
+ Montanelli, Stefano
Support for Reusable Explorations of Linked Data in the Semantic Web (176-190)
+ Cohen, Marcelo
+ Schwabe, Daniel
== Games, Social Search and Economics ==
A Survey on Proximity Measures for Social Networks (191-206)
+ Cohen, Sara
+ Kimelfeld, Benny
+ Koutrika, Georgia
Extending Search to Crowds: A Model-Driven Approach (207-222)
+ Bozzon, Alessandro
+ Brambilla, Marco
+ Ceri, Stefano
+ Mauri, Andrea
BetterRelations: Collecting Association Strengths for Linked Data Triples with a Game (223-239)
+ Hees, Jörn
+ Roth-Berghofer, Thomas
+ Biedert, Ralf
+ Adrian, Benjamin
+ Dengel, Andreas
An Incentive-Compatible Revenue-Sharing Mechanism for the Economic Sustainability of Multi-domain Search Based on Advertising (240-254)
+ Brambilla, Marco
+ Ceppi, Sofia
+ Gatti, Nicola
+ Gerding, Enrico H.