The 3rd RESER workshop will
co-locate with ESEM @ ESEIW in
Baltimore, Maryland, USA, 2013
Follow for UpdatesTweets by @reser2013
DeadlinesSubmission: June 8, 2013 (extended)
Notification: July 8, 2013
Camera Ready: July 22, 2013
Organizing CommitteeChristian Bird – Microsoft Research, USA
Charles Knutson – Brigham Young University, USA
Jonathan Krein – Brigham Young University, USA
Lutz Prechelt – Freie Universität Berlin, Germany
Advisory CommitteePer Runeson – Lund University, Sweden
Dag Sjøberg – University of Oslo, Norway
Program CommitteeTeresa Baldassarre – Università di Bari, Italy
Marcela Genero Bocco – Universidad de Castilla-La Mancha, Spain
Andrew Brooks – University of Minnesota Duluth, USA
Danilo Caivano – SER&Practices, Italy
Jeffrey Carver – University of Alabama, USA
Marcus Ciolkowski – QAware GmbH, Germany
Kevin Crowston – Syracuse University, USA
Fabio Q. B. da Silva – Federal University of Pernambuco, Brazil
Daniela Damian – University of Victoria, Canada
Dan Delorey – Google, Inc, USA
Oscar Dieste – Universidad Politécnica de Madrid, Spain
Daniel German – University of Victoria, Canada
Jesus Gonzalez-Barahona – Universidad Rey Juan Carlos, Spain
Georgios Gousios – Delft University of Technology, Netherlands
Neil Harrison – Utah Valley University, USA
Andreas Jedlitschka – Fraunhofer IESE, Germany
Mika Mäntylä – Aalto University, Finland
James Miller – University of Alberta, Canada
John Noll – Lero, The Irish Software Engineering Centre, Ireland
Dietmar Pfahl – Pika Research Inc., Canada
Megan Squire – Elon University, USA
Sira Vegas – Universidad Politécnica de Madrid, Spain
Patrick Wagstrom – IBM T. J. Watson Research Center, USA
Murray Wood – University of Strathclyde, UK
Previous RESER WorkshopsRESER 2011 – Banff, Alberta, Canada
RESER 2010 – Cape Town, South Africa
Many results in Software Engineering suffer from threats to validity that can be addressed by the replication of previous empirical studies. These threats include: 1) Lack of independent validation of empirical results; 2) Contextual shifts in Software Engineering practices or environments since the time of the original research studies; and 3) Limited data sets at the time of the original research studies.
However, certain factors discourage replication studies: 1) A perception persists that replication studies are less valuable than the presentation of original studies; 2) Data sets are often not made publicly available; 3) Reports of empirical studies are often not sufficiently detailed to foster replication; and 4) Research tools are either not available or not usable, so precise replication is impractical.
The purpose of empirical replication is twofold:
Meeting these two goals requires mature, high-quality research replications. Thus the primary goal of this workshop is to raise the quality and amount of replication work performed in software engineering research.
In particular this means:
The workshop also intends to be a forum for small-scale replications that are otherwise hard to publish. Accordingly, and in addition to general paper submissions, we collect results for one specific joint replication each year—soliciting small-scale replications, from which we intend to form large-scale replications by meta-analysis. Through this process, we expect to produce valuable insights on practical issues concerning replication. In addition, the workshop seeks to identify and suggest solutions for recurring practical problems in selecting, designing, performing, reporting, and publishing replication studies by furthering appropriate methods, tools, and standards.
Joint Replication Project
Consider participating in this year's Joint Replication Project! Individual results will be compiled into a major, distributed, joint replication (i.e., a journal paper, special issue, or something of that sort). Contributors will also have the opportunity to participate in the synthesis and publication of joint results. Additionally, all reports will be published in full and authors will share their work in a joint session at the workshop.
Student Project Reports
In many graduate courses, students have opportunities to perform small-scale replications. We invite the submission of reports from student projects. Accordingly, these reports and/or projects are not expected to be as comprehensive as a full-scale study and, understandably, may be subject to more threats to validity. In particular, we hope students will take the opportunity to explore new angles to old problems (such as Conway's Law—this year's Joint Replication Project).
Update: *** Find the complete proceedings published at IEEE Xplore ***
Update: *** Find a summary of the workshop published here ***
All accepted papers—including joint replication reports—will be submitted to the Computer Society Digital Library (CSDL) and to IEEE Xplore (see submission instructions for formatting guidelines and other details). At least one author of each accepted paper should register for and attend the workshop.
We appreciate questions and comments about the workshop.