Does Subject Type Influence Software Engineering Experiment Results?

Saved in:
Bibliographic Details
Title: Does Subject Type Influence Software Engineering Experiment Results?
Authors: Vegas, Sira1 svegas@fi.upm.es, Riofrío, Patricia1 priofrio@fi.upm.es, Juristo, Natalia1,2 natalia@fi.upm.es
Source: ICSE: International Conference on Software Engineering. 2017, p210-212. 3p.
Subjects: Computer software developers, Software engineering conferences, Computer software development, Cartography software, Application software
Abstract: Context: A key issue when dealing with the generalization threat of software engineering experiments is to use different subject types. Objective: In this paper, we aim to investigate which subject types are used in experiments and their impact on results. Method: We have performed a systematic mapping study by manually searching experiments published from January 2014 to June 2016 in six leading software engineering conferences and journals. Results: Out of the 833 papers published in the period covered, we have identified 93 papers reporting experiments with subjects. Of these, 27 papers report experiments that have two subject types (professionals and students). We have studied the impact of subject type on the results of experiments reported in 11 of these papers. Conclusion: We have observed contradictory results. Only in some cases subject type influences experimental results. This suggests that further research is needed in order to find an explanation. [ABSTRACT FROM AUTHOR]
Copyright of ICSE: International Conference on Software Engineering is the property of Association for Computing Machinery and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
FullText Links:
  – Type: pdflink
Text:
  Availability: 0
Header DbId: egs
DbLabel: Engineering Source
An: 125502428
AccessLevel: 6
PubType: Conference
PubTypeId: conference
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Does Subject Type Influence Software Engineering Experiment Results?
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Vegas%2C+Sira%22">Vegas, Sira</searchLink><relatesTo>1</relatesTo><i> svegas@fi.upm.es</i><br /><searchLink fieldCode="AR" term="%22Riofrío%2C+Patricia%22">Riofrío, Patricia</searchLink><relatesTo>1</relatesTo><i> priofrio@fi.upm.es</i><br /><searchLink fieldCode="AR" term="%22Juristo%2C+Natalia%22">Juristo, Natalia</searchLink><relatesTo>1,2</relatesTo><i> natalia@fi.upm.es</i>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22ICSE%3A+International+Conference+on+Software+Engineering%22">ICSE: International Conference on Software Engineering</searchLink>. 2017, p210-212. 3p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Computer+software+developers%22">Computer software developers</searchLink><br /><searchLink fieldCode="DE" term="%22Software+engineering+conferences%22">Software engineering conferences</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+software+development%22">Computer software development</searchLink><br /><searchLink fieldCode="DE" term="%22Cartography+software%22">Cartography software</searchLink><br /><searchLink fieldCode="DE" term="%22Application+software%22">Application software</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Context: A key issue when dealing with the generalization threat of software engineering experiments is to use different subject types. Objective: In this paper, we aim to investigate which subject types are used in experiments and their impact on results. Method: We have performed a systematic mapping study by manually searching experiments published from January 2014 to June 2016 in six leading software engineering conferences and journals. Results: Out of the 833 papers published in the period covered, we have identified 93 papers reporting experiments with subjects. Of these, 27 papers report experiments that have two subject types (professionals and students). We have studied the impact of subject type on the results of experiments reported in 11 of these papers. Conclusion: We have observed contradictory results. Only in some cases subject type influences experimental results. This suggests that further research is needed in order to find an explanation. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of ICSE: International Conference on Software Engineering is the property of Association for Computing Machinery and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=125502428
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1109/ICSE-C.2017.113
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 3
        StartPage: 210
    Subjects:
      – SubjectFull: Computer software developers
        Type: general
      – SubjectFull: Software engineering conferences
        Type: general
      – SubjectFull: Computer software development
        Type: general
      – SubjectFull: Cartography software
        Type: general
      – SubjectFull: Application software
        Type: general
    Titles:
      – TitleFull: Does Subject Type Influence Software Engineering Experiment Results?
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Vegas, Sira
      – PersonEntity:
          Name:
            NameFull: Riofrío, Patricia
      – PersonEntity:
          Name:
            NameFull: Juristo, Natalia
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Text: 2017
              Type: published
              Y: 2017
          Titles:
            – TitleFull: ICSE: International Conference on Software Engineering
              Type: main
ResultId 1