Applying the criteria indicators and metrics evaluation method on ICT research: The HUMBOLDT project.
Saved in:
| Title: | Applying the criteria indicators and metrics evaluation method on ICT research: The HUMBOLDT project. |
|---|---|
| Authors: | Khan, Zaheer1, Ludlow, David1, Rix, Joachim1 |
| Source: | Research Evaluation. Mar2013, Vol. 22 Issue 1, p30-40. 11p. |
| Subjects: | Technology indicators, Information & communication technologies, Methodology, Geospatial data, Technological innovations, Evaluation methodology |
| Abstract: | Evaluating an Information Technology (IT) based research and development project from an end-user’s perspective is necessary in order to discover whether or not the outcomes of the project are successful. However, it is not straightforward to design and implement a generic user evaluation methodology that can be applied to a large-scale collaborative integrated research and development project. In this article, we share our experience based on the research evaluation carried out in a large-scale integrated ICT research project—The HUMBOLDT project. The project develops IT tools and services for cross-border geospatial data harmonization, which are applied to nine different application scenarios. A novel user-oriented evaluation methodology, namely—Criteria Indicators and Metrics (CIM)—is defined and utilized for the evaluation of the project research outcomes. The user evaluation results reveal the extent to which the research and development objectives of the project are achieved, and also demonstrate the benefits and limitations of the evaluation methodology. The results of this article can be usefully applied to other collaborative research projects in a variety of domains. [ABSTRACT FROM AUTHOR] |
| Copyright of Research Evaluation is the property of Oxford University Press / USA and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
| FullText | Links: – Type: pdflink Text: Availability: 0 |
|---|---|
| Header | DbId: egs DbLabel: Engineering Source An: 84950902 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Applying the criteria indicators and metrics evaluation method on ICT research: The HUMBOLDT project. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Khan%2C+Zaheer%22">Khan, Zaheer</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Ludlow%2C+David%22">Ludlow, David</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Rix%2C+Joachim%22">Rix, Joachim</searchLink><relatesTo>1</relatesTo> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22Research+Evaluation%22">Research Evaluation</searchLink>. Mar2013, Vol. 22 Issue 1, p30-40. 11p. – Name: Subject Label: Subjects Group: Su Data: <searchLink fieldCode="DE" term="%22Technology+indicators%22">Technology indicators</searchLink><br /><searchLink fieldCode="DE" term="%22Information+%26+communication+technologies%22">Information & communication technologies</searchLink><br /><searchLink fieldCode="DE" term="%22Methodology%22">Methodology</searchLink><br /><searchLink fieldCode="DE" term="%22Geospatial+data%22">Geospatial data</searchLink><br /><searchLink fieldCode="DE" term="%22Technological+innovations%22">Technological innovations</searchLink><br /><searchLink fieldCode="DE" term="%22Evaluation+methodology%22">Evaluation methodology</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: Evaluating an Information Technology (IT) based research and development project from an end-user’s perspective is necessary in order to discover whether or not the outcomes of the project are successful. However, it is not straightforward to design and implement a generic user evaluation methodology that can be applied to a large-scale collaborative integrated research and development project. In this article, we share our experience based on the research evaluation carried out in a large-scale integrated ICT research project—The HUMBOLDT project. The project develops IT tools and services for cross-border geospatial data harmonization, which are applied to nine different application scenarios. A novel user-oriented evaluation methodology, namely—Criteria Indicators and Metrics (CIM)—is defined and utilized for the evaluation of the project research outcomes. The user evaluation results reveal the extent to which the research and development objectives of the project are achieved, and also demonstrate the benefits and limitations of the evaluation methodology. The results of this article can be usefully applied to other collaborative research projects in a variety of domains. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of Research Evaluation is the property of Oxford University Press / USA and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=84950902 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1093/reseval/rvs037 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 11 StartPage: 30 Subjects: – SubjectFull: Technology indicators Type: general – SubjectFull: Information & communication technologies Type: general – SubjectFull: Methodology Type: general – SubjectFull: Geospatial data Type: general – SubjectFull: Technological innovations Type: general – SubjectFull: Evaluation methodology Type: general Titles: – TitleFull: Applying the criteria indicators and metrics evaluation method on ICT research: The HUMBOLDT project. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Khan, Zaheer – PersonEntity: Name: NameFull: Ludlow, David – PersonEntity: Name: NameFull: Rix, Joachim IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 03 Text: Mar2013 Type: published Y: 2013 Identifiers: – Type: issn-print Value: 09582029 Numbering: – Type: volume Value: 22 – Type: issue Value: 1 Titles: – TitleFull: Research Evaluation Type: main |
| ResultId | 1 |
