An automated approach for abstracting execution logs to execution events.

Saved in:
Bibliographic Details
Title: An automated approach for abstracting execution logs to execution events.
Authors: Jiang, Zhen Ming1 zmjiang@cs.queensu.ca, Hassan, Ahmed E.1, Hamann, Gilbert2, Flora, Parminder2
Source: Journal of Software Maintenance & Evolution: Research & Practice. Jul/Aug2008, Vol. 20 Issue 4, p249-267. 19p. 2 Diagrams, 16 Charts.
Subjects: Application logging (Computer science), Simple Network Management Protocol (Computer network protocol), Software verification, Software engineering, Systems design, Source code
Abstract: Execution logs are generated by output statements that developers insert into the source code. Execution logs are widely available and are helpful in monitoring, remote issue resolution, and system understanding of complex enterprise applications. There are many proposals for standardized log formats such as the W3C and SNMP formats. However, most applications use ad hoc non-standardized logging formats. Automated analysis of such logs is complex due to the loosely defined structure and a large non-fixed vocabulary of words. The large volume of logs, produced by enterprise applications, limits the usefulness of manual analysis techniques. Automated techniques are needed to uncover the structure of execution logs. Using the uncovered structure, sophisticated analysis of logs can be performed. In this paper, we propose a log abstraction technique that recognizes the internal structure of each log line. Using the recovered structure, log lines can be easily summarized and categorized to help comprehend and investigate the complex behavior of large software applications. Our proposed approach handles free-form log lines with minimal requirements on the format of a log line. Through a case study using log files from four enterprise applications, we demonstrate that our approach abstracts log files of different complexities with high precision and recall. Copyright © 2008 John Wiley & Sons, Ltd. [ABSTRACT FROM AUTHOR]
Copyright of Journal of Software Maintenance & Evolution: Research & Practice is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
FullText Links:
  – Type: pdflink
Text:
  Availability: 0
Header DbId: egs
DbLabel: Engineering Source
An: 33468060
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: An automated approach for abstracting execution logs to execution events.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Jiang%2C+Zhen+Ming%22">Jiang, Zhen Ming</searchLink><relatesTo>1</relatesTo><i> zmjiang@cs.queensu.ca</i><br /><searchLink fieldCode="AR" term="%22Hassan%2C+Ahmed+E%2E%22">Hassan, Ahmed E.</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Hamann%2C+Gilbert%22">Hamann, Gilbert</searchLink><relatesTo>2</relatesTo><br /><searchLink fieldCode="AR" term="%22Flora%2C+Parminder%22">Flora, Parminder</searchLink><relatesTo>2</relatesTo>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Journal+of+Software+Maintenance+%26+Evolution%3A+Research+%26+Practice%22">Journal of Software Maintenance & Evolution: Research & Practice</searchLink>. Jul/Aug2008, Vol. 20 Issue 4, p249-267. 19p. 2 Diagrams, 16 Charts.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Application+logging+%28Computer+science%29%22">Application logging (Computer science)</searchLink><br /><searchLink fieldCode="DE" term="%22Simple+Network+Management+Protocol+%28Computer+network+protocol%29%22">Simple Network Management Protocol (Computer network protocol)</searchLink><br /><searchLink fieldCode="DE" term="%22Software+verification%22">Software verification</searchLink><br /><searchLink fieldCode="DE" term="%22Software+engineering%22">Software engineering</searchLink><br /><searchLink fieldCode="DE" term="%22Systems+design%22">Systems design</searchLink><br /><searchLink fieldCode="DE" term="%22Source+code%22">Source code</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Execution logs are generated by output statements that developers insert into the source code. Execution logs are widely available and are helpful in monitoring, remote issue resolution, and system understanding of complex enterprise applications. There are many proposals for standardized log formats such as the W3C and SNMP formats. However, most applications use ad hoc non-standardized logging formats. Automated analysis of such logs is complex due to the loosely defined structure and a large non-fixed vocabulary of words. The large volume of logs, produced by enterprise applications, limits the usefulness of manual analysis techniques. Automated techniques are needed to uncover the structure of execution logs. Using the uncovered structure, sophisticated analysis of logs can be performed. In this paper, we propose a log abstraction technique that recognizes the internal structure of each log line. Using the recovered structure, log lines can be easily summarized and categorized to help comprehend and investigate the complex behavior of large software applications. Our proposed approach handles free-form log lines with minimal requirements on the format of a log line. Through a case study using log files from four enterprise applications, we demonstrate that our approach abstracts log files of different complexities with high precision and recall. Copyright © 2008 John Wiley & Sons, Ltd. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Journal of Software Maintenance & Evolution: Research & Practice is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=33468060
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1002/smr.374
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 19
        StartPage: 249
    Subjects:
      – SubjectFull: Application logging (Computer science)
        Type: general
      – SubjectFull: Simple Network Management Protocol (Computer network protocol)
        Type: general
      – SubjectFull: Software verification
        Type: general
      – SubjectFull: Software engineering
        Type: general
      – SubjectFull: Systems design
        Type: general
      – SubjectFull: Source code
        Type: general
    Titles:
      – TitleFull: An automated approach for abstracting execution logs to execution events.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Jiang, Zhen Ming
      – PersonEntity:
          Name:
            NameFull: Hassan, Ahmed E.
      – PersonEntity:
          Name:
            NameFull: Hamann, Gilbert
      – PersonEntity:
          Name:
            NameFull: Flora, Parminder
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 07
              Text: Jul/Aug2008
              Type: published
              Y: 2008
          Identifiers:
            – Type: issn-print
              Value: 1532060X
          Numbering:
            – Type: volume
              Value: 20
            – Type: issue
              Value: 4
          Titles:
            – TitleFull: Journal of Software Maintenance & Evolution: Research & Practice
              Type: main
ResultId 1