Attention and Representation Learning in Byte-Level Digital Forensics: A Survey of Methods, Challenges, and Applications

Title

Attention and Representation Learning in Byte-Level Digital Forensics: A Survey of Methods, Challenges, and Applications

Creator

Mary, Teena; Sreeja, C.S.

Description

Byte-level analysis has become an essential capability in digital forensics, enabling content-based investigation when file system metadata, headers, or structural information are unavailable or unreliable. Recent advances in deep learning allow forensic systems to learn discriminative features directly from raw byte streams; however, the growing diversity of representation strategies, architectural designs, and attention mechanisms makes it difficult to assess their relative effectiveness and practical suitability. This study presents a structured survey of representation learning and attention-based approaches for byte-level digital forensic analysis. We examine statistical, embedding-based, image-based, sequential, and hybrid representations, and analyze how architectural choices and attention mechanisms influence performance, robustness, and scalability. Across the literature, hybrid representations combined with lightweight convolutional backbones and selective attention mechanisms consistently provide a favorable balance between accuracy and computational efficiency. The survey also reviews key forensic applications, including file fragment classification, malware and binary analysis, network payload forensics, and encrypted or compressed data triage. In addition, we critically discuss challenges related to distribution shift, dataset bias, adversarial vulnerability, interpretability, and reproducibility, along with practical considerations for deployment in large-scale forensic pipelines. By synthesizing architectural trends, operational constraints, and reliability concerns, this work identifies critical research gaps and provides a structured foundation for the development of robust and trustworthy byte-level forensic learning systems. (2026), (Science and Information Organization). All rights reserved.

Source

International Journal of Advanced Computer Science and Applications;Volume;17;Issue;2;pp.113-124

Date

01-01-2026

Publisher

Science and Information Organization

Subject

attention mechanisms; Byte-level digital forensics; deep learning; file fragment classification; forensic robustness; representation learning

Coverage

Mary T., Department of Computer Science, Christ University, Karnataka, Bengaluru, 560029, India; Sreeja C.S., Center for Quantum Technologies and Complex Systems (CQTCS), Christ University, Karnataka, Bengaluru, 560029, India

Rights

All Open Access; Gold Open Access

Relation

ISSN: 2158107X;

Format

online

Language

English

Type

Article

Identifier

https://doi.org/10.14569/IJACSA.2026.0170213

https://www.scopus.com/pages/publications/105039182557?origin=resultslist