Serverless Data Processing System and its Design Space Consideration
- Title
- Serverless Data Processing System and its Design Space Consideration
- Creator
- Arockia Raj A.; Banerjee K.; Anist A.; Beena Bethel G.N.; Muthu Pandian P.; Acharjee P.B.
- Description
- Serverless computing is becoming increasingly important in data-processing applications in science and business. The scheduler is at the centre of serverless data-processing systems, allowing for dynamic decisions on job and data placement. The complex design space, which is influenced by various user, cluster, and workload variables, presents problems for developing high-performance and cost-effective scheduling structures and processes. To make this exploration easier, we present Sched-Probe, a framework that includes a conceptual model and simulator for systematic design space exploration. Using the Sched-Probe framework, we evaluate the performance of three scheduling systems and two techniques using real-world workloads. Our open-source software is now available on ExDe, allowing system designers to collaborate on delving into the complexity of serverless scheduling, paving the way for optimised and efficient data-processing systems. 2024, Iquz Galaxy Publisher. All rights reserved.
- Source
- International Research Journal of Multidisciplinary Scope, Vol-5, No. 4, pp. 641-650.
- Date
- 2024-01-01
- Publisher
- Iquz Galaxy Publisher
- Subject
- Design Space Exploration; Performance Characterization; Sched-Probe Framework; Scheduling Mechanisms; Serverless Data Processing
- Coverage
- Arockia Raj A., Department of CSE-Data Science, Madanapalle Institute of Technology and Science, Andhra Pradesh, Madanapalle, India; Banerjee K., Department of CSE, JSS Academy of Technical Education, Noida, India; Anist A., Department of ECE, St.Joseph's Institute of Technology, OMR, Tamilnadu, Chennai, India; Beena Bethel G.N., Department of CSE (Data Science), Sridevi Women's Engineering College, Hyderabad, India; Muthu Pandian P., Department of Chemistry, Saveetha Engineering College, Thandalam, Chennai, India; Acharjee P.B., CHRIST University, Pune Lavasa Campus, Maharashtra, India
- Rights
- Restricted Access
- Relation
- ISSN: 2582631X
- Format
- Online
- Language
- English
- Type
- Article
Collection
Citation
Arockia Raj A.; Banerjee K.; Anist A.; Beena Bethel G.N.; Muthu Pandian P.; Acharjee P.B., “Serverless Data Processing System and its Design Space Consideration,” CHRIST (Deemed To Be University) Institutional Repository, accessed February 24, 2025, https://archives.christuniversity.in/items/show/12810.