Dublin Core The Dublin Core metadata element set is common to all Omeka records, including items, files, and collections. For more information see, http://dublincore.org/documents/dces/. Title A name given to the resource Articles Article Faculty Publications -Articles Dublin Core The Dublin Core metadata element set is common to all Omeka records, including items, files, and collections. For more information see, http://dublincore.org/documents/dces/. Title A name given to the resource Performance evaluation of Map-reduce jar pig hive and spark with machine learning using big data Subject The topic of the resource Cloudxlab; Flink; Hadoop; Hbase; HDFS; Hive; Map-reduce; Pig; Spark Description An account of the resource Big data is the biggest challenges as we need huge processing power system and good algorithms to make a decision. We need Hadoop environment with pig hive, machine learning and hadoopecosystem components. The data comes from industries. Many devices around us and sensor, and from social media sites. According to McKinsey There will be a shortage of 15000000 big data professionals by the end of 2020. There are lots of technologies to solve the problem of big data Storage and processing. Such technologies are Apache Hadoop, Apache Spark, Apache Kafka, and many more. Here we analyse the processing speed for the 4GB data on cloudx lab with Hadoop mapreduce with varing mappers and reducers and with pig script and Hive querries and spark environment along with machine learning technology and from the results we can say that machine learning with Hadoop will enhance the processing performance along with with spark, and also we can say that spark is better than Hadoop mapreduce pig and hive, spark with hive and machine learning will be the best performance enhanced compared with pig and hive, Hadoop mapreduce jar. Copyright 2020 Institute of Advanced Engineering and Science. All rights reserved. Creator An entity primarily responsible for making the resource Santosh Kumar J.; Raghavendra B.K.; Raghavendra S.; Meenakshi Source A related resource from which the described resource is derived International Journal of Electrical and Computer Engineering, Vol-10, No. 4, pp. 3811-3818. Publisher An entity responsible for making the resource available Institute of Advanced Engineering and Science Date A point or period of time associated with an event in the lifecycle of the resource 2020-01-01 Identifier An unambiguous reference to the resource within a given context <a href="https://doi.org/10.11591/ijece.v10i4.pp3811-3818" target="_blank" rel="noreferrer noopener">https://doi.org/10.11591/ijece.v10i4.pp3811-3818</a> <br /><br /><a href="https://www.scopus.com/inward/record.uri?eid=2-s2.0-85079907640&amp;doi=10.11591%2Fijece.v10i4.pp3811-3818&amp;partnerID=40&amp;md5=4663b5cad9d9091a213fc4454f707c89" target="_blank" rel="noreferrer noopener">https://www.scopus.com/inward/record.uri?eid=2-s2.0-85079907640&amp;doi=10.11591%2fijece.v10i4.pp3811-3818&amp;partnerID=40&amp;md5=4663b5cad9d9091a213fc4454f707c89</a> Rights Information about rights held in and over the resource All Open Access; Gold Open Access; Green Open Access Relation A related resource ISSN: 20888708 Format The file format, physical medium, or dimensions of the resource Online Language A language of the resource English Type The nature or genre of the resource Article Coverage The spatial or temporal topic of the resource, the spatial applicability of the resource, or the jurisdiction under which the resource is relevant Santosh Kumar J., Department of Computer Science and Engineering, KSSEM, Affiliated to VTU Belagavi, Bangalore, India; Raghavendra B.K., Department of Computer Science and Engineering, BGSIT (ACU) Deemed to be University, India; Raghavendra S., Department of Computer Science and Engineering, Christ Deemed to be University, India; Meenakshi, Department of Computer Science and Engineering, Jain Deemed to be University, India