Code360 powered by Coding Ninjas X Naukri.com. Code360 powered by Coding Ninjas X Naukri.com
Last updated: Jun 13, 2022

Big Data

Hello Folks!!, what's new in the bucket? Big Data, is it? That's a pretty great choice, I must say, and a tough one also. But don't you worry, we ninjas will be conquering everything with our ninja technique. But what is Big data? A large Data, Hahahaha... No no... it's not large data. But yes big data is related to data. Then what type of data? Don't worry we will be explaining what big data is and how it is managed? What is its Architecture? There are various types of Big Data, we will discuss each one of them briefly and give you a clear conceptual understanding of them. Later, moving forward we will be introducing to you components related to Big data. I know you are perplexed about all of this. Don't stress we will be taking up each of these topics one by one and giving you briefs about various terminologies and concepts. You just have to be consistent and don't lose spirit. We will be covering tough topics like the cloud and how it is helpful in Big data. We will also dive into various big data supporting tools like tableau, and Hadoop, which are used for storing Big data. As we know, databases are also used for storing data then we will also see how these various types of databases handle big data. There is a lot of taking in. I know, but don't worry, here we are just giving you an outline. So no further ado, let's take up the first lesson.
Applications of Big Data
This article explores some significant applications of big data across different sectors.
Elasticsearch vs Cassandra EASY
In this article, we will discuss what are Elasticsearch and Cassandra with, their advantages and disadvantages, and the difference between them.
Elasticsearch vs Kibana
In this blog, we will be discussing the features of Elasticsearch and Kibana, followed by the differences between them.
Elasticsearch vs Opensearch
In this article, we will learn about elasticsearch vs opensearch. We will also explore uses and working of Elasticsearch and Opensearch.

Introduction to Big Data

Welcome to the introduction to Big data!!! Here you will learn what is Big data? The actual definition of Big data. Big data is the combination of all types of data such as structured, semi-structured, and unstructured data collected using various methods and organizations This data or Big data can be further processed to fetch information, which is further used in machine learning techniques and training various models that depend on this data, in deep learning and data analysis projects. Big data is very helpful in doing predictive analysis or modeling. Why is it so? Big data means there is a large amount of data that is collected using methods. These methods are reliable and very advanced, thus the data received is quite accurate and the information obtained from this can give us very good results and we can predict the outcomes of related tasks. This one application of Big data is quite useful and a key reason why we or most people learn Big data. I hope this would be a good experience and keep learning.
What is Big Data?
In this article, we have discussed Big Data in detail. We have also briefly explained different types of data,5V of Big Data, and Big Data applications.

Big Data Management

Big data is there. We know this. But how to manage it. By managing it we mean how to store it. In this section, you will be given a clear picture of how to store big data in databases. We also explain to you various types of databases that can be used and how one is better than the other. After collecting the data, the next step is to store it. So let's store it.
Role of RDBMS in Big data Management EASY
This blog describes the role of RDBMS in Big Data management.
Author Aditi
0 upvotes
Non-relational Databases in Big data management EASY
This blog introduces non-relational databases in big data management.
Author Aditi
0 upvotes
What are the 5 Vs of Big Data? EASY
In this blog, we will learn about What are the 5 Vs of Big Data? We will understand its core concepts, examples, impact and much more.
Difference between Apache Spark and Hadoop
In this blog, we will learn about the key differences between Apache Spark and Hadoop, their features, limitations and a proper comparison between them.
Roles and Responsibilities of Data Visualization Analyst (Visual Analyst)
This blog will discuss the topic of the Roles and responsibilities of a Data Visualization Analyst. This includes domain, responsibilities, career, and many more.
Document Databases in Big Data MEDIUM
This article shall discuss the document databases in Big Data. We shall see the features and characteristics of document databases.
Polyglot Persistence
In this article, we will learn what Polygot Persistence and architecture is all about and its uses.

MapReduce

MapReduce is basically a programming model. It is used for the processing and generation the big data sets. In order to generate these big data sets, it uses a parallelly distributed algorithm on the given cluster or data. We will be giving details about what actually is Mapreduce and what is a map and what is reduced in it? It is a complex topic with various key points to note down so take your time and we will be giving you a good idea.
Functional versus Procedural Programming Models
This article will discuss functional and procedural programming models in detail and how they support big data.
MapReduce Fundamentals
This blog introduces MapReduce, i.e., Google’s approach to collecting and analyzing website data for search optimizations. Google’s proprietary MapReduce system ran on the Google File System (GFS).
MapReduce Types
The article covers the concept of MapReduce in Hadoop, various MapReduce types of input and output formats, along with some frequently asked questions.
MapReduce Combiner EASY
The article covers the concepts of MapReduce Combiner, its workings, advantages, and disadvantages, along with some frequently asked questions.
Understanding The Map Function EASY
In this article, we will understand how to process large amounts of unstructured data across a distributed group of processors into a structured unit.
MapReduce Features
In this article, we will discuss some mapreduce features and how it is used in hadoop ecosystem.
Adding the reduce function
In this article, we will understand how to add the reduce function.
Shuffle and Sort in MapReduce EASY
This article covers the concept of Shuffle and Sort in MapReduce along with the Map Phase, Reduce Phase and the pictorial representation of these Phases.
Putting Map and Reduce Together EASY
This article will discuss MapReduce in detail, how it supports Big data and some information about why we put Map and reduce together.
Foundational behaviors of MapReduce EASY
In this article, we will understand the foundational behavior of the MapReduce framework.

Hadoop

Hadoop is owned by the company Apache and in actuality, it is Apache Hadoop. It is a platform that is a collection of various open-source software utilities. These utilities solve problems that usually involve a massive amount of data and the computations over this data. Hadoop is a very powerful tool that helps in data collection and storage.
What is Hadoop
Hadoop is a set of open-source software tools for solving problems involving large amounts of data and computation using a network of many computers.
Introduction to Hadoop MEDIUM
Hadoop is an open-source framework designed to store and process large volumes of data across a distributed system of computers.
Hive Architecture MEDIUM
In this blog, we will learn about Hive Architecture. We will understand its core concepts and learn about its limitations and much more for better understanding.
Hadoop Architecture EASY
In this blog, we will learn about Hadoop Architecture. We will learn about its architecture, its types, and much more for better understanding.
Hadoop Distributed File System(HDFS)
We will discuss the Hadoop Distributed File Systems in Big Data. The architecture of HDFS and the Goals, pros, and cons of HDFS.
Transparent Encryption in HDFS
In this article, we will discuss about Transparent Encryption in HDFS and its key concepts and architecture.
Hadoop Yarn Architecture EASY
YARN (Yet Another Resource Negotiator) manages resources and schedules tasks for distributed computing in Hadoop ecosystems. In this article, we will learn about YARN in detail.
Hadoop MapReduce EASY
This article aims to understand the Hadoop MapReduce.
Building the Big Data Foundation with Hadoop
This blog will introduce why the Hadoop ecosystem is so crucial for big data & how Hadoop YARN manages resources and applications. We'll look into How to use HBase to store large amounts of data and how Hive is a tool for analyzing large amounts of data.
Managing Applications and Resources with Hadoop Yarn
This blog focuses on Managing Applications and Resources with Hadoop Yarn. We will discuss the Hadoop Yarn, Resource Manager, Node Manager and Application Master.
YARN vs MapReduce MEDIUM
In this article, we will learn and understand YARN and MapReduce framework.
Storing Big Data with Hbase MEDIUM
This blog helps you clear your understanding of the Storing Big Data with Hbase. We will discuss the Hadoop Foundation and Ecosystem and how to store Big Data with HBase.
Mining Big Data with Hive EASY
This blog introduces Big data and Mining big data with Hive. And also covers the introduction of big data with real-life examples, detailed knowledge of Hive, and big data management.

Distributed Computing in Big Data

Distributed Computing covers the field of computer science with talks about distributed systems. These systems have components that are located on different computers making a network. These systems show how these computers in a network communicate and coordinate the actions of passing messages. Here, we will see what is distributed computing and how this distributed computing is beneficial in big data or what is the connection between the two.
Distributed Computing EASY
In this blog, we will learn about distributed computing.
Why do we need Distributed Computing for Big Data? EASY
In this article, we will discuss the basics of Big Data. Further, we will see the need for distributed computing for big data.
The "latency" Problem EASY
In this article, we will discuss the latency problem. Further, we will see the need for reducing latency and, finally, ways to reduce latency.
Demand meets solutions EASY
In this blog, we will discuss distributed computing, its need, its working, and its type. We will also discuss Big Data, distributed computing in Big Data, distributed computing with MapReduce, why MapReduce is the only way, and lastly, demand meets solutions.
Getting the performance Right EASY
In this article, we will discuss the introduction of getting the performance right and how performance is needed for scalability

Analytics and Big Data

This is a very important and core topic to deal with. Big data as in whole is of no use if there is no reason for it. Why would anyone collect data if he is not going to use it? In Big data, we meant by using it is that, processing this big data to extract some features from it. Doing analysis is our work on big data. In this blog series, we will see how we can do the analysis and what tools are helpful in this.
Big Data Analytics EASY
In this article, we will make try to discuss the importance of Big Data, How Big Data plays a very much important role in the current trends, how it is to be analyzed, and many more. Hope you will learn a lot.
Introduction to Batch in Big Data Analytics EASY
This article is an Introduction to Batch in Big Data Analytics. It covers parameters for batch processing, batch in big data, and many more.
Author Shiva
0 upvotes
Managing BI Products To Handle Big Data
Here, we will discuss managing BI(business intelligence) Products to handle Big Data.
Text Analytics and Big Data EASY
This article will try to give you a taste of how Big Data work? And what is meant by text analytics? How do we use text analytics to gain useful insights to develop our business strategies?
Text Analytics VS Keyword Search
In this article, we will see the differences between text analytics and text search in Big Data.
Analysis and Extraction Techniques
This blog will discuss text analysis and extraction techniques in big data.
Understanding the extracted Information EASY
In this article, we will try to improve our ideas on how to understand the information that is extracted from the data after applying some of the data processing techniques. We will also see what type of information we will get as a result.
Taxonomy and Big Data
In this article, we will see the taxonomies in big data. We will look into some analysis and extraction techniques. We will also learn about the extracted information found after implementing these techniques.
Characteristics of Big Data Analysis EASY
In this blog, we will be discussing Big data and the characteristics of Big Data Analysis.
Author Anjali
0 upvotes

Big Data Implementation

Just learning things doesn't give you enough knowledge unless you practice that learning of yours. Here, we will be discussing how to implement big data techniques and how we can apply them in all ways.
Integrating the Data Sources
In this blog, we will learn about data integration, its need with all the three stages required for data integration in detail with easy explanation.
Fundamentals of Big Data Integration
In this blog, we will learn about the fundamentals of big data integration, the reasons, challenges that we need to integrate the data and the methods of integrating the data.
ETL in Big Data
In this blog, we will learn about ETL, the difference between ETL and ELT, different ETL tools, and integration methods.
Data Streaming EASY
In this blog, we will study Data Streaming and its implementation in Big Data.
The Need for Metadata in Streams EASY
In this blog, we will be dealing with real-time data streams and the need for metadata in streams.
Using Complex Event Processing EASY
In this article, we will learn about complex event processing and the major application areas of complex event processing (CEP).
Differentiating CEP from Streams EASY
This article will show you the differences between CEP and Streams.
Understanding Big Data WorkFlows
In this blog, we will understand the basics of Big Data WorkFlows.
Applying Big Data within Your Organization EASY
In this article, we will discuss various areas in which big data economics must be analyzed. Also, we will learn how to implement and integrate big data in your environment.
Enterprise Data Management
This article will learn about enterprise data management, its advantages, and its different components. Lastly, we will look into the major differences between MDM and EDM.
Big Data Implementation Road Map EASY
This blog teaches the Big Data implementation roadmap from scratch.
Starting Your Big Data Road Map EASY
In this article, we will get to know how we can create a roadmap to adopt big data practices in our organization.

Big Data Solutions in the Real World

If data is not usable in the real world, then what is the use, and why are we spending tons of money and time, and effort in collecting and processing data. That is why we need to know its applications in practical scenarios and use cases and how to even use it. Let's see what we can get here and might you also give some ideas.
The Importance of Big Data to Business EASY
In this blog, we will learn about the importance of Big Data to business, Big Data as a business planning tool and transforming business processes with Big Data.
Analysing Data In Motion
This article deals with the data in motion and their maintenance.
Healthcare Analytics in Big Data
In this blog, we will discuss the examples of Healthcare Analytics in Big Data and list down the respective benefits and challenges.
Improving Business Processes with Big Data Analytics EASY
In this article, we'll discuss how companies and whole industries are altering how they handle and analyze structured and unstructured data that are growing in volume.
Time Series Forecasting Methods
This article discusses the various methods for time series forecasting along with their formulas.
ARIMA Model for Time Series Analysis EASY
The article gives a detailed description of the ARIMA Model for Time Series Analysis.
Author Komal
0 upvotes
Augmented Dickey Fuller Test for Time Series Analysis
This article gives a detailed overview of the Augmented Dickey-Fuller test for time series analysis.
Author Komal
0 upvotes