ForumIAS announcing GS Foundation Program for UPSC CSE 2025-26 from 27th May. Click Here for more information.
Context:
There are infinite ways to analyse data but great caution must be exercised while handling large and complex data sets
What is Big Data?
Big data is a term used to denote data sets that are so large or complex that traditional data processing application software is inadequate to deal with them.
Causes of Data Blunders:
- Bias,
- low-quality data,
- unreliable sources,
- technical glitches,
- an improper understanding of the larger picture,
- lack of proper statistical tools and resources to analyse large volumes of data
- Relying too heavily on a particular model
Way Out:
- Big Data is very complex and involves additional challenge.
- They might involve the use of some skills involving analytics, decision-making skills, logical thinking skills, problem-solving, advanced computational expertise and also statistical expertise.
- Therefore, the use of some routine algorithm is not enough.
- Too much reliance on available software is serious mistake while handling Big Data