How to handle Big Data

sfg-2026
ForumIAS LATEST
  1. 31 May |Post Prelims Meet with Ayush Sir | Offline Session to discuss the Post-Prelims agenda | ForumIAS Click Here to register for the event →
  2. 02 June |Open Session - The PSIR Mark Improvement by Aman Aloon (AIR 295, UPSC CSE 2025)|Click Here to register for the event →
  3. 04 June | Open Orientation for GSAP 2026| Click Here to register →
  4. 06 June | Open Orientation on Essay Guidance Program (EGP 2026) Click Here to register →
  5. 07 June | Open Orientation for Current Affairs for Mains 2026 Click Here to register →

How to handle Big Data

Context:

There are infinite ways to analyse data but great caution must be exercised while handling large and complex data sets

What is Big Data?

Big data is a term used to denote data sets that are so large or complex that traditional data processing application software is inadequate to deal with them.

Causes of Data Blunders:

  • Bias,
  • low-quality data,
  • unreliable sources,
  • technical glitches,
  •  an improper understanding of the larger picture,
  • lack of proper statistical tools and resources to analyse large volumes of data
  • Relying too heavily on a particular model

Way Out:

  • Big Data is very complex and involves additional challenge.
  • They might involve the use of some skills involving analytics, decision-making skills, logical thinking skills, problem-solving, advanced computational expertise and also statistical expertise.
  • Therefore, the use of some routine algorithm is not enough.
  • Too much reliance on available software is serious mistake while handling Big Data
Print Friendly and PDF
Blog
Academy
Community