How to handle Big Data

ForumIAS announcing GS Foundation Program for UPSC CSE 2025-26 from 19 April. Click Here for more information.

ForumIAS Answer Writing Focus Group (AWFG) for Mains 2024 commencing from 24th June 2024. The Entrance Test for the program will be held on 28th April 2024 at 9 AM. To know more about the program visit: https://forumias.com/blog/awfg2024

How to handle Big Data

Context:

There are infinite ways to analyse data but great caution must be exercised while handling large and complex data sets

What is Big Data?

Big data is a term used to denote data sets that are so large or complex that traditional data processing application software is inadequate to deal with them.

Causes of Data Blunders:

  • Bias,
  • low-quality data,
  • unreliable sources,
  • technical glitches,
  •  an improper understanding of the larger picture,
  • lack of proper statistical tools and resources to analyse large volumes of data
  • Relying too heavily on a particular model

Way Out:

  • Big Data is very complex and involves additional challenge.
  • They might involve the use of some skills involving analytics, decision-making skills, logical thinking skills, problem-solving, advanced computational expertise and also statistical expertise.
  • Therefore, the use of some routine algorithm is not enough.
  • Too much reliance on available software is serious mistake while handling Big Data
Print Friendly and PDF
Blog
Academy
Community