- Many organizations have bet their businesses on big data, but still struggle to cut through the veil of myths that obscure the true value of this technology. In our recent #BigDataMgmt Twitter chat, Professor Kirk Borne, data scientist, and Neil Raden, CEO and Principal Analyst of Hired Brains, joined us as we debunked some of the big data myths. Here is a snippet from that conversation.
- Does big data always trump small data?
- #bigdatamgmt A2: Small data tells an intimate story. #BigData tells gazillions of such stories. You need both!
http://twitter.com/KirkDBorne/status/420965881737265153
— Kirk Borne (@KirkDBorne)Wed, Jan 08 2014 17:11:02 - #bigdatamgmt A2: #BigData allows for whole-population #analytics! See @jameskobielus comments at: http://linkd.in/19dY2Ul
http://twitter.com/KirkDBorne/status/420966210763640832
— Kirk Borne (@KirkDBorne)Wed, Jan 08 2014 17:12:20 - A2 BigData and small data are relative terms.But both are needed for #analytics #BigDataMgmt
http://twitter.com/NeilRaden/status/420966154417356801
— Neil Raden (@NeilRaden)Wed, Jan 08 2014 17:12:07 - A2 Data doesn’t always speak for itself.Detail can be noisy/dirty.OTOH, aggr'd data can lead to Simpson's Paradox #BigDataMgmt
http://twitter.com/NeilRaden/status/420966257127485441
— Neil Raden (@NeilRaden)Wed, Jan 08 2014 17:12:31 - A2: #bigdatamgmt #BigData is about seeing diff value from analytics as you ramp up "3Vs." But much analytic app value (eg BI) @ lower scale
http://twitter.com/jameskobielus/status/420966257077125120
— jameskobielus (@jameskobielus)Wed, Jan 08 2014 17:12:31 - A2: #bigdata complements small data. Depending on your biz problem, either may trump the other. #bigdatamgmt
http://twitter.com/TheSocialPitt/status/420966245773484032
— David Pittman (@TheSocialPitt)Wed, Jan 08 2014 17:12:28 - A2 Data doesn’t always speak for itself.Detail can be noisy/dirty.OTOH, aggr'd data can lead to Simpson's Paradox #BigDataMgmt
http://twitter.com/NeilRaden/status/420966257127485441
— Neil Raden (@NeilRaden)Wed, Jan 08 2014 17:12:31 - A2 Consider telemetrics for predictive maintentance.Every bit of data in phone lines not needed.Good models more important #BigDataMgmt
http://twitter.com/NeilRaden/status/420966715489402880
— Neil Raden (@NeilRaden)Wed, Jan 08 2014 17:14:20 - #bigdatamgmt A2: #BigData allows for whole-population #analytics! See @jameskobielus comments at: http://linkd.in/19dY2Ul
http://twitter.com/KirkDBorne/status/420966210763640832
— Kirk Borne (@KirkDBorne)Wed, Jan 08 2014 17:12:20 - #bigdatamgmt A2 alternative answer: #bigdata much more important, because nobody's going to get any marketing $$$ to talk about the opposite
http://twitter.com/timoelliott/status/420966724356161536
— Timo Elliott (@timoelliott)Wed, Jan 08 2014 17:14:22 - #bigdatamgmt A2: There are so many dimensions, correlations, "outliers", clusters/classes to discover with #BigData! pic.twitter.com/gfqVPhxw35
http://twitter.com/KirkDBorne/status/420967095669493760
— Kirk Borne (@KirkDBorne)Wed, Jan 08 2014 17:15:51 - A2: #bigdatamgmt Sandbox data,4 exploration, usually smaller than operatnl data. But sandbox where data sci finds patterns (ie core value)
http://twitter.com/jameskobielus/status/420967215572062208
— jameskobielus (@jameskobielus)Wed, Jan 08 2014 17:16:20 - A2: Both Small Data and Big Data are important. The more important thing is clean usable data! #bigdatamgmt
http://twitter.com/RyMontano/status/420967240591085568
— Ryan Montano (@RyMontano)Wed, Jan 08 2014 17:16:26 - Is big data primarily used for analyzing social media and customer sentiment?
- A4 Misconception/oversimplification that #BigData is only about customers and selling things. #BigDataMgmt
http://twitter.com/NeilRaden/status/420969169085947904
— Neil Raden (@NeilRaden)Wed, Jan 08 2014 17:24:05 - A4 Funnel Conversion,Cust Seg,Behavioral,Churn,etc.get lots of press,but prpmise of Bigdata (hopefully) is a better world #BigDataMgmt
http://twitter.com/NeilRaden/status/420969242888925184
— Neil Raden (@NeilRaden)Wed, Jan 08 2014 17:24:23 - #bigdatamgmt A4: I think you mean #DataScience & #Analytics! They're used on #BigData in ALL disciplines & domains: https://twitter.com/KirkDBorne/status/410535065932681216 …
http://twitter.com/KirkDBorne/status/420969588747022336
— Kirk Borne (@KirkDBorne)Wed, Jan 08 2014 17:25:45 - A4: #bigdatamgmt Not primary, but hot. Current #bigdata boom triggered in part by CMOs flocking to new ways 2 unlock social-media sentiment
http://twitter.com/jameskobielus/status/420969260144275456
— jameskobielus (@jameskobielus)Wed, Jan 08 2014 17:24:27 - A4: #bigdatamgmt #BigData (aka VLDB, stat/pred model), even pre-#Hadoop, often focused on cust data/analysis (eg NPS). Sentiment = mktg gold
http://twitter.com/jameskobielus/status/420969935234289664
— jameskobielus (@jameskobielus)Wed, Jan 08 2014 17:27:08 - “52% biz are making #bigdata investments primarily to improve the quality of their decision making” ~ IDG A4 #bigdatamgmt
http://twitter.com/Natasha_D_G/status/420969444517498880
— Natasha Bishop (@Natasha_D_G)Wed, Jan 08 2014 17:25:11 - #bigdatamgmt A4: "primarily" tough to judge. But also huge in things like curing cancer: http://www.saphana.com/community/blogs/blog/2012/04/09/hana-speeds-cancer-research-and-results …
http://twitter.com/timoelliott/status/420969624209858560
— Timo Elliott (@timoelliott)Wed, Jan 08 2014 17:25:54 - A4: No, many use cases of #bigdata for predictive maintenance, smart grid & 'smart cities,' financial, & terrorist tracking. #bigdatamgmt
http://twitter.com/TheSocialPitt/status/420969686419771392
— David Pittman (@TheSocialPitt)Wed, Jan 08 2014 17:26:09 - A4: #bigdatamgmt If you look at other hot #bigdata analytic apps (e.g geospatial, mobile, #CXO, IoT), many are customer/user focused.
http://twitter.com/jameskobielus/status/420970457588715520
— jameskobielus (@jameskobielus)Wed, Jan 08 2014 17:29:13
