"Big Data" and Analytics in Government
summary
Government holds massive structured and unstructured stores and the computational know-how via DOE/NSF procurement patterns to catalyze industry builds, then apply real-time packet-level analytics to detect botnet patterns, run predictive models for the smart grid that yield 10–20% efficiency gains by shifting consumer loads, and instrument compliance tick-by-tick for electronic trading. Built pilots include network monitoring that detects repeatable attack signatures and 48–72 hour “jam sessions” using large-scale text analytics on 400,000 participants to surface persistent topics.
AI-written summary · about
chapters (6)
- 0:00Big data in government
- 1:48Government data advantages
- 4:12Real-time analytics challenges
- 7:20Batch to real-time shift
- 9:45Regulation and compliance
- 11:50Human-machine collaboration
related talks
26mGrappling with massive data in the Public sector
11mData Science and Smart Systems: Creating the Digital Brain
06mEnterprise Big Data Hub & the Federal Government
38mReal world data & analytics journeys
22mInvesting in Data Analytics
47mBig Data for Good or Evil -- Lessons from the NSA PRISM Scandal
08mDavid Barnes interviewed at Web 2.0 Summit 2011
19mDemystifying Big Data