Data Analytics with the Big Data NIST Reference...
summary
Volume 8 of the NIST Big Data Reference Architecture is accepted last week and a working reference implementation exists: a pipeline converts the OpenAPI 3.0 specification into REST web services and language bindings, deploys them via cloudmesh multi-cloud interfaces to AWS Azure OpenStack Google and Oracle, and runs analytic services (scikit‑learn k‑means example) on a deployed virtual cluster at San Diego Supercomputing Center. The docs total ~1,000 pages, interfaces boot clusters (example: start up a cluster with 50 nodes or Gregor[1-1000] VMs), and the prototype is demonstrably runnable.
AI-written summary · about
chapters (12)
- 0:00NIST Big Data reference intro
- 2:13Talk purpose and scope
- 7:16Volume 8 testing
- 12:17Automated spec to pipeline
- 18:00OpenAPI and REST interfaces
- 23:48Scalable service framework
- 25:57CI and deployment strategies
- 29:12Cloudmesh multi-cloud VMs
- 35:43Cloudmesh hybrid integration
- 41:03Cloudmesh advanced features
- 45:04AI services and automation
- 46:08Q&A
related talks
07mIn-Hadoop Analytics: Bringing analytics to big data
47mReference Architecture of AI in the Cloud
36mThe MODERN Modern Data Stack: Building an Open Distributed Data Warehouse Beyond...
31mBuilding a Data Infrastructure for AI/ML
46mA Data Mesh Reference Implementation on AWS
40mData Intelligence Platform on AWS
41mBig Data Serving: The Last Frontier. Processing and Inference at Scale in Real Time
49mData Platform Architecture, Evolution, and Philosophy