High-Performance Data Connectivity: Integrating MarkLogic with Progress DataDirect
summary
Flux claims to replace MLCP CORB and DM SDK with one CLI and Java/Spark API, and shows live demos: Flux combines MLCP CORB and DM SDK to import JDBC data from Salesforce via DataDirect, ingest files (CSV, JSON, XML), run a Java loader, chunk text into ~1,000‑char LLM sidecars, call Semaphore for classification, add vector embeddings and reprocess documents to add fields, then export a filtered set (five records in the demo). DataDirect supplies high‑performance JDBC/ODBC drivers, SQL-over-REST mapping, caching, pagination and an autonomous REST connector for APIs.
AI-written summary · about
chapters (5)
- 0:00Introduction to talk
- 0:23What is MarkLogic Flux
- 6:03DataDirect overview
- 13:07Flux demos begin
- 36:08Q&A session
related talks
49mBuilding data lakes for your customers
18mSnapLogic and Amazon Redshift transform insights at Lumeris
05mProject Lightning Talk: Fluid Data Anyway, Data Anywhere, Data Anytime
12mPower a Better Future
05mFernando Mesa from MarkLogic interviewed at Strata Rx 2013
30mFrom Data Lake Entanglement to Data Mesh Decoupling: Scaling a Self-Service Data Platform
30mThe Future of Data is Words
40mData Mesh, Data Fabric and DataOps; what should you choose?