Batch Data to Graphs: Integrating Neo4j and Flink via JDBC

on YouTube ↗12m

" summary

Shows a working pattern to import a bounded dataset from Flink into Neo4j using the Neo4j JDBC/GDBC driver and Flink’s JDBC connector, assembling a DataStream source, a prepared-statement writer with batch size 500, and running the job on a StreamExecutionEnvironment. It uses native Cypher or optional SQL-to-Cypher translation, requires Java 11+ (recommend Flink 2.1), provides at-least-once delivery and can produce duplicates, needs manual ordering of node/relationship imports and manual schema/index setup.

AI-written summary · about

" chapters (9)

1. 0:00Introduction
2. 0:48What is Apache Flink
3. 2:14Key components overview
4. 3:20Code setup and configuration
5. 4:03Defining Flink job
6. 5:31Executing the sync
7. 5:53Using SQL with Neo4j
8. 7:41Limitations and constraints
9. 10:55Conclusion and resources

" related talks

• 32mThe easy way to build and run Flink SQL jobs using Cloudera SQL Stream BuilderKenny Gorman · Flink Forward Global 2021
• 43mA Data Streaming Architecture with Apache Flink #bbuzzRobert Metzger · Berlin Buzzwords 2016
• 43mContinuous SQL with Kafka and FlinkTimothy J Spann · JCON WORLD ONLINE 2023
• 46mFlink SQL in 2020: Time to show off!Timo Walther, Fabian Hueske · Flink Forward Virtual 2020
• 39mBetter, Faster, Stronger Streaming: Your First Dive into Flink SQLCaito Scherr · Data Con LA 2021
• 23mBetter, Faster, Stronger Streaming: Your First Dive into Flink SQLCaito Scherr · DataEngBytes 2021
• 42mApache Flink deep-dive #bbuzzStephan Ewen · Berlin Buzzwords 2015
• 38mApache Flink: A Very Quick GuideVladimir Bacvanski · Data By the Bay 2016