Keeping identity graphs in sync with Apache Spark
summary
Describes managing a large identity graph at Hybrid Theory using Apache Spark and other common big data technologies to perform large-scale graph computation cost-effectively. Explains the practical approach and tooling used to keep the graph in sync without high infrastructure expense.
AI-written summary · about
chapters (5)
- 0:00Start
- 11:05BASIC SOLUTION
- 16:48ALTERNATIVES CONSIDERED...
- 25:26OUTPUT LAYOUT
- 37:34FURTHER IMPROVEMENTS
related talks
25mBuilding the World’s Largest Identity Graph without a Graph DB
29mIdentity Management in the Era of Big Data: The intersection of APIs, Hadoop & IdM
41mReal time identity graph
24mLarge Scale Graph Computation with Apache Giraph
44mHow We Store and Analyze a Large Social Graph
52mSolving Analytical Problems using Apache Spark
25mBuilding the World’s Largest Identity Graph
39mThorny path to the Large Scale Graph Processing