Probabilistic Reasoning by First-Order Model Counting
summary
Weighted first‑order model counting (WFOMC) reduces Markov logic networks to a sentence plus a weight function and exploits weight symmetry to perform lifted inference that computes partition functions and query probabilities far faster than grounding; FO2 sentences, safe UCQs and gamma‑acyclic queries are domain‑liftable, the shuffled‑deck example yields N! in polynomial time, and a learned MLN with 30k entities (≈900M ground vars) evaluates partition functions in seconds. Open‑world use adds lambda bounds for missing tuples; some three‑variable formulas are Sharp‑P1 hard and evidence breaks symmetries (mitigated by lifted MCMC using approximate symmetries).
AI-written summary · about
chapters (38)
- 0:00Intro
- 0:25What we'd like to do...
- 0:46Einstein is in the knowledge Graph
- 4:54Statistical Relational Learning
- 5:28What's Going On Here?
- 5:50Tractable Reasoning
- 6:29First-Order Model Counting
- 7:14Weighted First Order Model Counting Model solution to first-order logic formula
- 8:07Probabilistic Database Rules
- 8:31Asymmetric WFOMC Rules
- 9:29Example MLN to WFOMC
- 12:52FOMC Inference
- 15:18Playing Cards Revisited
- 17:36Why not do propositional WMC?
- 18:03Deck of Cards Graphically
- 19:01Observations
- 20:42Tractable Classes
- 25:50Open World DB
- 27:02Intuition
- 27:50Bayesian Learning Loop
- 28:27Problem: Broken Learning Loop
- 29:14Problem: Curse of Superlinearity
- 30:30Open-World Prob. Databases
- 32:50Closed-World Lifted Query Eval
- 34:08Open-World Lifted Query Eval
- 35:02Complexity Results
- 36:53Lifted Parameter Learning
- 37:47Lifted Structure Learning
- 38:07Generalized Model Counting
- 38:23Weighted Model Integration
- 38:50Probabilistic Programming
- 39:10Probabilistic Functional Programming
- 39:28First-Order Knowledge Compilation
- 40:01Exchangeability
- 40:37Results for Symmetric Inference
- 41:01Conclusions
- 41:33Long-Term Outlook
- 46:11Approximate Symmetries in MCMC
related talks
37mFirst-Order Model Counting and Sampling
01h 02mOut-of-Distribution Generalization as Reasoning: Are LLMs Competitive?
11mProbabilistic Programming Meets Automata Theory: Exact Inference using Weighted Automata
48mWeighted Model Integration
36mEnhanced and Efficient Reasoning in Large Language Models
01h 05mLogic and Probabilistic Circuits 1
24mHigher order programming with probabilistic effects: A model of stochastic memo...
01h 03mLogic and Probabilistic Circuits 2
