~/talk

ValBench: Benchmarking exact value analysis

on YouTube 18m
Talkat SOAP 2024 · on Tuesday, 2024-06-25· [testing, java]

speakers

name:Marc Miltenberger
links:none on file
name:Steven Arzt
links:none on file

resources

video:https://youtu.be/U6n7_bJmbl4
slides:none on file

summary

ValBench provides 372 Java, 59 Android tests and an evaluator that generates ground truth by execution on JVM or emulator, then runs and compares seven existing value analysis tools. It flags challenges (loops, arrays, fields, interprocedural calls, StringBuilder, API models), reports that vroid and stringHound find many exact values while Harvester is partial and JSA often outputs useless over‑approximating regexes like .* and misses concrete secrets, and publishes artifacts and generators.

AI-written summary · about

chapters (10)

  1. 0:00ValBench introduction
  2. 2:05Value analysis challenges
  3. 3:54Concrete vs approximations
  4. 7:44Limitations of JSA
  5. 8:50ValBench design goals
  6. 10:19Ground truth generation
  7. 11:43Modern value analysis challenges
  8. 13:31Testing value analysis results
  9. 14:59Making ValBench public
  10. 15:45Q&A

related talks

~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.