~/talk

Transparent and Flexible Network Management for Big Data Processing in the Cloud

on YouTube 21m
Talkat HotCloud '13 · 2013-06-25..06-26· [networking]

speakers

name:Anupam Das
links:none on file
name:Cristian Lumezanu
links:none on file
name:Yueping Zhang
links:none on file
name:Vishal Singh
links:none on file
name:Guofei Jiang
links:none on file
name:Curtis Yu
links:none on file

resources

video:https://youtu.be/6i9JlasrcWo
slides:none on file

summary

FlowComb is a network management framework that predicts Hadoop data transfers (detecting ~28% before they start and ~80% before they end), uses small software agents on every node to read logs and report sizes/status to a centralized decision engine, and enforces alternate routes by installing OpenFlow rules on a programmable network. On an 8-switch, 15-node testbed sorting 10GB it reduces completion time by ~35% while rerouting only ~6% of transfers; agent CPU overhead stays under 5%.

AI-written summary · about

chapters (10)

  1. 0:00Introduction
  2. 0:35Motivation
  3. 2:00Partition Aggregation
  4. 4:32Flowcom
  5. 7:27Software Agents
  6. 8:11Transfer Scheduling
  7. 9:11Enforce Path Change
  8. 9:34Recap
  9. 10:19Preliminary Experiments
  10. 10:36Preliminary Results

related talks

~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.