Open AI + Data Forum @ Open Source Summit North America 2024
2024-04-16..2024-04-18
Seattle, United States
[Open AI + Data Forum @ Open Source Summit North America 2022, Open AI + Data Forum @ Open Source Summit North America 2023, Open AI + Data Forum @ Open Source Summit North America 2024]
who it's for
machine learning engineers, ml infrastructure engineers, platform engineers, data engineers, research engineers, open source project maintainers, engineering managers
topics
LLaMA 70B inference and costs; large model benchmarking and runtimes; retrieval augmented generation pipelines; vector databases with Milvus; LoRA adapter packing and serving; model openness framework and moff.json; open enterprise RAG platform (Opia); PyTorch compile and distributed training; translation augmented generation; edge ML deployment with BentoML and OpenVINO; Wasm and Rust for AI agents
| title | author | length |
|---|---|---|
| Unraveling Multimodality with Large Language Models | Alex Coqueiro | 38m |
Claims that open-source LLaMA 70B (moving to LLaMA 3) can power a nurse-facing healthcare assistant, chosen by evaluating speed, cost, precision; code uses… | ||
| Translation Augmented Generation - Breaking Language Barriers in RAG... | Raghavan Muthuregunathan | 33m |
Builds a simple translation layer that translates non-English prompts to English, calls GPT (3.5/4) or other LLMs, then reverse-translates output; tests use… | ||
| The Open Source AI Dilemma: Crafting a Clear Definition for Open Source AI | Ofer Hermoni, Mer Joyce | 42m |
Project produces a concrete model openness framework that breaks an AI system into 16 elements, sorts them into three openness classes, and maps which… | ||
| The Model Openness Framework: Promoting Completeness and Openness for Reproducibil... | Matt White | 34m |
A framework that classifies models by completeness and binary openness and lists 16 artifacts (architecture, weights, eval data, model card, etc.) produces a… | ||
| Sustainably Automate Manual Cell-Staining with Innovative Open-Sour... | Neethu Elizabeth Simon, Elizabeth Lee | 39m |
AiCSD automates toxic cell staining by replacing wet stains with virtual staining AI-models and running inference on a two-node edge pipeline (OEM + Gateway)… | ||
| Sponsored Session: Beyond the Buzz: Navigating AI's Myths and Realities | Ezequiel Lanza | 47m |
Claim: superhuman or general AI remains distant with survey estimates shifting from 10% in 2022 to 90% by 2075; current wins are practical not mystical… | ||
| Milvus: Scaling Vector Data Solutions with Gen AI | Yujian Tang | 36m |
Milvus is a distributed, cloud-native vector database built on MinIO and Kafka and designed to scale to billion-plus collections (the project started after a… | ||
| LoRAX: Serve 1000s of Fine-Tuned LLMs on a Single GPU | Travis Addair | 32m |
LoRAX claims to pack 1000s of LoRA adapters on a single GPU by keeping a base model resident and swapping tiny LoRA checkpoints just-in-time, with first‑time… | ||
| Introducing Open Platform for Enterprise AI | Ramakrishna Karamsetty, Arun Gupta | 35m |
Launches an open platform called Opia with a GitHub org and Opia GitHub org reference flows for chat Q&A, document summarization and video; aims to standardize… | ||
| HW, SW, Performance and Costs for Llama-2 70b and Mixtral 8x7b LLM Inference with Low... | Ivan Baldo | 52m |
Benchmarks use hamelsmu’s repo and containerized runtimes (NVIDIA Container Toolkit + CDI) across CTranslate2, MLC, Hugging Face Transformers, Triton, TGI and… | ||
| How We Built DBRX - An Open High-quality LLM | Denny Lee, Ankit Mathur | 43m |
Databricks builds DBRX as an open foundation LLM trained on 12 trillion curated tokens using Spark, MLflow, LLM Foundry and Megablocks, using a sparse… | ||
| Get to Know PyTorch - A Cutting Edge Open Source AI Framework for Deep Learning | Sahdev P. Zala | 47m |
Overview of PyTorch fundamentals, current Foundation status and practical tooling: PyTorch moves under the Linux Foundation (PyTorch Foundation, Sept 2022)… | ||
| Flyte: Production-Grade Data and Machine Learning Orchestration | Shivay Lamba, Ekansh Gupta | 39m |
Platform claim: a Kubernetes-native workflow automation system (Flyte) that registers workflows to an admin, stores metadata in RDS/S3, and executes tasks as… | ||
| Embracing AI in Education: A Path to Inclusive and Effe... | Juan Pablo Flores, Ashwin Kumar Uppala | 36m |
GitHub Education reports experiments using LLMs like Copilot and ChatGPT for classrooms, citing cs50 AI as a guard-railed tutor that gives steps not full… | ||
| Creating Versatile AI Agents Through Wasm+Rust | Miley Fu | 41m |
Claim: compile Rust into WebAssembly to run open-source LLMs as tiny, portable services. Uses WasmEdge runtime, WASI/WASI‑NN + WebGPU and integrates Hugging… | ||
| Conversational Assistants that Converse with Each Other | Deborah Dahl | 42m |
Proposal to make independent chatbots interoperate using simple JSON messages: three specs (dialogue events, conversation envelope, an assistant manifest near… | ||
| BOF: Trusted AI - Discussion of Model Evaluation Tools, Guidelines, and Geographic... | Susan Malaika | 35m |
Generative AI Commons runs a Responsible AI workstream producing a Responsible AI framework paper with named sections needing volunteers, weekly bi‑weekly… | ||
| AI Regulations: A Healthy Tension with Innovation or Stifling Bureaucracy? | Rebecca Lively | 39m |
Compares broad legal definitions, patchwork US and state rules, and pending UK/China/India drafts, showing regulation targets governments more than open source… | ||
| Lightning Talk: Open Source GenAI: A Community-Powered Future | Ofer Hermoni | 11m |
Linux Foundation AI reports 64–65 hosted projects, ~650 contributing organizations, and over 100,000 historical contributors with 30,000 in the past year, and… | ||
| nothing matches | ||