Holy Cummins

Senior Principal Software Engineer, Red Hat

Speaker's Bio

In this session, we’ll explore how to infuse AI capabilites into Java applications, using LangChain4j and its Quarkus integration. We’ll start from the Quarkus DevUI where you can try out AI models even before writing any code. Then we’ll explore LangChain4j features such as prompting, chaining, and preserving state; agents and function-calling; enriching your AI model’s knowledge with your own documents using retrieval augmented generation (RAG); and discovering ways to run (and train) models locally using tools like Ollama and/or Podman AI Lab. In addition, we’ll take a look at observability and fault tolerance of the AI integration and compile the app to a native binary.

In this session, we’ll explore how to infuse AI capabilites into Java applications, using LangChain4j and its Quarkus integration. We’ll start from the Quarkus DevUI where you can try out AI models even before writing any code. Then we’ll explore LangChain4j features such as prompting, chaining, and preserving state; agents and function-calling; enriching your AI model’s knowledge with your own documents using retrieval augmented generation (RAG); and discovering ways to run (and train) models locally using tools like Ollama and/or Podman AI Lab. In addition, we’ll take a look at observability and fault tolerance of the AI integration and compile the app to a native binary.

2024 AI
AI

Leverage LLMs in Java with LangChain4j and Quarkus

Fri 22 Nov 2024 • 12:45 (CET)
Auditorium

What happens when Java meets Generative AI? In this high-energy session, Holly Cummins and George Andrianakis show how developers can use LangChain4j and Quarkus to integrate large language models (LLMs) directly into Java applications — with type safety, prompt engineering, state handling, and tool orchestration baked in. From writing code to sending AI-generated poems by email, this talk has it all.

Holly Cummins Georgios Andrianakis

Day oppening: Impossible is Nothing

A discussion of building global success and how artificial intelligence is transforming the world.

Closing

Hackathon Final Pitching

Open Award

Panel / Debate discussion

Gold Sponsor Speech