Intelligent Information Systems Lab

• Description
• General Information
• Resources
• Further Resources
• Lab Sessions

Description

Intelligent information systems are AI-based systems that aid users to fulfill their information needs in everyday life and professional contexts such as medicine, technology, or science. The challenge lies in developing the most helpful system for exploring and understanding information regarding a specific domain or application. In addition to conventional web search engines, intelligent information systems also include interactive systems such as dialog systems and chatbots, which implement a conversation-driven search. These systems combine traditional AI methods with machine learning, and language models in particular. In the lab project, intelligent information systems are implemented and evaluated using the above-mentioned technologies based on current research.

General Information

Resources

• 01 - Developing a RAG system [view] [download]
• 02 - Hands-On Introduction to Slurm on the Webis GPU Cluster [view]

Further Resources

• 01 - Introduction to Python [view] [download]
• 02 - Introduction to Jupyter [view] [download]
• 03 - How to commandline [MIT's missing-semester]

Lab Sessions

Date	Title	Description	Materials	Deliverables
17.10.2024	Introduction (Session 1)	Introduction & Onboarding	[slides]
25.10.2024	Literature Research (Session 2)	How to do literature research & first steps on the cluster	[slides]
31.10.2024	Text Classification (Session 3)	Intro to text classification	[slides]	Literature Research
07.11.2024	Representation Learning I (Session 4)	Intro to representation learning	[slides]	Sentiment Classifier
14.11.2024	Representation Learning II (Session 5)	Representation learning with transformers	[slides]	Sentiment Classifier using Word Embeddings
21.11.2024	Representation Learning III (Session 6)	Fine-tuning a BERT model	[slides]	Sentiment Classifier using SBERT Embeddings
28.11.2024	RAG Quality I (Session 7)	RAG Quality (Pointwise)	[slides]	Fine-tuned BERT model
05.12.2024	RAG Quality II (Session 8)	RAG Quality (Pairwise)		Pointwise RAG Quality Classifier
12.12.2024	RAG Relevance I (Session 9)	Intro to negative sampling	[slides]	Pairwise RAG Quality Classifier
19.12.2024	RAG Relevance II (Session 10)	Intro to ranking functions	[slides]	RAG Relevance Classifier
16.01.2025	RAG Entailment (Session 11)	Intro to entailment		RAG Relevance Ranker
23.01.2025	Q&A (Session 12)	Q&A for lab presentation and report		RAG Entailment Classifier
30.01.2025	Final Presentations	Oral presentations		Lab Presentation
13.02.2025	Final Report	Written report		Lab Report