ITI41720 Machine Learning and Deep Learning (Autumn 2024)

The course is connected to the following study programs

Mandatory course in the master programme in applied computer science with specialisations in artificial intelligence, cyber security and internet of things, full-time and part-time.

Lecture Semester

First semester (autumn) in the full-time and part-time programme (For those who started in 2023)

First, third and seventh semster in the part-time programme (For those who started in 2021 and 2022)

The student's learning outcomes after completing the course

Knowledge

The student

• is familiar with both the possibilities and advantages of employing the machine learning methods in the course, as well as possible problems that may be encountered and how to overcome them.
• knows how the algorithms presented in the course work and their characteristics, for example which problems they work best for, overfitting, expected accuracy and computational requirements, for example how much benefit that accelerators may provide.

Skills

Given a machine learning application, the student is able to

• determine which theory and which methods that are presented in the course that are relevant and also how to apply them.
• perform hyperparameter tuning or in some cases even perform modifications of the source codes.
• use at least one implementation for each of the major machine learning techniques that are taught in the course.

General competence

The student

• is able to independently read machine learning papers and other literature and evaluate what works well and what does not for new problems.
• knows the terminology of machine learning and is familiar with the mathematics that is common in the field.
• knows the general behaviour of machine learning methods for example regarding how much data that is required, how to preprocess the data and ensure that its quality is sufficient.

Content

This course gives an advanced insight into the main methods used in machine learning. The topics covered in this course are:

• Concepts related to basic types of learning (supervised, unsupervised, reinforcement): preprocessing, feature extraction, overfitting, error functions
• Decision and regression trees, random forest and XGBoost
• Artificial neural networks, deep learning
• Introduction to transformers and large language models
• Recurrent neural nets, including state space models
• Convolutional neural nets
• Architecture search

Ethics and privacy in machine learning is also mentioned.

Additionally, the course contains up to date topics that are not known when this text is being written.

Forms of teaching and learning

The students will learn by attending lectures, read the books, papers and online material in the course reading list and above all by working on two projects. The project work is supervised each week and results in a 10 pages report for each project. These reports are part of the examination in the course.  

Workload

Approx. 280 hours.

Examination

Portfolio and individual written exam

The exam consists of both a portfolio and an individual written exam.

The portfolio (determines 65% of the final grade) consists of two projects. The projects can be carried out individually or in groups of maximum tree students. The students will get an individual grade.

The individual written exam determines 35% of the final grade and focuses on theory. Duration 3 hours. No supporting materials allowed.

Both parts of the exam must be passed to pass the exam as a whole. The student will get an individual joint grade for the entire course. Grades: A - F.

Examiners

One external and one internal examiner, or two internal examiners will be involved in the assessment.

Conditions for resit/rescheduled exams

Upon re-examination, each part of the examination can be retaken.

Course evaluation

This course is evaluated by a

• Final course evaluation (compulsory)

The responsible for the course compiles a report based on the feedback from the students and his/her own experience with the course. The report is discussed by the study quality committee of the faculty of Computer Sciences.

Literature

The current reading list for 2024 Autumn can be found in Leganto