
Computing
Information Processing
- Class 45
- Practice 15
- Independent work 90
Course title
Information Processing
Lecture type
Elective
Course code
183369
Semester
5
ECTS
5
Lecturers and associates
- Full Professor PhD Sven Lončarić
- Full Professor PhD Damir Seršić
- Associate Professor PhD Marko Subašić
Course objectives
Problem definition.
Advantages and drawbacks.
Machine learning tasks and applications; Machine learning approaches and paradigms; Hypothesis, model, parameter space, version space.
Inductive learning and inductive bias, language and preference bias; Loss function and error function; Overfitting and model selection, empirical and structural risk minimization.
Perceptron (learning paradigms,Hebbian learning, competitive learning, Boltzmann learning); Multilayer perceptron (error-backpropagation learning, credit-assignment problem, backpropagation through time); Self-organizing networks (Hebbian non-supervised learning, Oja's learning rule, PCA using self-organizing network, Sanger's learning rule, Competitive non-supervised learning, winner-takes-all network, Kohonen's self-organizing maps); Radial basis function networks (solving interpolation problem with radial basis function networks, generalized radial basis function networks, relation to regularization theory).
Recurrent neural networks (Hopfield network, Hopfield network energy function, Boltzman machine, Elman networks, Jordan networks) and learning algorithms (back propagation through time, reccurent backpropagation); Network ensembles (committee machines, mixture of experts, convolutional neural networks); Spike neuron model and spiking neural network.
Parametric models; Parameter estimation; Speech feature vectors; Cepstral analysis; Hommomorphic analysis.
Midterm exam.
Definition; Terms; Examples of real-world networks and their properties.
Classification in computational finance; Modelling in computational finance.
Document classification and tagging; Document clustering; Text information extraction (named entities, keyphrases, relations, etc.); Event detection and tracking; Document summarization, multidocument summarization; Latent semantic document models (LSI, LDA); Textual similarity, paraphrase, and entailment.
Light and EM spectrum; Human visual system; Image sampling and quantization; Discrete geometry; 2D linear systems; Image sensors; Basic image processing operations; Application areas.
Problem definition; Feature extraction; Image segmentation; Texture analysis; Shape analysis; Motion analysis.
Protein, RNA and DNA; Biological sequences and structures; Bioinformatics databases; Data formats.
Final exam.
Required reading
S. Lončarić, D. Seršić, M. Subašić (2008.), Obrada informacija: materijali za predavanja, FER, elektronička publikacija
T. Petković, D. Seršić, S. Lončarić (2008.), Obrada informacija: Upute za laboratorijske vježbe, FER, elektronička publikacija
James H. McClellan, Ronald Schafer, Mark Yoder (2015.), Signal Processing First, Pearson College Division
Rafael C. Gonzalez, Richard Eugene Woods (2008.), Digital Image Processing, Prentice Hall
Online education during epidemiological measures
- Study program duration
- 6 semesters (3 years)
- Semester duration
- 15 weeks of active teaching + 5 examination weeks
- Total number of ECTS points
- 180
- Title
- Bacc.ing.comp (Bachelor of Science in Computing)
Academic calendar
Minimal learning outcomes
- Identify and explain fundamental techniques of signal processing
- Identify and explain fundamental techniques of machine learning
- Identify and explain fundamental techniques of image processing analysis
- Identify and explain fundamental techniques of text analysis
- Identify and explain fundamental techniques of speech analysis
- Identify and explain fundamental techniques of computational finance
- Identify and explain fundamental techniques of bioinformatics
- Identify and explain fundamental techniques of complex networks