Cím angolul:
Developing a theory of representation learning by simulating the effect of inductive biases
Típus:
BSc szakdolgozat téma - fizikus
MSc diplomamunka téma - nanotechnológia és anyagtudomány
MSc diplomamunka téma - optika és fotonika
MSc diplomamunka téma - kutatófizikus
MSc diplomamunka téma - nukleáris technika
MSc diplomamunka téma - orvosi fizika
Félév:
2023/24/2.
Témavezető:
Név:
Fiser Jozsef
Email cím:
fiserj@ceu.edu
Intézet/Tanszék/Cégnév:
CEU, Kognitív Tudományi Tanszék
Beosztás:
egyetemi tanár
Konzulens:
Név:
Varga Imre
Email cím:
varga.imre@ttk.bme.hu
Intézet/Tanszék:
Fizikai Intézet, Elméleti Fizika Tanszék
Beosztás:
egyetemi docens
Elvárások:
Strong interest in understanding the algorithmic structure of learning problems, ability to independently process literature in English and implement software in python, basic knowledge of linear algebra, calculus and probability theory, experience with machine learning algorithms is a plus
Leírás:
Representation learning is a process that an agent uses to alter which pieces of information it retains from its input stream, and which pieces it discards, implementing an intelligent compression scheme. There are strong theoretical underpinnings for using Bayesian inference for compression problems, and also for learning to make good decisions based on a pre-existing representation, but there is currently no theory describing how representations should change over time in a task-based setting, which would be of major interest to both cognitive science and machine learning. We want to develop such a theory by formalising the interplay between the inductive biases of the agent, the constraints on available resources and the task objective in a learning algorithm. The student will participate in the algorithmic design of agents and tasks testing the theory, the implementation of the tree-search based and gradient-based algorithmic components, and the evaluation of the results.
Titkosítas:
Hozzáférés nincs korlátozva