<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=utf-8"><meta name=Generator content="Microsoft Word 15 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin-top:0cm;
margin-right:0cm;
margin-bottom:8.0pt;
margin-left:0cm;
line-height:105%;
font-size:11.0pt;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
span.EmailStyle18
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:70.85pt 70.85pt 70.85pt 70.85pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=SL link="#0563C1" vlink="#954F72" style='word-wrap:break-word'><div class=WordSection1><p class=MsoNormal style='margin-bottom:0cm;line-height:normal'>Vabimo vas na 14. predavanje iz sklopa <b><span style='color:#C45911'>»Kolokviji na IJS«</span></b> v akademskem letu 2022/23, ki bo v <b><span style='color:#C45911'>četrtek (ne sredo!), 29. junija 2023, ob 13:00</span></b><span style='color:#C45911'> </span>v Veliki predavalnici Instituta »Jožef Stefan«<strong><span style='font-family:"Calibri",sans-serif'> </span></strong><strong><span style='font-family:"Calibri",sans-serif;font-weight:normal'>na Jamovi cesti 39 v Ljubljani. Predavanje bo <span style='color:#C45911'>v angleščini</span>. Na voljo bodo <span style='color:#C45911'>kava, pijača in prigrizki</span>.</span></strong><strong><span style='font-family:"Calibri",sans-serif;color:#338684;font-weight:normal'><o:p></o:p></span></strong></p><p class=MsoNormal style='margin-bottom:0cm;line-height:normal'><strong><span lang=EN-US style='font-family:"Calibri",sans-serif'><o:p> </o:p></span></strong></p><p class=MsoNormal style='margin-bottom:0cm;line-height:normal'><strong><span lang=EN-US style='font-family:"Calibri",sans-serif'><o:p> </o:p></span></strong></p><p class=MsoNormal style='margin-bottom:0cm;line-height:normal'><b><span style='font-size:12.0pt'>prof. dr. Thomas G. Dietterich</span></b><span style='font-size:12.0pt'><o:p></o:p></span></p><p class=MsoNormal style='margin-bottom:0cm;line-height:normal'><i>Oregon State University, ZDA<o:p></o:p></i></p><p class=MsoNormal style='margin-bottom:0cm;line-height:normal'><i><o:p> </o:p></i></p><p class=MsoNormal style='margin-bottom:0cm;line-height:normal'><b><span style='font-size:14.0pt;color:#C45911'>Kaj je narobe z velikimi jezikovnimi modeli in s čim bi jih morali nadomestiti</span></b><b><span style='font-size:14.0pt;color:#338684'><o:p></o:p></span></b></p><p class=MsoNormal style='margin-bottom:0cm;line-height:normal'><span style='font-size:12.0pt'><o:p> </o:p></span></p><p class=MsoNormal style='margin-bottom:0cm;line-height:normal'><span lang=EN-US>Veliki jezikovni modeli (LLM, iz angleščine) zagotavljajo prednaučeno osnovo za učenje številnih zanimivih sistemov umetne inteligence. Vendar imajo veliko pomanjkljivosti. Njihovo učenje in posodabljanje je drago, imajo slabo nejezikovno znanje, dajejo napačne in nasprotujoče si izjave, ki so za nameček lahko tudi družbeno in etično neprimerne. V predavanju bom povzel te pomanjkljivosti in trenutna prizadevanja za njihovo reševanje znotraj obstoječega okvira LLM-jev. Nato se bom zavzel za drugačno, bolj modularno arhitekturo, ki razgradi funkcije obstoječih LLM-jev in jim doda več drugih komponent. Verjamem, da lahko ta alternativa odpravi vse pomanjkljivosti LLM-jev. Razmišljal bom o tem, kako bi to modularno arhitekturo lahko zgradili s kombinacijo strojnega učenja in inženiringa.</span><o:p></o:p></p><p class=MsoNormal style='margin-bottom:0cm;line-height:normal'><o:p> </o:p></p><p class=MsoNormal style='margin-bottom:0cm;line-height:normal'><b><span lang=EN-US>O predavatelju:</span></b><span lang=EN-US> Thomas G. Dietterich je zaslužni profesor na Fakulteti za elektrotehniko in računalništvo na Državni univerzi Oregon v ZDA. Je eden od pionirjev na področju strojnega učenja ter je avtor več kot 225 recenziranih člankov in dveh knjig. Njegove trenutne raziskovalne teme vključujejo robustno umetno inteligenco, robustne sisteme človek-AI in aplikacije na področju trajnosti.</span><o:p></o:p></p><p class=MsoNormal style='margin-bottom:0cm;line-height:normal'><o:p> </o:p></p><p class=MsoNormal style='margin-bottom:0cm;line-height:normal'><o:p> </o:p></p><p class=MsoNormal style='margin-bottom:0cm;line-height:normal'>Napovednik predavanja najdete tudi na naslovu <span lang=EN-US><a href="http://www.ijs.si/ijsw/Koledar_prireditev"><span lang=SL style='color:#C45911'>http://www.ijs.si/ijsw/Koledar_prireditev</span></a></span>, posnetke preteklih predavanj<span style='color:blue'> </span>pa na <span lang=EN-US><a href="https://video.arnes.si/?hashtag=Kolokviji_IJS"><span lang=SL style='color:#C45911'>Arhiv TV IJS</span></a></span> in <span lang=EN-US><a href="http://videolectures.net/kolokviji_ijs"><span lang=SL style='color:#C45911'>http://videolectures.net/kolokviji_ijs</span></a></span>.<o:p></o:p></p><p class=MsoNormal style='margin-bottom:0cm;line-height:normal'><o:p> </o:p></p><p class=MsoNormal style='margin-bottom:0cm;line-height:normal'><o:p> </o:p></p><p class=MsoNormal style='margin-bottom:0cm;line-height:normal'>--<o:p></o:p></p><p class=MsoNormal style='margin-bottom:0cm;line-height:normal'><b><span lang=EN-US><o:p> </o:p></span></b></p><p class=MsoNormal style='margin-bottom:0cm;line-height:normal'><b><span lang=EN-US><o:p> </o:p></span></b></p><p class=MsoNormal style='margin-bottom:0cm;line-height:normal'><span style='color:black'>We invite you to the 14th lecture in the framework of </span><b><span style='color:#C45911'>»JSI Colloquia«</span></b><span style='color:black'> </span>in the academic year 2022/23, which will take place on <b><span style='color:#C45911'>Thursday (not Wednesday!), June 29, 2023, at 1:00 PM</span></b><span style='color:#C45911'> </span>in the main lecture hall of Jožef Stefan Institute<strong><span style='font-family:"Calibri",sans-serif;font-weight:normal'>, Jamova cesta 39 in Ljubljana. The lecture will be held in <span style='color:#C45911'>English</span>.</span></strong> <span style='color:#C45911'>Coffee, drinks and snacks</span> will be available.<o:p></o:p></p><p class=MsoNormal style='margin-bottom:0cm;line-height:normal'><o:p> </o:p></p><p class=MsoNormal style='margin-bottom:0cm;line-height:normal'><o:p> </o:p></p><p class=MsoNormal style='margin-bottom:0cm;line-height:normal'><b><span style='font-size:12.0pt'>Prof. dr. Thomas G. Dietterich</span></b><span style='font-size:12.0pt'><o:p></o:p></span></p><p class=MsoNormal style='margin-bottom:0cm;line-height:normal'><i>Oregon State University, USA<o:p></o:p></i></p><p class=MsoNormal style='margin-bottom:0cm;line-height:normal'><i><o:p> </o:p></i></p><p class=MsoNormal style='margin-bottom:0cm;line-height:normal'><b><span style='font-size:14.0pt;color:#C45911'>What's wrong with large language models and what we should be building instead<o:p></o:p></span></b></p><p class=MsoNormal style='margin-bottom:0cm;line-height:normal'><span style='font-size:12.0pt'><o:p> </o:p></span></p><p class=MsoNormal style='margin-bottom:0cm;line-height:normal'><span lang=EN-US>Large Language Models (LLMs) provide a pre-trained foundation for training many interesting artificial intelligence systems. However, they have many shortcomings. They are expensive to train and to update, their non-linguistic knowledge is poor, they make false and self-contradictory statements, and these statements can be socially and ethically inappropriate. In this talk, I will review these shortcomings and current efforts to address them within the existing LLM framework. I will then argue for a different, more modular architecture that decomposes the functions of existing LLMs and adds several additional components. I believe this alternative can address all of the shortcomings of LLMs. I will speculate about how this modular architecture could be built through a combination of machine learning and engineering.<o:p></o:p></span></p><p class=MsoNormal style='margin-bottom:0cm;line-height:normal'><o:p> </o:p></p><p class=MsoNormal style='margin-bottom:0cm;line-height:normal'><b><span lang=EN-US>About the lecturer:</span></b><span lang=EN-US> Thomas G. Dietterich is Distinguished Professor Emeritus in the School of Electrical Engineering and Computer Science at Oregon State University, USA. He is one of the pioneers of the field of machine learning and has authored more than 225 refereed publications and two books. His current research topics include robust artificial intelligence, robust human-AI systems, and applications in sustainability.<o:p></o:p></span></p><p class=MsoNormal style='margin-bottom:0cm;line-height:normal'><o:p> </o:p></p><p class=MsoNormal style='margin-bottom:0cm;line-height:normal'><o:p> </o:p></p><p class=MsoNormal style='margin-bottom:0cm;line-height:normal'>You can find the lecture trailer at <span lang=EN-US><a href="http://www.ijs.si/ijsw/Koledar_prireditev"><span lang=SL style='color:#C45911'>http://www.ijs.si/ijsw/Koledar_prireditev</span></a></span>, and recordings of past lectures at <span lang=EN-US><a href="https://video.arnes.si/?hashtag=Kolokviji_IJS"><span lang=SL style='color:#C45911'>Arhiv TV IJS</span></a></span> and <span lang=EN-US><a href="http://videolectures.net/kolokviji_ijs"><span lang=SL style='color:#C45911'>http://videolectures.net/kolokviji_ijs</span></a></span>.<span lang=EN-US><o:p></o:p></span></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal><o:p> </o:p></p></div></body></html>