{"id":305,"date":"2020-11-02T17:19:15","date_gmt":"2020-11-02T15:19:15","guid":{"rendered":"http:\/\/members.loria.fr\/KFort\/?page_id=305"},"modified":"2025-11-26T21:02:08","modified_gmt":"2025-11-26T19:02:08","slug":"test-accueil-bis","status":"publish","type":"page","link":"https:\/\/members.loria.fr\/KFort\/","title":{"rendered":"Language resources and ethics for NLP"},"content":{"rendered":"<h3>Currently<\/h3>\n<p>In charge of the Master 2 degree and local <a href=\"https:\/\/lct-master.org\/\">LCT Erasmus Mundus<\/a> coordinator for <a href=\"https:\/\/idmc.univ-lorraine.fr\/idmc-master-traitement-automatique-langues\/\">IDMC<\/a>.<\/p>\n<p>PI of the <a href=\"https:\/\/anr-inextenso.loria.fr\/\">InExtenso<\/a> (Intrinsic and Extrensic Evaluation of biases in LLMs) ANR project.<\/p>\n<p>PI of the new GDR <a href=\"https:\/\/gdr-lift.loria.fr\/\">LIFT<\/a> (Linguistique Informatique, Formelle et de Terrain).<\/p>\n<p>Chair of the ethics committee of the AI cluster ENACT<\/p>\n<h3>Research interests<\/h3>\n<ul>\n<li><strong>ethics<\/strong> in NLP\n<ul>\n<li>Since 2025: chair of the ethics committee of the AI cluster ENACT.<\/li>\n<li>2025: <a href=\"https:\/\/2025.aclweb.org\/organization\/\">Ethics co-chair<\/a> for ACL 2025 (with Bj\u00f6rn Ross).<\/li>\n<li>2021-2025: Co-chair of the <a href=\"https:\/\/www.aclweb.org\/adminwiki\/index.php?title=Formation_of_the_ACL_Ethics_Committee\">ACL ethics committee<\/a>, with Min Yen Kan and Yulia Tsvetkov (then Luciana Benotti).<\/li>\n<li>2020-2023: Project Ethics Officer of the <a href=\"https:\/\/www.loria.fr\/fr\/ai-proficient-lintelligence-artificielle-par-et-pour-lhumain-au-coeur-de-lindustrie-manufacturiere-du-futur\/\">AI-Proficient<\/a> European project<\/li>\n<li>2019-2022: Member of the Sorbonne IRB (Comit\u00e9 d&rsquo;\u00e9thique de la recherche)<\/li>\n<li>2021: Area chair for the Ethics and NLP track at <a href=\"https:\/\/2021.aclweb.org\/\">ACL-IJCNLP 2021<\/a><\/li>\n<li>2020-2021: Co-chair of the ethics committee for <a href=\"https:\/\/2020.emnlp.org\/organizers\/ethics-committee\">EMNLP 2020<\/a> (with D. Hovy) and <a href=\"https:\/\/2021.naacl.org\/organization\">NAACL 2021<\/a> (with E. Bender)<\/li>\n<li>2016-2021: Ethics working group leader within the <a href=\"http:\/\/www.cost.eu\/COST_Actions\/ca\/CA16105\">enetCollect<\/a> COST action<\/li>\n<li>2016: Guest editor (with G. Adda and K. B. Cohen) for the special issue of the TAL journal on ethics and NLP: <a href=\"https:\/\/www.atala.org\/-57-2-TAL-ET-ETHIQUE-\">\u00ab\u00a0TAL et \u00e9thique\u00a0\u00bb<\/a><\/li>\n<li>2015 &#8211; : Creator and member of the scientific committee of the <a href=\"http:\/\/www.ethique-et-tal.org\/\">\u00ab\u00a0\u00e9thique et TAL\u00a0\u00bb (ethics and NLP) blog<\/a><\/li>\n<li>2015 and 2020: co-organizer (with M. Amblard and G. Adda) of the TALN workshop on ethics and NLP ETeRNAL (2015) and <a href=\"https:\/\/team.inria.fr\/semagramme\/eternal\/\"> ETeRNAL 2<\/a> (2020)<\/li>\n<li>2014: Organizer of the <a href=\"https:\/\/members.loria.fr\/KFort\/files\/JE_ATALA.html\">Journ\u00e9e d&rsquo;\u00e9tudes ATALA \u00ab\u00a0\u00e9thique et TAL\u00a0\u00bb<\/a><\/li>\n<li>2013-2014: Co-creator of the Ethics and big data charter (Charte Ethique et Big Data).\u00a0 In <a href=\"https:\/\/members.loria.fr\/KFort\/files\/fichiers_cours\/CharteEthiqueBigDatav8.pdf\">French<\/a> (V8) and <a href=\"https:\/\/members.loria.fr\/KFort\/files\/fichiers_cours\/charteethiqueenV2.pdf\">English<\/a> (V2).<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<ul>\n<li><strong>language resources<\/strong> creation, in particular using Games With A Purpose (see <a href=\"https:\/\/lingoboingo.org\/\">Lingo Boingo<\/a> and <a href=\"https:\/\/www.science-ensemble.org\/\">Science Ensemble<\/a> portals)\n<ul>\n<li><a href=\"https:\/\/hostomytho.atilf.fr\">HostoMytho<\/a> (evaluation of synthetic clinical texts).<\/li>\n<li>ZombiLingo (dependency syntax annotation), now <a href=\"https:\/\/zombiludik.org\/\">ZombiLUDik<\/a> (for UD)<\/li>\n<li><a href=\"http:\/\/bisame.paris-sorbonne.fr\/\">Bisame<\/a> (POS for Alsacian) and <a href=\"http:\/\/krik2017.herokuapp.com\/\">Krik<\/a> (POS for Guadeloupean Kreol), then <a href=\"https:\/\/bisame.paris-sorbonne.fr\/recettes\/\">Recettes de grammaire<\/a> &#8211; PhD of<a href=\"https:\/\/alicemillour.github.io\/\"> A. Millour<\/a><\/li>\n<li><a href=\"http:\/\/rigor-mortis.org\/\">Rigor Mortis<\/a> (MWE annotation) &#8211; with YA Pilatte<\/li>\n<li>Workshop series <a href=\"http:\/\/anawiki.essex.ac.uk\/dali\/games4nlp\">Games4NLP<\/a> at LREC 2018, <a href=\"https:\/\/sites.google.com\/view\/gamnlp2020\/\">Games And NLP<\/a> at LREC 2020, 2022 and 2024<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<h3>News!<\/h3>\n<p>I was invited to give a talk at the workshop on \u00ab\u00a0mise en place de l\u2019IA\u00a0\u00bb (p\u00f4le AM2i of Univ. de Lorraine). The slides are <a href=\"https:\/\/members.loria.fr\/KFort\/files\/fichiers_cours\/AtelierIAAM2I_invited_FR.pdf\">here<\/a> (FR).<\/p>\n<p>I was invited to give a talk at <a href=\"https:\/\/clic2025.unica.it\">CLiC-it<\/a> on Sept. 25, 2025 on \u00ab\u00a0LLMs: the challenge of evaluation\u00a0\u00bb. The slides are <a href=\"https:\/\/members.loria.fr\/KFort\/files\/fichiers_cours\/https:\/\/members.loria.fr\/KFort\/files\/fichiers_cours\/CLIC-IT_invited.pdf\">here<\/a>.<\/p>\n<p>I was invited to give a talk by the CNRS Ins2i on March 12th on \u00ab\u00a0LLMs: the challenge of evaluation\u00a0\u00bb. The slides are <a href=\"https:\/\/members.loria.fr\/KFort\/files\/fichiers_cours\/KarenFort_LLMEvaluation.pdf\">here<\/a>.<\/p>\n<p>I was invited to give a talk at <a href=\"https:\/\/univ-cotedazur.eu\/events\/sophia-summit\">SophIA<\/a> on Nov 29th on \u00ab\u00a0Why we should change the way we evaluate LLMs\u00a0\u00bb. The slides are <a href=\"https:\/\/members.loria.fr\/KFort\/files\/fichiers_cours\/Invited_SophIA_2024.pdf\">here<\/a>.<\/p>\n<p>I co-organized the energizing Journ\u00e9e d&rsquo;\u00e9tude ATALA \u00ab\u00a0<a href=\"https:\/\/www.atala.org\/content\/ethique-tal\">\u00e9thique et TAL : 10 ans plus tard<\/a>\u00a0\u00bb on April 2nd 2024. The proceedings are available <a href=\"https:\/\/members.loria.fr\/KFort\/files\/fichiers_cours\/ActesJEEthiqueEtTAL2024.pdf\">here<\/a>.<\/p>\n<p>I was invited to give a talk at the annual meeting of the <a href=\"https:\/\/partage.apmeplorraine.fr\/jr\/APMEP-LORRAINE-JR2024.pdf\">APMEP<\/a> (Association des Professeurs de Math\u00e9matiques de l\u2019Enseignement Public) on \u00ab\u00a0<span dir=\"ltr\" role=\"presentation\">Les outils de TAL :<\/span><span dir=\"ltr\" role=\"presentation\">une opportunit\u00e9 p\u00e9dagogique peut en cacher une autre\u00a0\u00bb. It was fun and rich. Thank you! The slides are <a href=\"https:\/\/members.loria.fr\/KFort\/files\/fichiers_cours\/APMEP_invited_2024.pdf\">here<\/a>.<\/span><\/p>\n<p>The book including 6 short stories written by PhD students from LORIA during a doctoral training that I initiated (with Maxime Amblard, Mathieu d&rsquo;Aquin, Aurore Coince, Marc Anderson and others) is available here: <a href=\"https:\/\/thinkbeforeloading.loria.fr\/fr\/\">https:\/\/thinkbeforeloading.loria.fr\/fr\/<\/a><\/p>\n<p>I was invited to give a talk at <a href=\"https:\/\/www.arcep.fr\/\">ARCEP<\/a> (Autorit\u00e9 de r\u00e9gulation des t\u00e9l\u00e9coms) about ethics and AI. My slides are <a href=\"https:\/\/members.loria.fr\/KFort\/files\/fichiers_cours\/ARCEPInvited2023.pdf\">here<\/a>.<\/p>\n<p>Our paper about the presence of the Big Tech in NLP has been accepted to ACL 2023! <a href=\"https:\/\/arxiv.org\/abs\/2305.02797\">Here<\/a> it is.<\/p>\n<p>I&rsquo;ve been interviewed for an Interstices podcast on ethics in AI: <a href=\"https:\/\/interstices.info\/quelle-ethique-pour-les-agents-conversationnels\/\">https:\/\/interstices.info\/quelle-ethique-pour-les-agents-conversationnels\/<\/a><\/p>\n<p>I was in Epinal on Jan. 12th, at Lyc\u00e9e Claude Gell\u00e9e, with Hee-Soo Choi, my PhD student, to interact with girls about science. A great moment, with lots of questions and laughters! Their <a href=\"https:\/\/www.lyceeclaudegellee.fr\/?page_id=7267\">webpage<\/a>. My <a href=\"https:\/\/members.loria.fr\/KFort\/files\/fichiers_cours\/Chiche12Jan2023Epinal.pdf\">slides<\/a>. Inria&rsquo;s <a href=\"https:\/\/twitter.com\/Inria_Nancy\/status\/1618230574556274692\">tweet<\/a>.<\/p>\n<p>I was invited to give a talk on ethics in NLP at the \u00ab\u00a0journ\u00e9es conjointes\u00a0\u00bb of the GDR TAL and LIFT in Marseille on Nov. 14th, 2022: <a href=\"https:\/\/members.loria.fr\/KFort\/files\/fichiers_cours\/EtatDeArt_EthiqueEtTAL_LIFTTAL2022.pdf\">\u00c9thique et TAL : ce dont on parle, ce dont on ne parle plus, ce dont on ne parle pas (un \u00e9tat de l&rsquo;art)<\/a><\/p>\n<p>I was invited to give a talk during a panel on <a href=\"https:\/\/members.loria.fr\/KFort\/files\/fichiers_cours\/TeachingEthicsInNLPMinusOne.pdf\">teaching ethics<\/a> at the ERCIM <a href=\"https:\/\/www.ercim.eu\/beyond-compliance\">project meeting.<\/a><\/p>\n<p>Our paper \u00ab\u00a0French CrowS-Pairs: Extending a challenge dataset for measuring social bias in masked language models to a language other than English\u00a0\u00bb has been accepted to ACL 2022! See you in Dublin!<\/p>\n<p>I have the great honour to be appointed <strong>co-chair of the newly created <a href=\"https:\/\/www.aclweb.org\/adminwiki\/index.php?title=Formation_of_the_ACL_Ethics_Committee\">ACL ethics committee<\/a><\/strong>, with Min Yen Kan and Yulia Tsvetkov, a great team! This is very exciting and already a lot of work to be done!<\/p>\n<p>I was invited to give a talk on ethics in NLP at the <a href=\"https:\/\/www.ofai.at\/events\/lectures2022\">OFAI seminar<\/a> (Austria) on Oct. 12th, 2022: <a href=\"https:\/\/members.loria.fr\/KFort\/files\/fichiers_cours\/SoA_EthicsAndNLP_OFAI.pdf\">Ethics and NLP: What we Talk About, What we Don&rsquo;t Talk About Anymore, What we Never Talked About<\/a><\/p>\n<p>I was invited to give a talk on ethics in NLP at the <a href=\"http:\/\/www.ixxi.fr\/agenda\/seminaires\/cycles-de-seminaires\/intelligence-artificielle-et-langage\/ethique-et-traitement-automatique-des-langues-ce-dont-on-parle-ce-dont-on-ne-parle-plus-ce-dont-on-ne-parle-pas-un-etat-de-lart\">IXXI seminar<\/a> on June 10th, 2022: <a href=\"https:\/\/members.loria.fr\/KFort\/files\/fichiers_cours\/EtatDeArt_EthiqueEtTAL_IXXI2022.pdf\">\u00c9thique et TAL : ce dont on parle, ce dont on ne parle plus, ce dont on ne parle pas (un \u00e9tat de l&rsquo;art)<\/a><\/p>\n<p>I&rsquo;ll participate to the <a href=\"https:\/\/icmi.acm.org\/2021\/index.php?id=tutorial\">tutorial on on Ethics in AI and human-machine interaction<\/a> at the 23rd ACM International Conference on Multimodal Interaction, on Oct. 18th, 2021. My slides are <a href=\"https:\/\/members.loria.fr\/KFort\/files\/fichiers_cours\/EthicsAndNLP_tutorial.pdf\">here<\/a>.<\/p>\n<p>I&rsquo;m invited to give a lecture on <a href=\"https:\/\/members.loria.fr\/KFort\/files\/fichiers_cours\/EthicsAndCL.pdf\">Ethics and NLP<\/a> at <a href=\"https:\/\/www.dilco.uni-hamburg.de\/activities\/ethics-lectures-21.html\">DiLCO<\/a> on Oct. 8th. <a href=\"https:\/\/www.dilco.uni-hamburg.de\/activities\/ethics-lectures-21.html\">Video<\/a>.<\/p>\n<p>I&rsquo;m invited to give a talk on <a href=\"https:\/\/members.loria.fr\/KFort\/files\/fichiers_cours\/WebinarSAILS.pdf\">Ethics and AI (a view from NLP)<\/a> at the <a href=\"https:\/\/www.universiteitleiden.nl\/en\/sails\/events\/sails-lunch-time-seminar-270921\">noon webinar of SAILS<\/a>, in Leiden, on Sept. 27, 2021. <a href=\"https:\/\/vimeo.com\/616945166\">Video<\/a>.<\/p>\n<p>The book <a href=\"https:\/\/www.sorbonne-universite.fr\/parutions\/sorbonnavirus\">Sorbonnavirus <\/a>has been published. The Sorbonne IRB wrote an article about our work during the COVID crisis.<\/p>\n<p>I&rsquo;m co-organizing the <a href=\"https:\/\/gamesandnlp.com\/\">Games and Natural Language Processing<\/a> Special Session at IEEE CoG 2021, please have a look and do not hesitate to send a paper!<\/p>\n<p>Our tutorial on reviewing has been accepted at <a href=\"https:\/\/2021.eacl.org\/\">EACL 2021<\/a> and will be taught on April 20th.<\/p>\n<p>The same tutorial has been accepted at <a href=\"https:\/\/talnrecital2021.inria.fr\/relire\/\">TALN 2021<\/a> and will be partially given in French.<\/p>\n<p>Chris Cieri, Chris Callison-Burch and myself were invited to present a seminar on crowdsourcing at the <a href=\"http:\/\/idmc.univ-lorraine.fr\/informations-master-sciences-cognitives\/info-sc-seminaires\/\">Cognition and Language seminar<\/a> of Univ. de Lorraine (April 14th). <a href=\"https:\/\/bbb-prod-rp.unistra.fr\/playback\/presentation\/2.0\/playback.html?meetingId=f376470e665f1d5f209c3f4c7e2e38879c4b9b5a-1618400443429\">Video<\/a>.<\/p>\n<p>I was invited (with Chris Cieri, LDC) by Chris Callison-Burch to participate as guest speaker in his <a href=\"http:\/\/crowdsourcing-class.org\/lectures.html\">Crowdsourcing and Human Computation<\/a> class at Univ. of Pennsylvania (Feb. 11th).<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Currently<\/p>\n<p>In charge of the Master 2 degree and local <a href=\"https:\/\/lct-master.org\/\">LCT Erasmus Mundus<\/a> coordinator for <a href=\"https:\/\/idmc.univ-lorraine.fr\/idmc-master-traitement-automatique-langues\/\">IDMC<\/a>.<\/p>\n<p>PI of the <a href=\"https:\/\/anr-inextenso.loria.fr\/\">InExtenso<\/a> (Intrinsic and Extrensic Evaluation of biases in LLMs) ANR project.<\/p>\n<p>PI of the new GDR <a href=\"https:\/\/gdr-lift.loria.fr\/\">LIFT<\/a> (Linguistique Informatique, Formelle et de Terrain).<\/p>\n<p>Chair of the ethics committee of the AI cluster ENACT<\/p>\n<p>Research interests<\/p>\n<ul>\n<li>ethics in NLP\n<ul>\n<li>Since 2025: chair of the ethics committee of the AI cluster ENACT.<\/li>\n<li>2025: <a href=\"https:\/\/2025.aclweb.org\/organization\/\">Ethics co-chair<\/a> for ACL 2025 (with Bj\u00f6rn Ross).<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n","protected":false},"author":205,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-305","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/members.loria.fr\/KFort\/wp-json\/wp\/v2\/pages\/305","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/members.loria.fr\/KFort\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/members.loria.fr\/KFort\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/members.loria.fr\/KFort\/wp-json\/wp\/v2\/users\/205"}],"replies":[{"embeddable":true,"href":"https:\/\/members.loria.fr\/KFort\/wp-json\/wp\/v2\/comments?post=305"}],"version-history":[{"count":75,"href":"https:\/\/members.loria.fr\/KFort\/wp-json\/wp\/v2\/pages\/305\/revisions"}],"predecessor-version":[{"id":1068,"href":"https:\/\/members.loria.fr\/KFort\/wp-json\/wp\/v2\/pages\/305\/revisions\/1068"}],"wp:attachment":[{"href":"https:\/\/members.loria.fr\/KFort\/wp-json\/wp\/v2\/media?parent=305"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}