mastodon 4.7.3The Ubiquitous Knowledge Processing Lab researches Natural Language Processing (#NLProc) with a strong emphasis on Large Language Models (#LLMs), Conversational AI and Question Answering · Department of Computer Science · @TU@darmstadt.social Darmstadt
🔍 𝗨𝘀𝗶𝗻𝗴 𝗾𝘂𝗮𝗻𝘁𝗶𝘇𝗲𝗱 𝗟𝗟𝗠𝘀 𝘁𝗼 𝗯𝗼𝗼𝘀𝘁 𝗲𝗳𝗳𝗶𝗰𝗶𝗲𝗻𝗰𝘆?
𝗪𝗮𝘁𝗰𝗵 𝘁𝗵𝗲 𝘀𝗼𝗰𝗶𝗮𝗹 𝘁𝗿𝗮𝗱𝗲-𝗼𝗳𝗳𝘀, 𝘁𝗼𝗼. ⚠️
Quantization makes LLMs cheaper and more deployable. But what does it do to fairness, toxicity, and bias?
💡 The research gap: a systematic picture of how quantization affects social behavior across models and tasks.
🚀 𝗪𝗵𝗮𝘁 𝘄𝗲 𝗱𝗼
We evaluate social bias under quantization at scale: weight-only vs. weight+activation, across architectures, demographic groups, and reasoning tasks.
🚀 𝗪𝗲'𝗿𝗲 𝗵𝗶𝗿𝗶𝗻𝗴: 𝗣𝗼𝘀𝘁𝗱𝗼𝗰𝘁𝗼𝗿𝗮𝗹 𝗥𝗲𝘀𝗲𝗮𝗿𝗰𝗵𝗲𝗿 𝗳𝗼𝗿 𝘁𝗵𝗲 𝗘𝗥𝗖 𝗔𝗱𝘃𝗮𝗻𝗰𝗲𝗱 𝗚𝗿𝗮𝗻𝘁 𝗜𝗻𝘁𝗲𝗿𝗧𝗲𝘅𝘁 𝗮𝘁 𝗨𝗞𝗣 𝗟𝗮𝗯, 𝗧𝗨 𝗗𝗮𝗿𝗺𝘀𝘁𝗮𝗱𝘁
If you work on #LLMs that reason across complex documents, not just within them, this role is for you.
🌍 𝗝𝗼𝗶𝗻𝗶𝗻𝗴 𝘁𝗵𝗲 𝗨𝗞𝗣 𝗟𝗮𝗯: 𝗪𝗲𝗹𝗰𝗼𝗺𝗲, 𝗞𝘂𝗿𝘁 𝗠𝗶𝗰𝗮𝗹𝗹𝗲𝗳!
We’re glad to welcome Kurt Micallef as a new postdoctoral researcher at the UKP Lab.
Kurt’s previous work focused on 𝗡𝗟𝗣 𝗳𝗼𝗿 𝗠𝗮𝗹𝘁𝗲𝘀𝗲, where he worked on low resource and cross lingual techniques, developed Maltese centric language models, and contributed to advancing benchmarking in the era of large language models.
🤔 How can we innovate reading and writing workflows for students, educators, researchers – and at the same time make it useful to science?
🚀 Meet 𝗖𝗔𝗥𝗘: — now with a 𝗺𝗮𝗷𝗼𝗿 𝘂𝗽𝗱𝗮𝘁𝗲 and 𝗳𝘂𝗹𝗹𝘆 𝗼𝗽𝗲𝗻 𝗱𝗲𝘃𝗲𝗹𝗼𝗽𝗺𝗲𝗻𝘁 on GitHub.
Check out the 🧵 below if you want to know more.