I am a Postdoctoral Research Fellow at MBZUAI specializing in LLM-related research. As the co-founder and CTO of LibrAI Technologies, I contribute to research and development efforts aimed at improving AI evaluation and safety frameworks. My work aims to tackle challenges in model alignment, evaluation, and safety, striving to bridge academic research with practical applications.

What’s New (updated on 2025-01-06)

• Jan 2025 — We will organize a tutorial on Safety Issues for Generative AI at COLING. See you in Abu Dhabi!
• Jan 2025 — We release Libra-Leaderboard, a leaderboard for LLM evaluation. Website, X, LinkedIn.
• Dec 2024 — Our Survey paper on AI safety was accepted by JAIR. Title: Against The Achilles’ Heel: A Survey on Red Teaming for Generative Models. Paper.
• Nov 2024 — We release Nanda LLM a 10B Hindi-English bilingual hashtag#LLM adapted on top of Llama3-8B. Paper LinkedIn
• Oct 2024 — We (LibrAI) are participating as exhibitors at GITEX, Dubai.
• July 2024 — We (LibrAI) are participating as exhibitors at WAIC - World Artificial Intelligence Conference.
• May 2024 — I have five co-authored papers accepted by ACL 2024, see you in Bangkok, Thailand!
• Apr 2024 — We did a comprehensive survey on generative AI attack and defense (red-teaming). We target a better and safer AI development. [Github][Paper]
• Apr 2024 — Our work Do-Not-Answer is featured in the latest Stanford AI Index Report 2024.
• Feb 2024 — We release Loki: An Open-source Tool for Fact Verification. We also release a commercial version with fancy UI and better user experience. TRY IT NOW!

• Dec 2023 — We release LLM360, A framework for open-source LLMs to foster transparency, trust, and collaborative research.

• Aug 2023 — We release Jais and Jais-chat: Arabic-centric foundation and instruction-tuned open generative large language models. Link to Technique Report, Blog.
• June 2023 — We release CMMLU, a massive multitask language understanding benchmark in Chinese.
• June 2023 — My Ph.D Thesis: Incorporating structured and unstructured information for geospatial question answering is now available online.
• May 2023 — We propose Bactrian-X, multilingual replicable instruction-following dataset and models.
• Feb 2023 — I moved to Abu Dhabi, UAE; and started my postdoctoral work at MBZUAI.