{"id":6301,"date":"2025-07-09T03:10:44","date_gmt":"2025-07-08T17:10:44","guid":{"rendered":"https:\/\/blogs.deakin.edu.au\/article\/?p=6301"},"modified":"2025-07-09T15:10:38","modified_gmt":"2025-07-09T05:10:38","slug":"library-ai-evaluations-goes-public","status":"publish","type":"post","link":"https:\/\/blogs.deakin.edu.au\/article\/library-ai-evaluations-goes-public\/","title":{"rendered":"Library AI Evaluations goes public"},"content":{"rendered":"<blockquote>\n<p id=\"Fresh-on-the-shelf:-Library-AI-Evaluations-go-public\" data-renderer-start-pos=\"1681\"><em>\u201cAI is not a done deal. We&#8217;re building the road as we walk it, and we can collectively decide what direction we want to go in, together.&#8221;<\/em> Dr. Sasha Luccioni, AI &amp; Climate Lead at Hugging Face<\/p>\n<\/blockquote>\n<p data-renderer-start-pos=\"1933\">The Library has just soft-launched its new public-facing <a href=\"https:\/\/deakin.libguides.com\/AI-Evaluations\" class=\"_mizu1p6i _1ah31bk5 _ra3xnqa1 _128m1bk5 _1cvmnqa1 _4davt94y _4bfu18uv _1hms8stv _ajmmnqa1 _vchhusvi _syaz14q2 _ect41gqc _1a3b18uv _4fpr8stv _5goinqa1 _f8pj14q2 _9oik18uv _1bnxglyw _jf4cnqa1 _30l314q2 _1nrm18uv _c2waglyw _1iohnqa1 _9h8h16c2 _1053w7te _1ienw7te _n0fxw7te _1vhvg3x0\" title=\"https:\/\/deakin.libguides.com\/AI-Evaluations\" data-renderer-mark=\"true\"><strong data-renderer-mark=\"true\">AI Evaluations Guide<\/strong><\/a>. The guide shares how we are critically engaging with emerging AI through a library lens to support informed decision-making, surface strategic risks, and demonstrate principled practice.<\/p>\n<h2 id=\"Why-we\u2019ve-made-it-public\" data-renderer-start-pos=\"2215\"><strong data-renderer-mark=\"true\"><span class=\"fabric-text-color-mark\" data-renderer-mark=\"true\" data-text-custom-color=\"#008da6\">Why we made the guide public<\/span><\/strong><\/h2>\n<p data-renderer-start-pos=\"2241\">Originally developed to support internal capability building, our growing collection of AI Evaluations has now evolved into a living public resource. As interest grew (in Deakin and across the sector), it made sense to make Library work more visible, adaptable, and reusable.<\/p>\n<p data-renderer-start-pos=\"2516\">The release supports our commitment to:<\/p>\n<ul>\n<li data-renderer-start-pos=\"2559\"><strong data-renderer-mark=\"true\">Transparency<\/strong> in how the Library is assessing the implications of AI across learning, research, and digital services<\/li>\n<li data-renderer-start-pos=\"2678\"><strong data-renderer-mark=\"true\">Advisory leadership<\/strong> that helps our community evaluate and engage with AI critically and constructively<\/li>\n<li data-renderer-start-pos=\"2784\"><strong data-renderer-mark=\"true\">Open practice<\/strong> that allows others to see, consider and potentially adapt our approach<\/li>\n<\/ul>\n<p data-renderer-start-pos=\"2872\">As a Library interested in information and knowledge practices, we need to model the kind of evaluative judgement and transparency we want our students, educators, and professional peers to apply in their own contexts.<\/p>\n<h2 id=\"What\u2019s-in-the-guide\" data-renderer-start-pos=\"3093\"><strong data-renderer-mark=\"true\"><span class=\"fabric-text-color-mark\" data-renderer-mark=\"true\" data-text-custom-color=\"#008da6\">What\u2019s in the guide?<\/span><\/strong><\/h2>\n<p data-renderer-start-pos=\"3114\">The AI Evaluations Guide is designed to be clear, consistent, and practical. It is guided by and reflects <a href=\"https:\/\/www.deakin.edu.au\/about-deakin\/why-deakin\/generative-artificial-intelligence\" class=\"_mizu1p6i _1ah31bk5 _ra3xnqa1 _128m1bk5 _1cvmnqa1 _4davt94y _4bfu18uv _1hms8stv _ajmmnqa1 _vchhusvi _syaz14q2 _ect41gqc _1a3b18uv _4fpr8stv _5goinqa1 _f8pj14q2 _9oik18uv _1bnxglyw _jf4cnqa1 _30l314q2 _1nrm18uv _c2waglyw _1iohnqa1 _9h8h16c2 _1053w7te _1ienw7te _n0fxw7te _1vhvg3x0\" title=\"https:\/\/www.deakin.edu.au\/about-deakin\/why-deakin\/generative-artificial-intelligence\" data-renderer-mark=\"true\">Deakin\u2019s GenAI Principles<\/a>. Our evaluations are not endorsements. They are informed perspectives designed to support confident and principled engagement.<\/p>\n<p id=\"Each-evaluation-outlines:\" data-renderer-start-pos=\"3375\">Each evaluation outlines:<\/p>\n<ul>\n<li data-renderer-start-pos=\"3404\">Key AI functions and intended use<\/li>\n<li data-renderer-start-pos=\"3441\">Relevance to scholarly, library, and information contexts<\/li>\n<li data-renderer-start-pos=\"3502\">Pedagogical, ethical, and data-related considerations<\/li>\n<li data-renderer-start-pos=\"3559\">Strategic reflections, limitations, and risks<\/li>\n<li data-renderer-start-pos=\"3608\">Advisory statements to support critical engagement<\/li>\n<\/ul>\n<p data-renderer-start-pos=\"3662\">We focus on AI that our community is already encountering through freely accessible systems, subscription tools, or library-supported platforms. This means evaluating what\u2019s visible and used in practice, not just the newest or most hyped technologies.<\/p>\n<p data-renderer-start-pos=\"3915\">The evaluations are grounded in expertise across our Library, from expert searching and copyright to digital literacies instruction. The guide also documents our evaluation approach, including alignment with Deakin\u2019s GenAI Principles and key digital capability frameworks.<\/p>\n<p id=\"Completed-evaluations-(so-far)\" data-renderer-start-pos=\"4189\">The completed evaluations, so far, include:<\/p>\n<ul>\n<li data-renderer-start-pos=\"4223\">Consensus<\/li>\n<li data-renderer-start-pos=\"4236\">Elicit<\/li>\n<li data-renderer-start-pos=\"4246\">EndNote AI functions<\/li>\n<li data-renderer-start-pos=\"4270\"><span data-highlighted=\"true\" data-vc=\"highlighted-text\"><span class=\"_kqswh2mm\"><span class=\"_5pioz8co _189eyh40 _1il9buyh _19lcevot _d0altlke\" data-testid=\"definition-highlighter\">EBSCO<\/span><\/span><\/span> AI functions<\/li>\n<li data-renderer-start-pos=\"4292\">ProQuest Research Assistant<\/li>\n<\/ul>\n<h2 id=\"Why-this-matters-now\" data-renderer-start-pos=\"4323\"><strong data-renderer-mark=\"true\"><span class=\"fabric-text-color-mark\" data-renderer-mark=\"true\" data-text-custom-color=\"#008da6\">Why does this matter now?<\/span><\/strong><\/h2>\n<p data-renderer-start-pos=\"4345\">The AI landscape is expanding rapidly. From writing and search to transcription and visual generation, AI is becoming part of everyday academic work, even when users don\u2019t always recognise it. The need for structured, credible, and values-based guidance has never been greater.<\/p>\n<p data-renderer-start-pos=\"4623\">This guide is one way Deakin Library is stepping into the AI space. Our evaluations provide language to support AI-related conversations, models for thoughtful critique and informed uptake, and resources that bridge the gap between policy and day-to-day decisions.<\/p>\n<h2 id=\"How-to-use-the-guide-in-your-work\" data-renderer-start-pos=\"4884\"><strong data-renderer-mark=\"true\"><span class=\"fabric-text-color-mark\" data-renderer-mark=\"true\" data-text-custom-color=\"#008da6\">How to use the guide in your work?<\/span><\/strong><\/h2>\n<p data-renderer-start-pos=\"4919\">The AI Evaluations Guide is a practical resource built for action, not just a collection of reports. You can use it to:<\/p>\n<ul>\n<li data-renderer-start-pos=\"5047\"><strong data-renderer-mark=\"true\">Support conversations with your community<\/strong><br \/>\nRefer to evaluations when asked about an AI system, especially in teaching or curriculum settings where AI is being trialled or queried.<\/li>\n<li data-renderer-start-pos=\"5229\"><strong data-renderer-mark=\"true\">Build into learning and capability resources<\/strong><br \/>\nEmbed evaluations into student workshops, professional learning sessions, consult or enquiry support materials. They help scaffold practical discussions around responsible AI use, critical thinking, and digital capability development.<\/li>\n<li data-renderer-start-pos=\"5512\"><strong data-renderer-mark=\"true\">Explore AI yourself and share what you learn<\/strong><br \/>\nTry the AI functions we\u2019ve evaluated. Reflect on what works and where you feel uncertain. Then share those experiences with your colleagues. This grassroots insight helps us all support the Deakin community more effectively.<\/li>\n<\/ul>\n<h2 id=\"What\u2019s-next\" data-renderer-start-pos=\"5786\"><strong data-renderer-mark=\"true\">What\u2019s next?<\/strong><\/h2>\n<p data-renderer-start-pos=\"5799\">This initiative is dynamic and continuously evolving. New evaluations will be published approximately every few weeks. Feedback rounds will be integrated into our update cycle to incorporate insights from students, staff, and the wider community. The guide\u2019s usability and navigation will be shaped by iterative design, in collaboration with the Library learning designers.<\/p>\n<blockquote>\n<p data-renderer-start-pos=\"6153\"><em>\u201cAs AI goes mainstream\u202f\u2026, library workers are increasingly having to make day\u2011to\u2011day decisions about adoption, advice, and policies. Their stakeholder communities will be in various states of enthusiasm or resistance, interest or apathy, knowledge or learning.\u201d<\/em> Dr. Lorcan Dempsey, Professor of Practive and Distinguished Practioner in Residence at University of Washington<\/p>\n<\/blockquote>\n","protected":false},"excerpt":{"rendered":"<p>\u201cAI is not a done deal. We&#8217;re building the road as we walk it, and we can collectively decide what direction we want to go in, together.&#8221; Dr. Sasha Luccioni, AI &amp; Climate Lead at Hugging Face The Library has just soft-launched its new public-facing AI Evaluations Guide. The guide shares how we are critically [&hellip;]<\/p>\n","protected":false},"author":137461,"featured_media":6302,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_post_was_ever_published":false},"categories":[16,25,2],"tags":[],"class_list":["post-6301","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-faculties","category-general-interest","category-library-services"],"jetpack_featured_media_url":"https:\/\/blogs.deakin.edu.au\/article\/wp-content\/uploads\/sites\/326\/2025\/07\/Blog-banner-AI-evaluations.png","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/pao1A6-1DD","_links":{"self":[{"href":"https:\/\/blogs.deakin.edu.au\/article\/wp-json\/wp\/v2\/posts\/6301","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.deakin.edu.au\/article\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.deakin.edu.au\/article\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.deakin.edu.au\/article\/wp-json\/wp\/v2\/users\/137461"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.deakin.edu.au\/article\/wp-json\/wp\/v2\/comments?post=6301"}],"version-history":[{"count":5,"href":"https:\/\/blogs.deakin.edu.au\/article\/wp-json\/wp\/v2\/posts\/6301\/revisions"}],"predecessor-version":[{"id":6307,"href":"https:\/\/blogs.deakin.edu.au\/article\/wp-json\/wp\/v2\/posts\/6301\/revisions\/6307"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blogs.deakin.edu.au\/article\/wp-json\/wp\/v2\/media\/6302"}],"wp:attachment":[{"href":"https:\/\/blogs.deakin.edu.au\/article\/wp-json\/wp\/v2\/media?parent=6301"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.deakin.edu.au\/article\/wp-json\/wp\/v2\/categories?post=6301"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.deakin.edu.au\/article\/wp-json\/wp\/v2\/tags?post=6301"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}