AI is being used in social services—but we must make sure it doesn't traumatize clients [phys.org]

Rafael Maravilla(PACEs Connection Staff) 2/13/258:00 AM

By Suvradip Maitra, Lyndal Sleep, Paul Henman and Suzanna Fay, Phys.org, Illustration: Pixabay/CC0 Public Domain, February 10, 2025

Late last year, ChatGPT was used by a Victorian child protection worker to draft documents. In a glaring error, ChatGPT referred to a "doll" used for sexual purposes as an "age-appropriate toy." Following this, the Victorian information commissioner banned the use of generative artificial intelligence (AI) in child protection.

Unfortunately, many harmful AI systems will not garner such public visibility. It's crucial that people who use social services—such as employment, homelessness or domestic violence services—are aware they may be subject to AI. Additionally, service providers should be well informed about how to use AI safely.

Fortunately, emerging regulations and tools, such as our trauma-informed AI toolkit, can help to reduce AI harm.

[Please click here to read the full article.]

Add Comment

Comments (0)

<ul id="{%=id%}ButtonGroup" class="button-group h-popup-buttons even-button-group even-1">
    <li id="{%=id%}Okay_buttonContainer"><a id="{%=id%}Okay" href="javascript:void(0);" class="button success no-margin-bottom h-alert-modal-ok-button" role="button">OK</a><script type="text/javascript">
        (function() {
            function {%=id%}Okay_click(event, data) {
            {%=id%}Popup.hide();
        }
        
                $('#{%=id%}Okay').on('click', {%=id%}Okay_click);
        })();
    </script></li></ul><a href="javascript:void(0);" class="close-reveal-modal" aria-label="Close Modal">&#215;</a><div class="last-modal-focus focus-utility-element" tabindex="0"></div>
</div>
<script type="text/javascript">
        (function() {
            {%=id%}Popup = new SS.Popup.ModalPopup('{%=id%}');
        })();
    </script>

Skip to main content

Add Comment

Membership Required

Remove From Your Block List

Manage Follow Preferences

Block

Please wait...