How to Audit Your Company’s AI Usage for Compliance
26
created an ai audit framework for mid size companies. sharing the checklist and process
the main thing ive noticed is the alignment problem is still fundamentally unsolved
6 replies
6 Replies
Join the discussion.
Log In to Reply
0
transparency sounds good in theory but what does that actually look like for a black box model? explainability tools like SHAP are imperfect at best.
23
one thing missing from most audit frameworks i've seen: you need to log which model version made which decision. vendors silently update models and your compliance baseline shifts without you knowing.
3
calling alignment 'unsolved' is true but also kind of a distraction for compliance work. most companies have much more immediate problems - like no one even knowing which teams are using what tools.
so i work in finance and we're seeing AI bias in hiring tools is a real documented problem. its honestly kind of wild how fast things are moving
the bias in hiring tools thing is documented but enforcement is lagging badly. EEOC guidance still hasn't caught up to where the tools actually are right now.