AI's Role in Workplace Decisions Prompts Governance Calls
AI systems are increasingly used to make decisions about hiring, promotions, and terminations, often without transparency for employees. A recent analysis highlights that millions of job applications were processed by AI hiring tools in 2024 with most applicants unaware. In response, states like New York and California are beginning to require bias audits and AI usage notifications, pushing companies to establish clear governance frameworks.
- New York City's Local Law 144 requires employers using "automated employment decision tools" (AEDTs) for residents of the city to conduct annual independent bias audits. These audits must test for disparate impacts based on race, ethnicity, and sex, and a summary of the results must be publicly available on the employer's website. - The European Union's AI Act, which began a phased implementation in August 2024, classifies AI systems used in recruitment, promotion, or termination as "high-risk." This designation imposes strict obligations on employers, including requirements for human oversight, data governance to prevent bias, and transparency with employees. - A proposed California bill, AB 331, would have required companies to perform annual impact assessments for automated decision tools and notify any person who is the subject of a "consequential decision" made by such a tool. The bill would have also established a governance program to manage the risks of algorithmic discrimination. - Beyond external regulations, a key component of internal AI governance is establishing clear human oversight. This involves creating review panels, defining when human intervention is mandatory for AI-driven decisions, and having clear protocols for escalating ambiguous or sensitive cases for human review. - A 2025 survey found that 99% of hiring managers reported using AI in some capacity during the hiring process, with 98% seeing significant improvements in efficiency. Despite this widespread adoption, 93% of those surveyed emphasized the continued importance of human involvement in making final hiring decisions. - A growing trend for 2026 is the demand for skills in AI governance and ethics as companies shift from merely implementing AI to ensuring its responsible and compliant use. This includes establishing clear accountability, decision-making guardrails, and active oversight for AI systems, especially as they become more autonomous. - While 58% of organizations report that AI is deeply embedded in their operations, only 19% have a complete AI governance framework in place, a gap that is expected to be a major focus for 2026. Many companies lack a centralized inventory of their AI tools, making it difficult to track, monitor, and govern them effectively. - Legal challenges are beginning to emerge, such as a lawsuit against the AI hiring platform Eightfold, which alleged that companies used its systems to secretly score and profile job applicants without their knowledge. Such cases highlight the increasing legal risks and the need for auditable and explainable AI-driven decisions in hiring.
