In a significant move towards enhancing transparency and accountability in healthcare AI, California Governor Gavin Newsom recently signed two key pieces of legislation: the Physicians Make Decisions Act (SB 1120) and Health Care Services: Artificial Intelligence (AB 3030). These new laws are set to reshape the way healthcare providers, payers, and AI developers approach the integration of AI in clinical settings.
At Alignmt AI, we’re closely tracking these developments as they have a profound impact on AI governance, compliance, and healthcare delivery. Here’s what the new laws mean and how they align with the need for robust AI oversight.
SB 1120: The Physicians Make Decisions Act
SB 1120 mandates that insurers and payers ensure that any AI tools involved in making coverage decisions rely on an enrollee’s medical or clinical history and individual clinical circumstances. More critically, it requires that physicians—not AI systems—have the final say in determining medical necessity.
This legislation is a clear response to growing concerns over the increasing role of AI in healthcare decision-making, particularly when it comes to coverage and medical necessity determinations. AI tools are often praised for their ability to streamline processes, but as these tools are increasingly involved in high-stakes decisions, there is a need for clear oversight.
Key implications of SB 1120:
AI tools used by payers must be programmed and trained to take into account the individual’s specific medical history and clinical situation.
Physicians will retain ultimate decision-making authority in determining the medical necessity of treatments, ensuring that human expertise governs clinical care.
Compliance frameworks for AI solutions must ensure that AI-driven recommendations are transparent, accountable, and based on comprehensive patient data.
For companies developing healthcare AI solutions, this law highlights the importance of aligning AI systems with individualized care and empowering physicians to make final decisions. At Alignmt AI, we advocate for governance frameworks that not only comply with these laws but also foster trust between healthcare providers and their patients.
SB 1120 is sponsored by the California Medical Association, which represents approximately 50,000 physicians in the state. It takes effect on January 1, 2024.
AB 3030: Disclaimers on AI-Generated Communications
Governor Newsom also signed AB 3030, which adds another layer of transparency around the use of AI in healthcare communications. The bill requires healthcare providers to issue a disclaimer if AI systems contributed to the drafting of written or verbal communications that include patient clinical information. Affected providers include hospitals, clinics, physician offices, and group practices.
This law addresses the increasing use of AI tools in drafting patient-related communications, such as treatment plans, discharge summaries, and clinical reports. By ensuring that patients are aware when AI has played a role, AB 3030 promotes transparency and gives patients a better understanding of how technology influences their care.
Key implications of AB 3030:
Healthcare providers must disclose when AI tools assist in drafting communications involving patient clinical data.
Patients will have greater insight into the role AI plays in their care, fostering trust and promoting transparency.
AI tools must be clearly documented and compliant with healthcare communication standards.
For organizations implementing AI systems in their communication workflows, this bill underscores the necessity for AI transparency and responsible use. Disclosures need to be built into processes, and governance systems must ensure these AI-driven communications meet the regulatory standards laid out by AB 3030.
How Alignmt AI Can Help
The passage of these laws signals a clear call for AI governance in healthcare, ensuring that AI systems are used responsibly, transparently, and ethically. At Alignmt AI, we specialize in helping healthcare organizations navigate these regulatory landscapes by offering AI governance and compliance solutions tailored to evolving legal requirements.
Our platform automates compliance workflows and ensures that AI tools used in healthcare are aligned with the latest regulations, including SB 1120 and AB 3030. We help organizations maintain oversight over AI-driven processes, ensure physician autonomy, and promote transparency in AI communications.
As these new laws take effect, the future of AI in healthcare will increasingly depend on robust governance frameworks that prioritize patient safety, transparency, and clinical accountability. With Alignmt AI, healthcare providers and payers can be confident their AI tools not only enhance care delivery but also meet critical compliance standards.
Comments