A Bill for an Act
Page 1, Line 101Concerning restrictions on the use of artificial intelligence
Page 1, Line 102relating to psychotherapy services.
Bill Summary
(Note: This summary applies to this bill as introduced and does not reflect any amendments that may be subsequently adopted. If this bill passes third reading in the house of introduction, a bill summary that applies to the reengrossed version of this bill will be available at http://leg.colorado.gov.)
The bill prohibits licensed, certified, or registered psychologists, professional counselors, social workers, clinical social workers, marriage and family therapists, addiction counselors, or candidates for those credentials, as well as unlicensed psychotherapists and other individuals lawfully permitted to provide psychotherapy services in the state (regulated professionals), from using an artificial intelligence system to:
- Directly interact with clients in any form of therapeutic communication;
- Generate therapeutic recommendations or treatment plans without review and approval by regulated professionals; or
- Detect emotions or mental states.
Under current law, the practice of "psychotherapy" or "psychotherapy services" means, in pertinent part: Treatment, diagnosis, testing, assessment, or counseling in a professional relationship to assist individuals or groups to alleviate behavioral and mental health disorders; understand unconscious or conscious motivation; resolve emotional, relationship, or attitudinal conflicts; or modify behaviors that interfere with effective emotional, social, or intellectual functioning. Psychotherapy follows a planned procedure of intervention that takes place on a regular basis or over a period of time, or, in the cases of testing, assessment, and brief psychotherapy, psychotherapy can be a single intervention. The definition of psychotherapy in current law also states that it is the intent of the general assembly that the definition of psychotherapy be interpreted in its narrowest sense to regulate only those persons that clearly fall within the definition.
The bill allows regulated professionals to use an artificial intelligence system to assist in providing administrative support or supplementary support for psychotherapy services if the regulated professional maintains full responsibility for all interactions, outputs, and data use associated with the artificial intelligence system.
Further, if a client's therapeutic session will be recorded or transcribed through the use of an artificial intelligence system, the regulated professional must obtain written, informed consent from the client or the client's representative.
The bill does not prohibit the use of an artificial intelligence system within accredited or approved educational, instructional, or professional training programs so long as the artificial intelligence system is used solely for educational, administrative, simulation, or training purposes and is not deployed or marketed for use with clients, patients, or the public.
The bill also does not prohibit the development or testing of an artificial intelligence system solely for research purposes under the oversight of a federally registered institutional review board, so long as the artificial intelligence system is not offered to consumers or used to provide psychotherapy services outside of the research setting.
Further, the bill also does not prohibit the use of a technology or service that provides self-help, coaching, guided meditation, or wellness tools and that does not diagnose or treat mental health disorders and clearly discloses that the technology or service is not a substitute for clinical care.
The applicable board that regulates a regulated professional may take disciplinary action against a regulated professional that violates prohibitions in the bill concerning the use of artificial intelligence systems relating to psychotherapy services.
The bill also makes it unlawful for an individual, corporation, or entity (person) to provide, advertise, or otherwise offer psychotherapy services to the public in the state unless the services are provided by a regulated professional.
It is an unfair trade practice under the "Colorado Consumer Protection Act" for a person to use a term, letter, or phrase in the advertising, interface, or outputs of an artificial intelligence system that indicates or implies that the artificial intelligence system's output data is endorsed by or equivalent to psychotherapy services provided by regulated professionals or represent that the artificial intelligence system provides psychotherapy services or that users' data or information is confidential.
Page 3, Line 1Be it enacted by the General Assembly of the State of Colorado:
Page 3, Line 2SECTION 1. In Colorado Revised Statutes, 12-245-224, amend
Page 3, Line 3(1)(w) and (1)(x); and add (1)(y) as follows:
Page 3, Line 412-245-224. Prohibited activities - related provisions -
Page 3, Line 5definition.
Page 3, Line 6(1) A person licensed, registered, or certified under this article 245
Page 3, Line 7violates this article 245 if the person:
Page 3, Line 8(w) Has sold or fraudulently obtained or furnished a license,
Page 3, Line 9registration, or certification to practice as a psychologist, social worker,
Page 3, Line 10marriage and family therapist, licensed professional counselor,
Page 3, Line 11psychotherapist, or addiction counselor or has aided or abetted in those
Page 3, Line 12activities;
orPage 3, Line 13(x) Has failed to respond, in the manner required by the board, to
Page 3, Line 14a complaint filed with or by the board against the licensee, registrant, or
Page 3, Line 15certificate holder; or
Page 3, Line 16(y) Fails to comply with section 12-245-224.5 concerning
Page 3, Line 17the use of artificial intelligence systems.
Page 4, Line 1SECTION 2. In Colorado Revised Statutes, add 12-245-224.5 as
Page 4, Line 2follows:
Page 4, Line 312-245-224.5. Use of artificial intelligence systems for
Page 4, Line 4psychotherapy services - unauthorized use - permitted use by
Page 4, Line 5regulated individuals - consent - use in educational and training
Page 4, Line 6settings and research - definitions.
Page 4, Line 7(1) As used in this section, unless the context otherwise
Page 4, Line 8requires:
Page 4, Line 9(a) (I) "Administrative support" means tasks that:
Page 4, Line 10(A) Are performed to assist a licensee, registrant,
Page 4, Line 11certificate holder, or other individual lawfully permitted to
Page 4, Line 12provide psychotherapy services in the state in the delivery of
Page 4, Line 13psychotherapy services; and
Page 4, Line 14(B) Do not involve therapeutic communication.
Page 4, Line 15(II) "Administrative support" includes the following, at a
Page 4, Line 16minimum:
Page 4, Line 17(A) Managing appointment scheduling and reminders;
Page 4, Line 18(B) Processing billing and insurance claims; and
Page 4, Line 19(C) Drafting general communications related to therapy
Page 4, Line 20logistics that do not include therapeutic advice.
Page 4, Line 21(b) "Artificial intelligence system" has the meaning set
Page 4, Line 22forth in section 6-1-1701 (2).
Page 4, Line 23(c) (I) "Consent" means a clear, explicit, affirmative,
Page 4, Line 24specific, and unambiguous written agreement, including a
Page 4, Line 25written agreement provided by electronic means, entered into
Page 4, Line 26by an individual that is revocable by the individual.
Page 4, Line 27(II) "Consent" does not include an agreement that is
Page 5, Line 1obtained by any of the following means:
Page 5, Line 2(A) The acceptance of a general or broad terms of use
Page 5, Line 3agreement or a similar document that contains descriptions of
Page 5, Line 4artificial intelligence along with other unrelated information;
Page 5, Line 5(B) An individual interacting with a given piece of digital
Page 5, Line 6content in a manner that involves hovering over, muting,
Page 5, Line 7pausing, or closing the digital content; or
Page 5, Line 8(C) An agreement obtained through the use of deception.
Page 5, Line 9(d) "Person" has the meaning set forth in section 2-4-401
Page 5, Line 10(8).
Page 5, Line 11(e) "Supplementary support" means tasks performed to
Page 5, Line 12assist a licensee, registrant, certificate holder, or other
Page 5, Line 13individual lawfully permitted to provide psychotherapy
Page 5, Line 14services in the state in the delivery of psychotherapy services
Page 5, Line 15that do not involve therapeutic communication and that are not
Page 5, Line 16administrative support. "Supplementary support" includes, at a
Page 5, Line 17minimum:
Page 5, Line 18(I) Preparing and maintaining client records, including
Page 5, Line 19therapy notes;
Page 5, Line 20(II) Analyzing anonymized data to track client progress
Page 5, Line 21or identify trends, subject to review by a licensee, registrant,
Page 5, Line 22certificate holder, or other individual lawfully permitted to
Page 5, Line 23provide psychotherapy services in the state; and
Page 5, Line 24(III) Identifying and organizing internal and external
Page 5, Line 25resources or referrals for client use.
Page 5, Line 26(f) "Therapeutic communication" means any verbal,
Page 5, Line 27nonverbal, or written interaction conducted in a clinical or
Page 6, Line 1professional setting that meets the definition of psychotherapy
Page 6, Line 2services. "Therapeutic communication" includes, at a minimum:
Page 6, Line 3(I) Direct interactions with clients for the purpose of
Page 6, Line 4understanding or reflecting their thoughts, emotions, or
Page 6, Line 5experiences;
Page 6, Line 6(II) Providing guidance, therapeutic strategies, or
Page 6, Line 7interventions designed to achieve mental or behavioral health
Page 6, Line 8outcomes;
Page 6, Line 9(III) Offering emotional support, reassurance, or empathy
Page 6, Line 10in response to psychological or emotional distress;
Page 6, Line 11(IV) Collaborating with clients to develop or modify
Page 6, Line 12therapeutic goals or treatment plans; and
Page 6, Line 13(V) Offering behavioral feedback intended to promote
Page 6, Line 14psychological growth or to address mental or behavioral
Page 6, Line 15health conditions.
Page 6, Line 16(2) A person shall not provide, advertise, or otherwise
Page 6, Line 17offer psychotherapy services to the public in the state,
Page 6, Line 18including through the use of an artificial intelligence system,
Page 6, Line 19unless the psychotherapy services are conducted in accordance
Page 6, Line 20with this section by a licensee, registrant, certificate holder, or
Page 6, Line 21other individual lawfully permitted to provide psychotherapy
Page 6, Line 22services in the state.
Page 6, Line 23(3) A licensee, registrant, certificate holder, or other
Page 6, Line 24individual lawfully permitted to provide psychotherapy
Page 6, Line 25services in the state may use an artificial intelligence system to
Page 6, Line 26assist in providing administrative support or supplementary
Page 6, Line 27support for psychotherapy services if the licensee, registrant,
Page 7, Line 1certificate holder, or other individual lawfully permitted to
Page 7, Line 2provide psychotherapy services in the state maintains full
Page 7, Line 3responsibility for all interactions, outputs, and data use
Page 7, Line 4associated with the artificial intelligence system and satisfies
Page 7, Line 5the requirements set forth in subsection (4) of this section.
Page 7, Line 6(4) (a) If a client's therapeutic session will be recorded or
Page 7, Line 7transcribed, a licensee, registrant, certificate holder, or other
Page 7, Line 8individual lawfully permitted to provide psychotherapy
Page 7, Line 9services in the state shall not use an artificial intelligence
Page 7, Line 10system to assist in providing supplementary support for
Page 7, Line 11psychotherapy services, unless:
Page 7, Line 12(I) The client or the client's legally authorized
Page 7, Line 13representative is informed in advance in writing of the
Page 7, Line 14following:
Page 7, Line 15(A) That an artificial intelligence system will be used;
Page 7, Line 16and
Page 7, Line 17(B) The specific purpose for which the artificial
Page 7, Line 18intelligence system will be used;
Page 7, Line 19(II) The client or the client's legally authorized
Page 7, Line 20representative consents in writing to the use of the artificial
Page 7, Line 21intelligence system; and
Page 7, Line 22(III) The client's refusal to provide or later decision to
Page 7, Line 23revoke consent required pursuant to subsection (4)(a)(II) of this
Page 7, Line 24section shall not be used as a basis to deny psychotherapy
Page 7, Line 25services.
Page 7, Line 26(b) The consent required pursuant to subsection (4)(a)(II)
Page 7, Line 27of this section for the use of an artificial intelligence system to
Page 8, Line 1record or transcribe therapeutic sessions is required only for
Page 8, Line 2the initial use of the artificial intelligence system occurring on
Page 8, Line 3or after the effective date of this section and not for each
Page 8, Line 4subsequent therapeutic session, unless the purpose or manner of
Page 8, Line 5use materially changes.
Page 8, Line 6(5) A licensee, registrant, certificate holder, or other
Page 8, Line 7individual lawfully permitted to provide psychotherapy
Page 8, Line 8services in the state shall not allow an artificial intelligence
Page 8, Line 9system to do any of the following:
Page 8, Line 10(a) Directly interact with clients in any form of
Page 8, Line 11therapeutic communication;
Page 8, Line 12(b) Generate therapeutic recommendations or treatment
Page 8, Line 13plans without review and approval by the licensee, registrant,
Page 8, Line 14certificate holder, or other individual lawfully permitted to
Page 8, Line 15provide psychotherapy services in the state; or
Page 8, Line 16(c) Detect emotions or mental states.
Page 8, Line 17(6) Except as provided in subsections (7) and (8) of this
Page 8, Line 18section, an artificial intelligence system used as permitted
Page 8, Line 19pursuant to this section must not provide, direct, guide, or
Page 8, Line 20attempt to provide, direct, or guide psychotherapy, clinical
Page 8, Line 21intervention, counseling, diagnosis, treatment planning, or any
Page 8, Line 22other activity that constitutes the practice of psychotherapy
Page 8, Line 23with an individual or a group.
Page 8, Line 24(7) Nothing in this section prohibits the use of an artificial
Page 8, Line 25intelligence system within an accredited or approved
Page 8, Line 26educational, instructional, or professional training program,
Page 8, Line 27so long as the artificial intelligence system:
Page 9, Line 1(a) Is used solely for educational, administrative,
Page 9, Line 2simulation, or training purposes;
Page 9, Line 3(b) Is not deployed, marketed, or represented as a tool for
Page 9, Line 4use with clients, patients, or members of the public; and
Page 9, Line 5(c) For any simulation, training module, or educational
Page 9, Line 6activity that includes content related to clinical
Page 9, Line 7decision-making, is supervised, reviewed, or controlled by an
Page 9, Line 8individual licensed, certified, registered, or otherwise lawfully
Page 9, Line 9permitted to provide psychotherapy services in the state.
Page 9, Line 10(8) Nothing in this section prohibits the development,
Page 9, Line 11testing, or evaluation of an artificial intelligence system
Page 9, Line 12solely for research purposes conducted under the oversight of
Page 9, Line 13an institutional review board registered with the United States
Page 9, Line 14department of health and human services, so long as the
Page 9, Line 15artificial intelligence system is not offered to consumers or
Page 9, Line 16used to provide psychotherapy services outside of the research
Page 9, Line 17setting.
Page 9, Line 18(9) This section does not apply to:
Page 9, Line 19(a) An individual engaged in the practice of religious
Page 9, Line 20ministry who satisfies the requirements of section 12-245-217 (1)
Page 9, Line 21or an individual with lived experience of mental health
Page 9, Line 22conditions or recovery from substance use who provides peer
Page 9, Line 23support services, without clinical intervention, that are
Page 9, Line 24intended to offer encouragement, understanding, and guidance;
Page 9, Line 25or
Page 9, Line 26(b) A technology or service that provides self-help,
Page 9, Line 27coaching, guided meditation, or wellness tools and that:
Page 10, Line 1(I) Does not diagnose or treat mental health disorders;
Page 10, Line 2and
Page 10, Line 3(II) Clearly discloses that the technology or service is
Page 10, Line 4not a substitute for clinical care.
Page 10, Line 5SECTION 3. In Colorado Revised Statutes, add 6-1-1705.2 as
Page 10, Line 6follows:
Page 10, Line 76-1-1705.2. Use of artificial intelligence systems -
Page 10, Line 8psychotherapy services - prohibited practices.
Page 10, Line 9(1) A person shall not use any term, letter, or phrase in
Page 10, Line 10the advertising, interface, or outputs of an artificial
Page 10, Line 11intelligence system in a manner that:
Page 10, Line 12(a) Indicates or implies that the artificial intelligence
Page 10, Line 13system's output data is being provided by, is endorsed by, or is
Page 10, Line 14equivalent to services provided by an individual licensed,
Page 10, Line 15registered, or certified in the state pursuant to article 245 of
Page 10, Line 16title 12 to engage in the practice of psychotherapy or to provide
Page 10, Line 17psychotherapy services, as defined in section 12-245-202 (14);
Page 10, Line 18(b) Represents that the artificial intelligence system
Page 10, Line 19provides psychotherapy services, as defined in section 12-245-202
Page 10, Line 20(14); or
Page 10, Line 21(c) Represents that a user's data or information is
Page 10, Line 22confidential.
Page 10, Line 23SECTION 4. Applicability. This act applies to action taken on
Page 10, Line 24or after the effective date of this act.
Page 10, Line 25SECTION 5. Safety clause. The general assembly finds,
Page 10, Line 26determines, and declares that this act is necessary for the immediate
Page 10, Line 27preservation of the public peace, health, or safety or for appropriations for
Page 11, Line 1the support and maintenance of the departments of the state and state
Page 11, Line 2institutions.