AI Summit_Sept. 13 2024

2. Risks associated with output

Why is this a concern?

Group

Risk

Indicator

Bias can harm users of the AI models and magnify existing discriminatory behaviors. Business entities can face reputational harms, disruption to operations, and other consequences. Bias can harm persons affected by the decisions of the N " ³ Q Q disruption to operations, and other legal consequences. Laws and regulations concerning the use of content that looks the same or closely similar to other copyrighted data are largely unsettled and can vary from country to country, providing challenges in determining and implementing N " ³ Q harms, disruption to operations, and other legal consequences. False output can mislead users and be incorporated into downstream artifacts, further spreading misinformation. This can harm both owners and users of the AI models. ! Q ³ Q Q disruption to operations, and other legal consequences. Hateful, abusive, and profane (HAP) or obscene content can adversely impact and harm people interacting with the model. ! Q ³ Q Q disruption to operations, and other legal consequences. A person might act on incomplete advice or worry about a situation that is not applicable to them due to the overgeneralized nature of the content generated.

New

Fairness

Output bias: Generated content might unfairly represent certain groups or individuals.

Decision bias: When one group is unfairly advantaged over another due to effect of decisions made by human using the model output. Copyright infringement: When a model generates content that is too similar or identical to existing work protected by copyright or covered by open source license agreement.

Traditional

Intellectual Properly

New

Value Alignment

Hallucination: Generation of factually inaccurate or untruthful content.

New

New

Toxic output: When the model produces hateful, abusive, and profane (HAP) or obscene content.

New

Dangerous advice: When a model provides advice without having enough information, resulting in possible danger if the advice is followed. Spreading disinformation: Using a model to create misleading or false information to deceive or influence a targeted audience.

Misuse

Spreading disinformation might affect a human’s ability to N " ³ Q reputational harms, disruption to operations, and other legal consequences.

New

Toxic content might negatively affect the well-being of its N " ³ Q harms, disruption to operations, and other legal consequences.

New

Toxicity: Using a model to generate hateful, abusive, and profane (HAP) or obscene content.

! ³ Deepfakes can spread disinformation about a person, possibly resulting in negative impact on the person’s reputation. " ³ Q Q disruption to operations, and other legal consequences.

Nonconsensual use: Using a model to imitate people through video (deepfakes), images, audio, or other modalities without their consent.

12

Foundation models: Opportunities, risks and mitigations | February 2024

AI Roundtable Page 686