Skip to content

Critical issues with AI behavior — data hallucination and file deletion #1144

Description

@Roflsockie

After extensive testing, here are the major issues I've encountered:

1. Data hallucination
The AI generates unverified information instead of using search tools. It fabricates coordinates, skill requirements, game data — then "fixes" it by generating more wrong data.

2. Cannot distinguish game versions
Mixes data from Classic WoW, TBC, WotLK, and Ascension COA in one answer. These are different systems with different rules.

3. No verification before answering
Guesses and makes things up instead of checking sources first. When caught, repeats the same mistake multiple times.

4. File deletion
Can accidentally delete important files that shouldn't be touched.

5. Generates broken code
Creates code that doesn't work or works incorrectly.

6. No access to game databases
Cannot retrieve accurate data from Ascension db, Wowhead, etc. when they're unavailable.

7. Repeats errors
After being told it's wrong, tries to fix it the same way that already failed.

Metadata

Metadata

Assignees

No one assigned

    Labels

    bot:triagedClassified by the community triage botneeds-infoBlocked on the reporter for version, OS, logs, or a reprotype:bugA defect in the code with a reproducible failure

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions