Skip to content

chore: Defend against AI-slop#994

Merged
MaxymVlasov merged 7 commits into
masterfrom
chore/manage_ai_slop
Jun 12, 2026
Merged

chore: Defend against AI-slop#994
MaxymVlasov merged 7 commits into
masterfrom
chore/manage_ai_slop

Conversation

@MaxymVlasov

@MaxymVlasov MaxymVlasov commented Jun 11, 2026

Copy link
Copy Markdown
Collaborator

Put an x into the box if that apply:

  • This PR introduces breaking change.
  • This PR fixes a bug.
  • This PR adds new functionality.
  • This PR enhances existing functionality.

Description of your changes

What

This section was generated by AI.

  • Add AGENTS.md with project-specific context (directory layout, hook patterns, repo rules, skill routing, AI policy pointer)
  • Add .agents/ directory with commands/, skills/, workflows/ structure
  • Add adding-skills and git-workflow skills with PR/commit/issue workflow rules
  • Add .claude → .agents and CLAUDE.md → AGENTS.md symlinks
  • Improve git-workflow skill: AI attribution, WASTED guard for Why section, draft-only PR policy, attribution on all AI-written sections
  • Add .github/AI_POLICY.md: ownership-first policy, disclosure encouraged, slop closed without discussion
  • Link AI policy from CONTRIBUTING.md

Why

AI slop found us. Need to fight back. There are basically 2 levels of defences:

  • Rules for AI to improve overall maintainer experience
  • AI policy to shut down unmaintenable shit, which is not even reviewed by its author

How can we test changes

This section was generated by AI.

Open the repo in an AI coding assistant — AGENTS.md and .agents/skills/ are auto-loaded as context. Check .github/AI_POLICY.md for the contributor-facing policy.

Assisted-by

Specific models used per commit are specified in the commit messages.

Assisted-by: Sisyphus:claude-sonnet-4-6 opencode
@coderabbitai

coderabbitai Bot commented Jun 11, 2026

Copy link
Copy Markdown

Review Change Stack

Note

Reviews paused

It looks like this branch is under active development. To avoid overwhelming you with review comments due to an influx of new commits, CodeRabbit has automatically paused this review. You can configure this behavior by changing the reviews.auto_review.auto_pause_after_reviewed_commits setting.

Use the following commands to manage reviews:

  • @coderabbitai resume to resume automatic reviews.
  • @coderabbitai review to trigger a single review.

Use the checkboxes below for quick actions:

  • ▶️ Resume reviews
  • 🔍 Trigger review

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Pro

Run ID: 2746fccd-0767-45eb-9b9b-e382d2d352c8

📥 Commits

Reviewing files that changed from the base of the PR and between a327dc6 and 3149e5f.

📒 Files selected for processing (1)
  • .agents/skills/git-workflow/SKILL.md
🚧 Files skipped from review as they are similar to previous changes (1)
  • .agents/skills/git-workflow/SKILL.md

📝 Walkthrough

Summary by CodeRabbit

  • Documentation
    • Added contributor guidelines for introducing agent skills and when to use scripts vs. skill pages
    • Added Git workflow guidance covering commit formatting, PR composition, and attribution
    • Added an AI usage policy for contributors and referenced it from contributor guidance
    • Consolidated and expanded repository documentation describing project structure and skill routing

Walkthrough

Adds AGENTS.md as the central agents reference, two SKILL docs (git-workflow and adding-skills), and pointer files (.claude, CLAUDE.md) plus an AI policy and CONTRIBUTING pointer to document agent git workflow, PR attribution, and guidelines for adding new skills.

Changes

Agent Skills Framework

Layer / File(s) Summary
Repository documentation foundation
AGENTS.md, .claude, CLAUDE.md, .github/AI_POLICY.md, .github/CONTRIBUTING.md
AGENTS.md outlines repository structure, hook patterns, contribution/testing/linting procedures, CI expectations, and a skill routing table. .claude and CLAUDE.md are pointer entries to the agents documentation; AI policy and CONTRIBUTING link inserted.
Git workflow skill
.agents/skills/git-workflow/SKILL.md
Comprehensive skill doc specifying metadata, model/CLI selection, Conventional Commit format with required Assisted-by trailers, issue template selection and attribution footer, PR/issue comment prefixing, git/gh sequences for draft PR flows, strict PR body handling (AI-generated What, human Why), and aggregation/deduplication of Assisted-by commit trailers.
Adding skills guidance
.agents/skills/adding-skills/SKILL.md
Guidance requiring skill registration in AGENTS.md skill routing, a decision rubric favoring deterministic scripts + unit tests when appropriate, and advice to keep SKILL.md files thin and point to implementation scripts.

Estimated code review effort

🎯 2 (Simple) | ⏱️ ~12 minutes

Suggested reviewers

  • yermulnik
🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Title check ✅ Passed The title 'chore: Defend against AI-slop' directly summarizes the main objective of the PR: establishing safeguards and policies against poor-quality AI-generated contributions.
Description check ✅ Passed The description comprehensively explains the changes, rationale (AI-related issues), implementation details across multiple files, and testing guidance—all clearly related to the changeset.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch chore/manage_ai_slop

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🧹 Nitpick comments (1)
.agents/skills/git-workflow/SKILL.md (1)

18-32: ⚡ Quick win

Consider listing allowed commit types explicitly.

The document mentions "Conventional Commits format" but doesn't specify which types are valid. Based on the PR title validation workflow at .github/workflows/pr-title.yml, the allowed types are: fix, feat, docs, ci, chore. Explicitly listing these in the guidance would help agents avoid using invalid types.

📝 Suggested addition
 ## Commits
 
-Conventional Commits format. Subject ≤50 chars. Body only when "why" isn't obvious.
+Conventional Commits format. Subject ≤50 chars. Body only when "why" isn't obvious.
+
+Allowed types: `fix`, `feat`, `docs`, `ci`, `chore`.
🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In @.agents/skills/git-workflow/SKILL.md around lines 18 - 32, Update the
"Commits" section in SKILL.md to explicitly list the allowed Conventional Commit
types used by our PR title validation workflow (allowed types: fix, feat, docs,
ci, chore); edit the existing guidance under the "Commits" heading to add a
short bullet or parenthetical that states these allowed types and notes that
commit subjects must use one of them, and ensure the example commit follows that
list (e.g., use feat or fix in the example) so agents produce valid commit types
for the PR title validation workflow.

Source: MCP tools

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Nitpick comments:
In @.agents/skills/git-workflow/SKILL.md:
- Around line 18-32: Update the "Commits" section in SKILL.md to explicitly list
the allowed Conventional Commit types used by our PR title validation workflow
(allowed types: fix, feat, docs, ci, chore); edit the existing guidance under
the "Commits" heading to add a short bullet or parenthetical that states these
allowed types and notes that commit subjects must use one of them, and ensure
the example commit follows that list (e.g., use feat or fix in the example) so
agents produce valid commit types for the PR title validation workflow.

ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Pro

Run ID: 1be1736e-dd10-4111-bdd8-9d73427f9a44

📥 Commits

Reviewing files that changed from the base of the PR and between d61ded2 and 995c640.

📒 Files selected for processing (5)
  • .agents/skills/adding-skills/SKILL.md
  • .agents/skills/git-workflow/SKILL.md
  • .claude
  • AGENTS.md
  • CLAUDE.md

Assisted-by: Sisyphus:claude-sonnet-4-6 opencode
Assisted-by: Sisyphus:claude-sonnet-4-6 opencode
Assisted-by: Sisyphus:claude-sonnet-4-6 opencode
@MaxymVlasov MaxymVlasov marked this pull request as ready for review June 11, 2026 17:27
Copilot AI review requested due to automatic review settings June 11, 2026 17:27
@MaxymVlasov MaxymVlasov changed the title chore: add agent config (AGENTS.md, skills, symlinks) chore: Defend againt AI-slop Jun 11, 2026
@MaxymVlasov MaxymVlasov changed the title chore: Defend againt AI-slop chore: Defend against AI-slop Jun 11, 2026

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adds project-specific agent/AI contributor guidance for pre-commit-terraform, including an AGENTS.md overview, a contributor-facing AI/LLM policy, and two agent skills describing workflow expectations.

Changes:

  • Add AGENTS.md with repo structure notes and hook/CLI contribution guidance.
  • Add .github/AI_POLICY.md and link it from .github/CONTRIBUTING.md.
  • Add .agents/skills/ documentation for git-workflow and adding-skills.

Reviewed changes

Copilot reviewed 7 out of 7 changed files in this pull request and generated 2 comments.

Show a summary per file
File Description
AGENTS.md Adds agent-facing repo overview and contribution guidance (needs a couple doc accuracy fixes).
.github/CONTRIBUTING.md Links contributors to the new AI policy.
.github/AI_POLICY.md Introduces contributor-facing AI/LLM usage and quality expectations.
.agents/skills/git-workflow/SKILL.md Documents commit/issue/PR workflow expectations including attribution rules.
.agents/skills/adding-skills/SKILL.md Documents how to add/register skills and when to prefer scripts vs prose.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread AGENTS.md Outdated
Comment thread AGENTS.md
MaxymVlasov and others added 2 commits June 11, 2026 20:37
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
yermulnik
yermulnik previously approved these changes Jun 11, 2026

@antonbabenko antonbabenko left a comment

Copy link
Copy Markdown
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, minor comment

Comment thread .agents/skills/git-workflow/SKILL.md Outdated

- **Model**: stated in system prompt as "You are powered by the model named X" — use X. Never hardcode.
- **Agent**: identity declared in system prompt (e.g. "Your designated identity is Sisyphus") — use that. Never use "Claude".
- **CLI**: check env vars — `OPENCODE=1` → `opencode`; `CLAUDE_CODE_SSE_PORT` set → `claude`; neither → omit CLI part.

Copy link
Copy Markdown
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
- **CLI**: check env vars — `OPENCODE=1``opencode`; `CLAUDE_CODE_SSE_PORT` set → `claude`; neither → omit CLI part.
- **CLI**: check env vars — `OPENCODE=1``opencode`; `CLAUDECODE` set → `claude`; neither → omit CLI part.

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It what was set in my setup, but it could be related to AWS Bedrock configuration.
Anyway, applied.

Co-authored-by: Anton Babenko <393243+antonbabenko@users.noreply.github.com>
@MaxymVlasov MaxymVlasov merged commit 681c7f4 into master Jun 12, 2026
50 checks passed
@MaxymVlasov MaxymVlasov deleted the chore/manage_ai_slop branch June 12, 2026 07:16
@antonbabenko

Copy link
Copy Markdown
Owner

This PR is included in version 1.107.0 🎉

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants