Fix example pipelines: 44 of 45 fail 'orchestrator validate'

[jeremymanning]

Background

During the removal of all mock/simulated functionality (#103), we discovered that many example pipelines use outdated syntax or reference non-existent functionality. To ensure we can properly test the core orchestrator functionality, we need to temporarily remove these examples and their associated tests.

Archived Examples

The following example YAML pipelines were archived and removed:

• automated_testing_system.yaml
• code_analysis_suite.yaml
• code_optimization.yaml
• content_creation_pipeline.yaml
• creative_writing_assistant.yaml
• customer_support_automation.yaml
• data_processing_workflow.yaml
• document_intelligence.yaml
• financial_analysis_bot.yaml
• interactive_chat_bot.yaml
• multi_agent_collaboration.yaml
• research_assistant.yaml
• scalable_customer_service_agent.yaml

A complete backup of the examples directory has been saved at: /tmp/orchestrator_examples_backup.tar.gz (78KB)

TODO

Once the core orchestrator functionality is fully working with real models:

1. Review archived examples - Check which examples use valid, current syntax
2. Update example syntax - Ensure all examples follow the current YAML schema
3. Verify real functionality - Each example should:
   • Use only real control systems and models
   • Not rely on any mocked or simulated behavior
   • Produce high-quality outputs when executed
4. Test with various inputs - Examples should work for users with:
   • Different expertise levels
   • Various use cases and scenarios
   • Different model availability (OpenAI, Anthropic, etc.)
5. Add comprehensive tests - Each example needs tests that:
   • Verify the pipeline executes successfully
   • Check that each step produces expected results
   • Manually validate output quality
   • Test with realistic user inputs

Related Issues

• Find and correct fake tests #36 - Base issue for removing mocks
• Remove all Testable/Mock/Simulated classes from test suite #103 - Remove all fake test classes
  EOF < /dev/null

[jeremymanning]

This issue has been consolidated into #8 for better tracking of all example pipeline work. See #8 (comment)

[jeremymanning]

Re-verified by execution: 44 of 45 examples/*.yaml fail orchestrator validate.

A full sweep of every example plus the 3 golden pipelines found only one example validating cleanly. The shipped examples are the project's primary documentation surface, so this is a credibility problem as much as a correctness one.

Scope: use #154–#182 (the 29 per-pipeline validation issues, all closed) as the checklist rather than reopening them individually — the per-pipeline issues are too granular to manage and their individual evidence is stale.

Note this partly depends on #241: some failures are validator false positives rather than broken examples, and fixing the validator will clear those without touching the YAML.