diff --git a/CHANGELOG.md b/CHANGELOG.md index cdcbf922..9067ebf6 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -1,3 +1,48 @@ +# [1.37.0](https://github.com/salesforcecli/plugin-agent/compare/1.36.1...1.37.0) (2026-05-07) + +### Bug Fixes + +- **agent/test/run-eval:** address pre-PR review findings ([f48d2b0](https://github.com/salesforcecli/plugin-agent/commit/f48d2b0d064cdc2c778e97be66f4edf7cf78738d)) +- **agent/test/run-eval:** update command snapshot to reflect --wait removal ([7f9c353](https://github.com/salesforcecli/plugin-agent/commit/7f9c3533bbb497ff1847c048a47fb8641f0b2519)) + +### Features + +- **agent/test/run-eval:** promote command to GA and delegate logic to @salesforce/agents ([e2670cf](https://github.com/salesforcecli/plugin-agent/commit/e2670cf7449b835c852c4985df2b236e05707fd6)) + +## [1.36.1](https://github.com/salesforcecli/plugin-agent/compare/1.36.0...1.36.1) (2026-05-07) + +### Bug Fixes + +- use nonZero ensureExitCode for invalid-input NUTs ([9ea48ee](https://github.com/salesforcecli/plugin-agent/commit/9ea48eeae8e324ac4280a92cc53fad2d3ffaf8ff)) + +# [1.36.0](https://github.com/salesforcecli/plugin-agent/compare/1.35.0...1.36.0) (2026-05-07) + +### Features + +- add --verbose and --concise flags to agent publish authoring-bundle ([065ed7d](https://github.com/salesforcecli/plugin-agent/commit/065ed7d3d12f3e20bc79b7e8fc07ec637f1aace4)) + +# [1.35.0](https://github.com/salesforcecli/plugin-agent/compare/1.34.1...1.35.0) (2026-05-04) + +### Bug Fixes + +- address PR review comments on --agent-json flag ([a955e42](https://github.com/salesforcecli/plugin-agent/commit/a955e42d08630756461ccb4af073bcd84ff1a104)) +- compile agent in NUT instead of using static fixture ([833fbec](https://github.com/salesforcecli/plugin-agent/commit/833fbecc9c9ce14160ffafb21041be6b34028ed1)) +- patch fixture defaultAgentUser so preview sessions API accepts it ([090e128](https://github.com/salesforcecli/plugin-agent/commit/090e128af75722d9f7f6ce89c9c082ae995b7865)) +- set agentType to AgentforceServiceAgent in compiled-agent fixture ([39e157f](https://github.com/salesforcecli/plugin-agent/commit/39e157f4ada11489c3366bbefc08cfef466df7ce)) +- stop patching defaultAgentUser in agent-json NUT ([3d0ba3d](https://github.com/salesforcecli/plugin-agent/commit/3d0ba3dbfa9037bddc05587a60ccf3763d8d073a)) +- use EinsteinServiceAgent agentType in fixture; bump @salesforce/agents to 1.4.0 ([94952aa](https://github.com/salesforcecli/plugin-agent/commit/94952aab888578de6f1c6d46a69dd325d5874a65)) +- use valid agentType value in compiled-agent.json fixture ([39b92a7](https://github.com/salesforcecli/plugin-agent/commit/39b92a792e4a7577161432e0373487162d79fe8c)) + +### Features + +- add hidden --agent-json flag to agent preview start ([64f5452](https://github.com/salesforcecli/plugin-agent/commit/64f5452c351afae4f007046160181d75d3df5a60)) + +## [1.34.1](https://github.com/salesforcecli/plugin-agent/compare/1.34.0...1.34.1) (2026-05-03) + +### Bug Fixes + +- **deps:** bump yaml from 2.8.3 to 2.8.4 ([29d59f9](https://github.com/salesforcecli/plugin-agent/commit/29d59f9163e3ef5b36ef6b262f2fbd5ea9fd48f8)) + # [1.34.0](https://github.com/salesforcecli/plugin-agent/compare/1.33.0...1.34.0) (2026-04-27) ### Bug Fixes diff --git a/README.md b/README.md index a02c36b4..aad49f1e 100644 --- a/README.md +++ b/README.md @@ -77,6 +77,7 @@ sf plugins - [`sf agent test results`](#sf-agent-test-results) - [`sf agent test resume`](#sf-agent-test-resume) - [`sf agent test run`](#sf-agent-test-run) +- [`sf agent test run-eval`](#sf-agent-test-run-eval) - [`sf agent validate authoring-bundle`](#sf-agent-validate-authoring-bundle) ## `sf agent activate` @@ -126,7 +127,7 @@ EXAMPLES $ sf agent activate --api-name Resort_Manager --version 2 --target-org my-org ``` -_See code: [src/commands/agent/activate.ts](https://github.com/salesforcecli/plugin-agent/blob/1.34.0/src/commands/agent/activate.ts)_ +_See code: [src/commands/agent/activate.ts](https://github.com/salesforcecli/plugin-agent/blob/1.37.0/src/commands/agent/activate.ts)_ ## `sf agent create` @@ -193,7 +194,7 @@ EXAMPLES $ sf agent create --name "Resort Manager" --spec specs/resortManagerAgent.yaml --preview ``` -_See code: [src/commands/agent/create.ts](https://github.com/salesforcecli/plugin-agent/blob/1.34.0/src/commands/agent/create.ts)_ +_See code: [src/commands/agent/create.ts](https://github.com/salesforcecli/plugin-agent/blob/1.37.0/src/commands/agent/create.ts)_ ## `sf agent deactivate` @@ -234,7 +235,7 @@ EXAMPLES $ sf agent deactivate --api-name Resort_Manager --target-org my-org ``` -_See code: [src/commands/agent/deactivate.ts](https://github.com/salesforcecli/plugin-agent/blob/1.34.0/src/commands/agent/deactivate.ts)_ +_See code: [src/commands/agent/deactivate.ts](https://github.com/salesforcecli/plugin-agent/blob/1.37.0/src/commands/agent/deactivate.ts)_ ## `sf agent generate agent-spec` @@ -341,7 +342,7 @@ EXAMPLES $ sf agent generate agent-spec --tone formal --agent-user resortmanager@myorg.com ``` -_See code: [src/commands/agent/generate/agent-spec.ts](https://github.com/salesforcecli/plugin-agent/blob/1.34.0/src/commands/agent/generate/agent-spec.ts)_ +_See code: [src/commands/agent/generate/agent-spec.ts](https://github.com/salesforcecli/plugin-agent/blob/1.37.0/src/commands/agent/generate/agent-spec.ts)_ ## `sf agent generate authoring-bundle` @@ -418,7 +419,7 @@ EXAMPLES other-package-dir/main/default --target-org my-dev-org ``` -_See code: [src/commands/agent/generate/authoring-bundle.ts](https://github.com/salesforcecli/plugin-agent/blob/1.34.0/src/commands/agent/generate/authoring-bundle.ts)_ +_See code: [src/commands/agent/generate/authoring-bundle.ts](https://github.com/salesforcecli/plugin-agent/blob/1.37.0/src/commands/agent/generate/authoring-bundle.ts)_ ## `sf agent generate template` @@ -480,7 +481,7 @@ EXAMPLES my-package --source-org my-scratch-org ``` -_See code: [src/commands/agent/generate/template.ts](https://github.com/salesforcecli/plugin-agent/blob/1.34.0/src/commands/agent/generate/template.ts)_ +_See code: [src/commands/agent/generate/template.ts](https://github.com/salesforcecli/plugin-agent/blob/1.37.0/src/commands/agent/generate/template.ts)_ ## `sf agent generate test-spec` @@ -545,7 +546,7 @@ EXAMPLES force-app//main/default/aiEvaluationDefinitions/Resort_Manager_Tests.aiEvaluationDefinition-meta.xml ``` -_See code: [src/commands/agent/generate/test-spec.ts](https://github.com/salesforcecli/plugin-agent/blob/1.34.0/src/commands/agent/generate/test-spec.ts)_ +_See code: [src/commands/agent/generate/test-spec.ts](https://github.com/salesforcecli/plugin-agent/blob/1.37.0/src/commands/agent/generate/test-spec.ts)_ ## `sf agent preview` @@ -618,7 +619,7 @@ EXAMPLES $ sf agent preview --use-live-actions --apex-debug --output-dir transcripts/my-preview ``` -_See code: [src/commands/agent/preview.ts](https://github.com/salesforcecli/plugin-agent/blob/1.34.0/src/commands/agent/preview.ts)_ +_See code: [src/commands/agent/preview.ts](https://github.com/salesforcecli/plugin-agent/blob/1.37.0/src/commands/agent/preview.ts)_ ## `sf agent preview end` @@ -673,7 +674,7 @@ EXAMPLES $ sf agent preview end --authoring-bundle My_Local_Agent ``` -_See code: [src/commands/agent/preview/end.ts](https://github.com/salesforcecli/plugin-agent/blob/1.34.0/src/commands/agent/preview/end.ts)_ +_See code: [src/commands/agent/preview/end.ts](https://github.com/salesforcecli/plugin-agent/blob/1.37.0/src/commands/agent/preview/end.ts)_ ## `sf agent preview send` @@ -731,7 +732,7 @@ EXAMPLES $ sf agent preview send --utterance "what can you help me with?" --authoring-bundle My_Local_Agent ``` -_See code: [src/commands/agent/preview/send.ts](https://github.com/salesforcecli/plugin-agent/blob/1.34.0/src/commands/agent/preview/send.ts)_ +_See code: [src/commands/agent/preview/send.ts](https://github.com/salesforcecli/plugin-agent/blob/1.37.0/src/commands/agent/preview/send.ts)_ ## `sf agent preview sessions` @@ -764,7 +765,7 @@ EXAMPLES $ sf agent preview sessions ``` -_See code: [src/commands/agent/preview/sessions.ts](https://github.com/salesforcecli/plugin-agent/blob/1.34.0/src/commands/agent/preview/sessions.ts)_ +_See code: [src/commands/agent/preview/sessions.ts](https://github.com/salesforcecli/plugin-agent/blob/1.37.0/src/commands/agent/preview/sessions.ts)_ ## `sf agent preview start` @@ -829,7 +830,7 @@ EXAMPLES $ sf agent preview start --api-name My_Published_Agent ``` -_See code: [src/commands/agent/preview/start.ts](https://github.com/salesforcecli/plugin-agent/blob/1.34.0/src/commands/agent/preview/start.ts)_ +_See code: [src/commands/agent/preview/start.ts](https://github.com/salesforcecli/plugin-agent/blob/1.37.0/src/commands/agent/preview/start.ts)_ ## `sf agent publish authoring-bundle` @@ -838,14 +839,17 @@ Publish an authoring bundle to your org, which results in a new agent or a new v ``` USAGE $ sf agent publish authoring-bundle -o [--json] [--flags-dir ] [--api-version ] [-n ] - [--skip-retrieve] + [--skip-retrieve] [-v | --concise] FLAGS -n, --api-name= API name of the authoring bundle you want to publish; if not specified, the command provides a list that you can choose from. -o, --target-org= (required) Username or alias of the target org. Not required if the `target-org` configuration variable is already set. + -v, --verbose Display detailed output showing all metadata components retrieved and deployed during the + publish process. --api-version= Override the api version used for api requests made by this command + --concise Display minimal output with only essential information about the publish operation. --skip-retrieve Don't retrieve the metadata associated with the agent to your DX project. GLOBAL FLAGS @@ -876,9 +880,17 @@ EXAMPLES Publish an authoring bundle with API name MyAuthoringBundle to the org with alias "my-dev-org": $ sf agent publish authoring-bundle --api-name MyAuthoringbundle --target-org my-dev-org + + Publish with verbose output to see all retrieved and deployed metadata components: + + $ sf agent publish authoring-bundle --api-name MyAuthoringbundle --verbose + + Publish with concise output showing only essential information: + + $ sf agent publish authoring-bundle --api-name MyAuthoringbundle --concise ``` -_See code: [src/commands/agent/publish/authoring-bundle.ts](https://github.com/salesforcecli/plugin-agent/blob/1.34.0/src/commands/agent/publish/authoring-bundle.ts)_ +_See code: [src/commands/agent/publish/authoring-bundle.ts](https://github.com/salesforcecli/plugin-agent/blob/1.37.0/src/commands/agent/publish/authoring-bundle.ts)_ ## `sf agent test create` @@ -933,7 +945,7 @@ EXAMPLES $ sf agent test create --spec specs/Resort_Manager-testSpec.yaml --api-name Resort_Manager_Test --preview ``` -_See code: [src/commands/agent/test/create.ts](https://github.com/salesforcecli/plugin-agent/blob/1.34.0/src/commands/agent/test/create.ts)_ +_See code: [src/commands/agent/test/create.ts](https://github.com/salesforcecli/plugin-agent/blob/1.37.0/src/commands/agent/test/create.ts)_ ## `sf agent test list` @@ -955,8 +967,8 @@ GLOBAL FLAGS DESCRIPTION List the available agent tests in your org. - The command outputs a table with the name (API name) of each test along with its unique ID and the date it was created - in the org. + The command outputs a table with the name (API name) of each test along with its unique ID, type ('agentforce-studio' + or 'testing-center'), and the date it was created in the org. EXAMPLES List the agent tests in your default org: @@ -968,7 +980,7 @@ EXAMPLES $ sf agent test list --target-org my-org ``` -_See code: [src/commands/agent/test/list.ts](https://github.com/salesforcecli/plugin-agent/blob/1.34.0/src/commands/agent/test/list.ts)_ +_See code: [src/commands/agent/test/list.ts](https://github.com/salesforcecli/plugin-agent/blob/1.37.0/src/commands/agent/test/list.ts)_ ## `sf agent test results` @@ -977,7 +989,7 @@ Get the results of a completed agent test run. ``` USAGE $ sf agent test results -o -i [--json] [--flags-dir ] [--api-version ] [--result-format - json|human|junit|tap] [-d ] [--verbose] + json|human|junit|tap] [-d ] [--test-runner agentforce-studio|testing-center] [--verbose] FLAGS -d, --output-dir= Directory to write the agent test results into. @@ -987,6 +999,8 @@ FLAGS --api-version= Override the api version used for api requests made by this command --result-format=