Skip to content

examples(spin-llm): updates needed? #135

@vdice

Description

@vdice

As of #132, it is unclear if the spin-llm example requires updates. An attempt was made to test the updated example but the following was encountered:

With the following ai-model structure:

         .spin/ai-models/
         └── sentence-transformers
             └── all-minilm-l6-v2
                 ├── model.safetensors
                 └── tokenizer.json

When handling a request, the app produces this error:

Traceback (most recent call last):
  File "/1/spin_sdk/http/__init__.py", line 86, in handle
  File "/0/app.py", line 6, in handle_request
  File "/1/spin_sdk/llm.py", line 55, in infer
  File "/1/spin_sdk/llm.py", line 45, in infer_with_options
  File "/1/spin_sdk/wit/imports/fermyon_spin_llm_2_0_0.py", line 93, in infer
componentize_py_types.Err: Error_ModelNotSupported()

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions