Skip to content

Token indices sequence length is longer #4

Description

@ziat007

I am getting this error, I wish this project got some updates, it is exactly what I need.
Token indices sequence length is longer than the specified maximum sequence length for this model (283994 > 4096). Running this sequence through the model will result in indexing errors
Traceback (most recent call last):
File "D:\GPT\DatesetExtraction-main\BookParse.py", line 115, in
response = submit_to_api(tokenizer.decode(chunk))
File "D:\GPT\DatesetExtraction-main\BookParse.py", line 101, in submit_to_api
print(f"Request failed: {e}")
UnboundLocalError: local variable 'e' referenced before assignment

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions