Update tokenizer_config.json to fix 'Error: Object of type Undefined is not JSON serializable'
#7
by
bigrobinson
- opened
Tool calls are inconsistently handled. The LLM produces tool calls with 'arguments' key, where the chat template expects a 'parameters' key. This causes Error: Object of type Undefined is not JSON serializable when attempting to tokenize message list with tool responses included under tool role.
bigrobinson
changed pull request title from
Update tokenizer_config.json
to Update tokenizer_config.json to fix 'Error: Object of type Undefined is no JSON serializable'
bigrobinson
changed pull request title from
Update tokenizer_config.json to fix 'Error: Object of type Undefined is no JSON serializable'
to Update tokenizer_config.json to fix 'Error: Object of type Undefined is not JSON serializable'