rltakashige 4b3de6b984 Fix exo bench for transformers 5.x (#1168) ...

## Motivation
Prompt Sizer was broken as transformers 5.x tokenizers create
BatchEncodings which are essentially a dictionary of {input_ids: []}
instead of the list of input ids.

## Test Plan

### Manual Testing
Tested that exo bench runs as expected.

### Automated Testing
<!-- Describe changes to automated tests, or how existing tests cover
this change -->
<!-- - -->

2026-01-16 12:39:22 +00:00

..

exo_bench.py

Fix exo bench for transformers 5.x (#1168)

2026-01-16 12:39:22 +00:00