[npu] 43 weight matrices quantized to int8 and resident on the NPU
[stories15M] dim=288 layers=6 heads=6 | NPU int8 linears | temp=0.85 top-p=0.9 seed=7

--- story ---
One day, a robot named Bolt found a small blue key in the garden. He thought, "I want to use this key to open something!" So, he took the key and went to his friend, a small bird named Chirpy. Chirpy was very smart and always knew what to do.
Chirpy said, "Let's use this key to open the door!" They tried the key, and it worked! Inside the house, they found a room full of toys and games. They were very happy and played together all day.
After playing, they said goodbye to each other and went back to their homes. They knew they would always remember the day they found the key and opened the door to their fun and adventure.

[speed] 140 tokens, 53.2 tok/s (NPU int8 linears); prompt prefill 185 ms
