[npu] 43 weight matrices quantized to int8 and resident on the NPU
[stories15M] dim=288 layers=6 heads=6 | NPU int8 linears | temp=0.85 top-p=0.9 seed=7

--- story ---
Lily found a tiny door behind the bookshelf, no bigger than her hand. She scratched it and felt a big tug. She pulled it out and pulled it towards the door. She heard a click and the door opened.
"Whoa, what are you doing?" Mom said. She came into the living room and saw Lily with her hands over the door. "You can't open it. It's closed. It's not safe. It's broken."
Lily felt scared and sorry. She did not mean to open the door. She just wanted to see what was on the other side. She started to cry.
"Mom, I'm sorry, I'm sorry!" Lily sobbed. "I just wanted to see what was on the other side. It was a surprise. Please, Mom, don't be mad at me."
Mom looked at Lily with a mild and kind face. She saw that Lily was sorry and scared. She felt sorry for her too.
"Lily, I know you were curious. But you have to

[speed] 221 tokens, 41.0 tok/s (NPU int8 linears); prompt prefill 253 ms
