Posts by curiousicae@tech.lgbt
 (DIR) Post #B4CcVQJvHMzkMrAdk0 by curiousicae@tech.lgbt
       0 likes, 0 repeats
       
       @ariadneI just so happend to try writing a timeline sumarizer yesterday. Not having the hardware and skills to train an own model specifically for this, I had to stick with pre-made MLMs (medium canguage models) from the Ollama repo though. Only having a ten-year old laptop dGPU available, I had to stick to ~1,2b models to not run out of VRAM and apparently those are considered just too small for that kind problem (while still being slow).Of the ones tried only DeepSeek-1 (general model) and LFM2.5 (supposidly optimized for summaries) ran well enough and depending on the exact input tried they would sometimes produce adequate summaries, but start falling apart or fantasize on even minor input/instruction changes. (And also LFM2.5 read like it was trained by a middle manager no matter what I did? :blobPikaLaugh:)Apparently ~7b models are supposed to be much better for this, but I kinda wonder: Do you think a custom-made model would be able to do this even with even <1b params too? Or it really cannot?