[HN Gopher] Magistral -- the first reasoning model by Mistral AI
       ___________________________________________________________________
        
       Magistral -- the first reasoning model by Mistral AI
        
       Author : meetpateltech
       Score  : 895 points
       Date   : 2025-06-10 14:08 UTC (1 days ago)
        
 (HTM) web link (mistral.ai)
 (TXT) w3m dump (mistral.ai)
        
       | cchance wrote:
       | Good first shot i guess, but the small ones about as good as v3,
       | and the mediums not quite as good as r1... i wonder if that r1 is
       | the actual new one or the old one
        
         | hacklas wrote:
         | The Deepseek V3 is a model with 671 billion parameters, of
         | which 37 billion are active.
         | 
         | Magistral Small is a 24 billion parameter model.
         | 
         | Pretty impressive in terms of efficiency for Mistral.
         | 
         | The size of the Magistral Medium is not publicly available, so
         | it is difficult to compare efficiency there.
        
           | kouteiheika wrote:
           | > The size of the Magistral Medium is not publicly available,
           | so it is difficult to compare efficiency there.
           | 
           | FWIW one of their 70B models has leaked in the past (search
           | for "miqu") and rumors at the time were that it was their
           | medium model.
        
       | danielhanchen wrote:
       | I made some GGUFs for those interested in running them at
       | https://huggingface.co/unsloth/Magistral-Small-2506-GGUF
       | 
       | ollama run hf.co/unsloth/Magistral-Small-2506-GGUF:UD-Q4_K_XL
       | 
       | or
       | 
       | ./llama.cpp/llama-cli -hf unsloth/Magistral-
       | Small-2506-GGUF:UD-Q4_K_XL --jinja --temp 0.7 --top-k -1 --top-p
       | 0.95 -ngl 99
       | 
       | Please use --jinja for llama.cpp and use temperature = 0.7, top-p
       | 0.95!
       | 
       | Also best to increase Ollama's context length to say 8K at least:
       | OLLAMA_CONTEXT_LENGTH=8192 ollama serve &. Some other details in
       | https://docs.unsloth.ai/basics/magistral
        
         | danielhanchen wrote:
         | Their paper https://mistral.ai/static/research/magistral.pdf is
         | also cool! They edited GRPO via:
         | 
         | 1. Removed KL Divergence
         | 
         | 2. Normalize by total length (Dr. GRPO style)
         | 
         | 3. Minibatch normalization for advantages
         | 
         | 4. Relaxing trust region
        
           | Onavo wrote:
           | > _Removed KL Divergence_
           | 
           | Wait, how are they computing the loss?
        
             | danielhanchen wrote:
             | Oh it's the KL term sorry - beta * KL ie they set beta to
             | 0.
             | 
             | The goal of it was to "force" the model not to stray to far
             | away from the original checkpoint, but it can hinder the
             | model from learning new things
        
             | mjburgess wrote:
             | It's just a penalty term that they delete
        
             | trc001 wrote:
             | It's become trendy to delete it. I say trendy because many
             | papers delete it without offering any proof that it is
             | meaningless
        
           | gyrovagueGeist wrote:
           | Does anyone know why they added minibatch advantage
           | normalization (or when it can be useful)?
           | 
           | The paper they cite "What matters in on-policy RL" claims it
           | does not lead to much difference on their suite of test
           | problems, and (mean-of-minibatch)-normalization doesn't seem
           | theoretically motivated for convergence to the optimal
           | policy?
        
             | danielhanchen wrote:
             | Tbh I'm unsure as well I took a skim of the paper so if I
             | find anything I'll post it here!
        
         | cpldcpu wrote:
         | But this is just the SFT - "distilled" model, not the one
         | optimized with RL, right?
        
           | danielhanchen wrote:
           | Oh I think it's SFT + RL as mentioned in the paper - they
           | said combining both is actually more performant than just RL
        
         | lxe wrote:
         | Thanks for all you do!
        
           | danielhanchen wrote:
           | Thanks!
        
         | monkmartinez wrote:
         | At the risk of dating myself; Unsloth is the Bomb-dot-com!!! I
         | use your models all the time and they just work. Thank you!!!
         | What does llama.cpp normally use if not "jinja" for their
         | templates?
        
           | danielhanchen wrote:
           | Oh thanks! Yes I was gonna bring it up to them! Imo if there
           | is a chat template, by default it should be --jinja
        
         | ozgune wrote:
         | Their benchmarks are interesting. They are comparing to
         | DeepSeek-V3's (non-reasoning) December and DeepSeek-R1's
         | January releases. I feel that comparing to DeepSeek-R1-0528
         | would be more fair.
         | 
         | For example, R1 scores 79.8 on AIME 2024, R1-0528 performs
         | 91.4.
         | 
         | R1 scores 70 on AIME 2025, R1-0528 scores 87.5. R1-0528 does
         | similarly better for GPQA Diamond, LiveCodeBench, and Aider
         | (about 10-15 points higher).
         | 
         | https://huggingface.co/deepseek-ai/DeepSeek-R1-0528
        
           | semi-extrinsic wrote:
           | Would also be interesting to compare with R1-0528-Qwen3-8B
           | (chain-of-thought distilled from Deepseek-R1-0528 and post-
           | trained into Qwen3-8B). It scores 86 and 76 on AIME 2024 and
           | 2025 respectively.
           | 
           | Currently running the 6-bit XL quant on a single old RTX 2080
           | Ti and I'm quite impressed TBH. Simply wild for a sub-8GB
           | download.
        
             | danielhanchen wrote:
             | I'm surprised it does very well as well - that's pretty
             | cool to see!
        
             | saratogacx wrote:
             | I have the same card on my machine at home, what is your
             | config to run the model?
        
               | semi-extrinsic wrote:
               | Downloaded the gguf file by unsloth, ran llama-cli from
               | llama.cpp with that file as an argument.
               | 
               | IIUC, nowadays there is a jinja templated metadata-struct
               | inside the gguf file itself. This contains the chat
               | template and other config.
        
           | derefr wrote:
           | I presume that "outdated upon release" benchmarks like these
           | happen because the benchmark and the models in it were chosen
           | _first_ , before the model was created; and the model's
           | development progress was measured using the benchmark. It
           | then doesn't occur to anyone that the benchmark the engineers
           | had been relying upon isn't also a good/useful benchmark for
           | marketing upon release. From the inside view, it's just a
           | benchmark, already there, already achieving impressive
           | results, a whole-company internal target to hit for months --
           | so why _not_ publish it?
        
         | gavi wrote:
         | too much thinking
         | 
         | https://gist.github.com/gavi/b9985f730f5deefe49b6a28e5569d46...
        
           | fzzzy wrote:
           | My impression from running the first R1 release locally was
           | that it also does too much thinking.
        
             | cluckindan wrote:
             | It does not do any thinking. It is a statistical model,
             | just like the rest of them.
        
               | robmccoll wrote:
               | What are we doing when we think?
        
               | otabdeveloper4 wrote:
               | We don't know yet. But we do know it's certainly not
               | statistical token prediction.
               | 
               | (People can do statistical token prediction too, but
               | that's called "bullshitting", not "thinking". Thinking is
               | a much wider class of activity.)
        
               | LordDragonfang wrote:
               | Do we know that with certainty? Do we actually?
               | 
               | Because my understanding is that how "thinking" works is
               | actually still a total mystery. How is it we no for
               | certain that the basis for the analog electric-potential-
               | based computing done by neurons is not based on
               | statistical prediction?
               | 
               | Do we have actual evidence of that, or are you just doing
               | "statistical token prediction" yourself?
        
               | cluckindan wrote:
               | Human neurons are not reducible to arithmetic artificial
               | neurons in a statistical model. Do not conflate them.
        
               | jeffhuys wrote:
               | Why not, actually?
        
               | cluckindan wrote:
               | Because we do not have a complete understanding of human
               | neurons. How are we supposed to accurately model
               | something we cannot directly observe?
        
               | TheDong wrote:
               | Do you also complain when someone says "Half-life 2 has
               | great water-physics" with "Don't call it physics, we
               | still don't understand all the physical laws of the
               | universe, and also they use limited-precision floating-
               | point, so it's not water-physics, it's just a bunch of
               | math"?
               | 
               | Like, we've agreed that "water-physics" and "cloth
               | physics" in 3d graphics refers to a mathematical
               | approximation of something we don't actually understand
               | at the subatomic level (are there strings down there? Who
               | knows).
               | 
               | Can "thinking" in AI not refer to this intentionally
               | false imitation that has a similar observable outward
               | effect?
               | 
               | Like, we're okay saying minecraft's water has "water
               | physics", why are we not okay saying "in the AI context,
               | thinking is a term that externally looks a bit like a
               | human thinking, even though at a deeper layer it's
               | unrelated"?
               | 
               | Or is thinking special, is it like "soul" and we must
               | defend the word with our life else we lose our humanity?
               | If I say "that building's been thinking about falling
               | over for 50 years", did I commit a huge faux pas against
               | my humanity?
        
               | cluckindan wrote:
               | That's comparing apples to oranges. Nobody is going to be
               | making a real cruise ship based on game water physics
               | simulations.
               | 
               | In such a task, better water simulations are used. We
               | have those, because we can directly observe the behavior
               | of water under different conditions. It's okay because
               | the people doing it are explicitly aware that they are
               | using simulation.
               | 
               | AI will get used in real decisions affecting other
               | people, and the people doing those decisions will be
               | influenced by the terminology we choose to use.
        
               | autoexec wrote:
               | > Do you also complain when someone says "Half-life 2 has
               | great water-physics"
               | 
               | I would if they said the water in Half-life 2 was great
               | for quenching your thirst or that in the near future
               | everyone will only drink water from Half-life 2 and it
               | will flow from our kitchen taps when it's clear that
               | however good Half-life 2 is at approximating what water
               | looks and acts like it isn't capable of being a beverage
               | and isn't likely to ever become one. Right now there are
               | a lot of people going around saying that what passes for
               | AI these days has the ability to reason and that AGI is
               | right around the corner but that's just as obvious a lie
               | and every bit as unlikely, but the more it gets repeated
               | the more people end up falling for it.
               | 
               | It's frustrating because at some point (if it hasn't
               | happened already) you're going to find yourself feeling
               | very thirsty and be shocked to discover that the only
               | thing you have access to is Half-life 2 water, even
               | though it does nothing for you except make you even more
               | thirsty since it looks close enough to remind you of the
               | real thing. All because some idiot either fell for the
               | hype or saved enough money by not supplying you with real
               | water that they don't care how thirsty that leaves you.
               | 
               | The more companies force the use of flawed and
               | unreasoning AI to do things that require actual reasoning
               | the worse your life is going to get. The constant
               | misrepresentation of AI and what it's capable of is
               | accelerating that outcome.
        
               | inimino wrote:
               | Just because you don't know how does not mean that we
               | can't.
        
               | cluckindan wrote:
               | Prove it, then.
        
               | LordDragonfang wrote:
               | "Thinking" is a term of art referring to the
               | hidden/internal output of "reasoning" models where they
               | output "chain of thought" before giving an answer[1].
               | This technique and name stem from the early observation
               | that LLMs do better when explicitly told to "think step
               | by step"[2]. Hope that helps clarify things for you for
               | future constructive discussion.
               | 
               | [1] https://arxiv.org/html/2410.10630v1
               | 
               | [2] https://arxiv.org/pdf/2205.11916
        
               | bobsomers wrote:
               | We are aware of the term of art.
               | 
               | The point that was trying to be made, which I agree with,
               | is that anthropomorphizing a statistical model isn't
               | actually helpful. It only serves to confuse laypersons
               | into assuming these models are capable of a lot more than
               | they really are.
               | 
               | That's perfect if you're a salesperson trying to dump
               | your bad AI startup onto the public with an IPO, but
               | unhelpful for pretty much any other reason, especially
               | true understanding of what's going on.
        
               | LordDragonfang wrote:
               | If that was their point, it would have been more
               | constructive to actually make it.
               | 
               | To your point, it's only anthropomorphization if you make
               | the anthrocentric assumption that "thinking" refers to
               | something that only humans can do.[1]
               | 
               | And I don't think it confuses laypeople, when literally
               | telling it to "think" achieves the very similar results
               | as in humans - it produces output that someone provided
               | it out-of-context would easily identify as "thinking out
               | loud", and improves the accuracy of results like how...
               | thinking does.
               | 
               | The best mental model of RLHF'd LLMs that I've seen is
               | that they are statistical models "simulating"[1] how a
               | human-like character would respond to a given natural-
               | language input. To calculate the statistically "most
               | likely" answer that an intelligent creature would give to
               | a non-trivial question, with any sort of accuracy, you
               | need emergent effects which look an awful like like a
               | (low fidelity) simulation of intelligence. This includes
               | simulating "thought". (And the distinction between
               | "simulating thinking" and "thinking" is a distinction
               | without a difference given enough accuracy)
               | 
               | I'm curious as to what "capabilities" you think the
               | layperson is misled about, because if anything they tend
               | to exceed layperson understanding IME. And I'm curious
               | what mental model you have of LLMs that provides more
               | "true understanding" of how a statistical model can
               | generate answers that appear nowhere in its training.
               | 
               | [1] It also begs the question of whether there exists a
               | clear and narrow definition of _what "thinking" is_ that
               | everyone can agree on. I suspect if you ask five
               | philosophers you'll get six different answers, as the
               | saying goes.
               | 
               | [2] https://www.astralcodexten.com/p/janus-simulators
        
               | zer00eyz wrote:
               | > It also begs the question of whether there exists a
               | clear and narrow definition of what "thinking" is that
               | everyone can agree on. I suspect if you ask five
               | philosophers you'll get six different answers, as the
               | saying goes.
               | 
               | And yet we added a hand wavy 7th to humanize a peice of
               | technology.
        
               | MindTheAbstract wrote:
               | I know this is the terminology, but I'd argue that the
               | activations are the actual thinking. It's probably too
               | late to change that, but I wish people would refer to
               | thinking as the work Anthropic and Deepmind are doing
               | with their mech interp
        
               | andrepd wrote:
               | It's a misleading "term of art" which is more accurately
               | described as a "term of marketing". Reasoning is
               | precisely what LLMs don't do and it's precisely why they
               | are unsuited to many tasks they are peddled for.
        
               | LordDragonfang wrote:
               | How are you defining "reasoning" such that you are
               | confident that LLMs are definitely not doing it? What
               | evidence do you have to that effect? (And are you certain
               | that none of your reasoning applies to humans as well?)
        
               | cluckindan wrote:
               | They don't "think".
               | 
               | https://arxiv.org/abs/2503.09211
               | 
               | They don't "reason".
               | 
               | https://ml-site.cdn-apple.com/papers/the-illusion-of-
               | thinkin...
               | 
               | They don't even always output their internal state
               | accurately.
               | 
               | https://arxiv.org/abs/2505.05410
        
               | LordDragonfang wrote:
               | > https://arxiv.org/abs/2503.09211
               | 
               | I am thoroughly unimpressed by this paper. It sets up a
               | vague strawman definition of "thinking" that I'm not
               | aware of anyone using (and makes no claim it applies to
               | humans) and then knocks down the strawman.
               | 
               | > https://ml-site.cdn-apple.com/papers/the-illusion-of-
               | thinkin...
               | 
               | This one is more substantial, but:
               | 
               | "While these models demonstrate improved performance on
               | reasoning benchmarks, their fundamental capabilities,
               | scaling properties, and limitations remain insufficiently
               | understood. [...] Through extensive experimentation
               | across diverse puzzles, we show that frontier LRMs face a
               | complete accuracy collapse beyond certain complexities.
               | [...] We found that LRMs have limitations in exact
               | computation: they fail to use explicit algorithms and
               | reason inconsistently across puzzles."
               | 
               | Starts by saying "we actually don't understand them"
               | (meaning we don't know well enough to give a yes or no)
               | and then proceeds to list flaws that, as I keep saying,
               | also can be applied to most (if not all) humans' ability
               | to reason. Human reasoning also collapses in accuracy
               | above a certain complexities, and certainly are observed
               | to fail to use explicit algorithms, as well as reasoning
               | inconsistently across puzzles.
               | 
               | So unless your definition of anthropomorphization
               | excludes most humans, this is far from a slam dunk.
               | 
               | > They don't even always output their internal state
               | accurately.
               | 
               | I have some really bad news about humans for you. I
               | believe (Buddha et al, 500 BCE) is the foundational text
               | on this, but there's been some more recent research
               | (Hume, 1739), (Kierkegaard, 1849)
        
               | boredhedgehog wrote:
               | These kind of comments are the equivalent of going to dog
               | owners' forums, analyzing word choices in every post and
               | warning the dog owners about the dangers of
               | anthropomorphizing their pets, an effort as accurate as
               | it is boorish and ineffectual.
        
               | cluckindan wrote:
               | Dogs will not be quite as widely influencing decisions
               | concerning other people.
        
             | reissbaker wrote:
             | Magistral Small seems wayyy too heavy-handed with its RL to
             | me:
             | 
             |  _\boxed{Hey! How can I help you today?}_
             | 
             | They clearly rewarded the \boxed{...} formatting during
             | their RL training, since it makes it easier to naively
             | extract answers to math problems and thus verify them. But
             | Magistral uses it for pretty much everything, even when
             | it's inappropriate (in my own testing as well).
             | 
             | It also forgets to <think> unless you use their special
             | system prompt reminding it to.
             | 
             | Honestly a little disappointing. It obviously benchmarks
             | well, but it seems a little overcooked on non-benchmark
             | usage.
        
         | trebligdivad wrote:
         | Nice! I'm running on CPU only, so it's interesting to compare -
         | the Magistral-Small-2506_Q8_0.gguf runs at under 2 tokens/s on
         | my 16 core, but your UD-IQ2_XXS gets about 5.5 tokens/s which
         | is fast enough to be useful - but it does hallucinate a bit
         | more and loop a little; but still actually pretty good for
         | something so small.
        
           | danielhanchen wrote:
           | Oh nice! I normally suggest maybe Q4_K_XL to be on the safe
           | side :)
        
       | Oras wrote:
       | Would be interesting to see a comparison with Qwen 32B. I found
       | it a fantastic local model (ollama).
        
         | DSingularity wrote:
         | I agree. Qwen models are great.
        
         | SV_BubbleTime wrote:
         | Last year, fit was important. This year, inference speed is
         | key.
         | 
         | Proofreading an email at four tokens per second, great.
         | 
         | Spending a half hour to deep research some topic with artifacts
         | and MCP tools and reasoning at four tokens per second... a bad
         | time.
        
       | ksec wrote:
       | A few days after Apple's "The illusion of Reasoning". I wonder if
       | this is the same again. Anyone runs Tower of Hanoi?
        
         | barrkel wrote:
         | The Tower of Hanoi problem is limited by context length rather
         | than model intelligence - see
         | https://x.com/scaling01/status/1931783050511126954
        
         | NitpickLawyer wrote:
         | That paper was flawed in many ways, but it had a catchy name so
         | lots of 'fluencers and media pounced on it and slopped some
         | content based on the title alone. Chances are it will be
         | relegated to the blooper section of LLM papers, just like that
         | "training on LLM outputs leads to model collapse" paper was...
        
           | __loam wrote:
           | Sorry this has nothing to do with the point you're making but
           | I've literally never seen anyone use the word 'fluencers in
           | place of influencers lol.
        
             | olddustytrail wrote:
             | Me neither and it's not much shorter. I think fluzies could
             | work better.
        
               | squidsoup wrote:
               | I propose effluencers.
        
         | syntex wrote:
         | The illussion of reasoning was terrible paper. 2^n-1 how it
         | could fit in context size. I tried o3 and he gave me python
         | script saying that inserting all moves is to much for context
         | window. completely different results.
        
           | roboboffin wrote:
           | I think that their point was that the problem is easily
           | solvable by humans without code, and shows the ability to
           | chain steps together to achieve a goal.
        
             | roboboffin wrote:
             | Not sure why I am being downvoted. I am simply saying that
             | we know there is a defined algorithm for solving Tower of
             | Hanoi, and the source code for it is widely available. So,
             | o3 producing the code as an answer, demonstrates even less
             | intelligence, as it means it is either memorized or copied
             | from the internet. I don't see how this point counters the
             | paper at all.
             | 
             | I believe what they are trying to show in that paper, is
             | that as the chain of operations approaches a large amount
             | (their proxy for complexity), an LLM will inevitable fail.
             | Humans don't have infinite context either, but they can
             | still solve the Tower Of Hanoi without need to resort to
             | either pen or paper, or coding.
        
               | syntex wrote:
               | I didn't downvote. T the problem with the paper is that
               | it asks the model to output all moves for, say, 15 disks
               | 2 ^ 15 - 1 = 32767
               | 
               | 32767 moves in a single prompt. That's not testing
               | reasoning. That's testing whether the model can emit a
               | huge structured output without error, under a context
               | window limit.
               | 
               | The authors then treat failure to reproduce this entire
               | sequence as evidence that the model can't reason. But
               | that's like saying a calculator is broken because its
               | printer jammed halfway through printing all prime numbers
               | under 10000.
               | 
               | For me o3 returning Python code isn't a failure. It's a
               | smart shortcut. The failure is in the benchmark design.
               | This benchmark just smells.
        
               | roboboffin wrote:
               | No worries, I wasn't saying to you directly.
               | 
               | I agree 15 disks is very difficult for a human, probably
               | on a sheer stamina level; but I managed to do 8 in about
               | 15 minutes by playing around (I.e. no practice). They do
               | state that there is a massive drop in performance at this
               | point.
        
               | teach wrote:
               | Remember that with Towers of Hanoi every extra disk
               | doubles the number of moves required. So 15 discs is 128x
               | more moves. If you did eight in 15m then fifteen would
               | take you 32 hours.
        
               | daveguy wrote:
               | > That's testing whether the model can emit a huge
               | structured output without error, under a context window
               | limit.
               | 
               | Agreed. But to be fair, 1) a relatively simple algorithm
               | can do it, and more importantly 2) a lot of people are
               | trying to build products around doing exactly this (emit
               | large structured output without error).
        
             | jwitthuhn wrote:
             | Is it easily solvable by humans without code? I suspect if
             | you asked a human to write down all the steps in order to
             | solve a Tower of Hanoi with 12 disks they would also give
             | up before completing it. Writing code that produces the
             | correct output is the only realistic way to solve that
             | purely due to the amount of output required.
        
       | tonyhart7 wrote:
       | a bit too late aren't we??
        
       | pu_pe wrote:
       | Benchmarks suggest this model loses to Deepseek-R1 in every one-
       | shot comparison. Considering they were likely not even pitting it
       | against the newer R1 version (no mention of that in the article)
       | and at more than double the cost, this looks like the best AI
       | company in the EU is struggling to keep up with the state-of-the-
       | art.
        
         | atemerev wrote:
         | "EU is leading in regulation", they say.
         | 
         | I don't know what they are thinking.
        
           | micromacrofoot wrote:
           | probably some silly thing like "people should have more
           | rights and protections"
        
             | atemerev wrote:
             | I've yet to find any rights and protections in these cookie
             | banners.
        
               | saubeidl wrote:
               | The cookie banners are corps trying to circumvent the
               | rights and protections. If they actually went by the
               | spirit of the protections, the cookie banners wouldn't be
               | needed. Your ire is misdirected.
        
               | yeahforsureman wrote:
               | Are you sure?
               | 
               | The ePrivacy Directive requires a (GDPR-level) consent
               | for just placing the cookie, unless it's strictly
               | _necessary_ for the provision of the "service". The way
               | EU regulators interpret this, even web analytics falls
               | outside the necessity exception and therefore requires
               | consent.
               | 
               | So as long as the user doesn't and/or is not able to
               | automatically signal consent (or non-consent) eg via
               | general browser-level settings, how _can_ you obtain it
               | without trying to get it from the user on a per-site
               | basis somehow? (And no, DNT doesn 't help since it's an
               | opt-out, not an opt-in mechanism.)
        
               | exyi wrote:
               | Everyone I know of will try to click "reject all
               | unnecessary cookies", and you don't need the dialog for
               | the necessary ones. You can therefore simply remove the
               | dialog and the tracking, simplifying your code and
               | improving your users' experience. Can tracking the
               | fraction which misclicks even give some useful data?
        
               | yeahforsureman wrote:
               | My point was that according to the current
               | interpretation, if they rely on cookies, user analytics
               | (even simple visitor stats where no personal data is
               | actually processed) are _not_ considered  "necessary" and
               | are therefore not exempt from the cookie consent
               | obligation under the ePrivacy Directive. The reason why
               | personal data processing is irrelevant is that the cookie
               | consent requirement itself is based on the pre-GDPR
               | ePrivacy Directive which requires, as a rule, consent
               | merely for saving cookies on the client device (subject
               | to some exceptions, including the one discussed).
               | 
               | So you need a consent for all but the most crucial
               | cookies without which the site/service wouldn't be able
               | to function, like session cookies for managing signed-in
               | state etc.
               | 
               | (The reason why you started to see consent banners really
               | only after GDPR came to force is at least in part due to
               | the fact that the ePrivacy Directive refers to the Data
               | Protection Directive (DPD) for the _standard_ of consent,
               | and after DPD was replaced by GDPR, the arguably more
               | stringent GDPR consent standard was applied, making it
               | unfeasible to rely on some concept of implied consent or
               | the like.)
        
               | mhitza wrote:
               | User analytics that require cookies, sounds like tracking
               | to me.
               | 
               | > like session cookies for managing signed-in state etc.
               | 
               | Maybe I'm reading it wrong, but are you saying that
               | consent is required for session cookies? Because that is
               | not the case, at all.
               | 
               | > (25) However, such devices, for instance so-called
               | "cookies", can be a legitimate and useful tool, for
               | example, in analysing the effectiveness of website design
               | and advertising, and in verifying the identity of users
               | engaged in on-line transactions. Where such devices, for
               | instance cookies, are intended for a legitimate purpose,
               | such as to facilitate the provision of information
               | society services, their use should be allowed on
               | condition that users are provided with clear and precise
               | information in accordance with Directive 95/46/EC about
               | the purposes of cookies or similar devices so as to
               | ensure that users are made aware of information being
               | placed on the terminal equipment they are using. Users
               | should have the opportunity to refuse to have a cookie or
               | similar device stored on their terminal equipment. This
               | is particularly important where users other than the
               | original user have access to the terminal equipment and
               | thereby to any data containing privacy-sensitive
               | information stored on such equipment. Information and the
               | right to refuse may be offered once for the use of
               | various devices to be installed on the user's terminal
               | equipment during the same connection and also covering
               | any further use that may be made of those devices during
               | subsequent connections. The methods for giving
               | information, offering a right to refuse or requesting
               | consent should be made as user-friendly as possible.
               | Access to specific website content may still be made
               | conditional on the well-informed acceptance of a cookie
               | or similar device, if it is used for a legitimate
               | purpose.
               | 
               | https://eur-lex.europa.eu/eli/dir/2002/58/oj/eng
               | 
               | You should inform users about any private data you would
               | be storing in a cookie. But this can be a small infobox
               | on your page with no button.
               | 
               | When storing other type of information, the "cookie"
               | problem needs to be seen from the perspective of shared
               | devices. You know, the times before, when you might
               | forget to log out at an internet cafe or clear your
               | cookies containing password and other things they
               | shouldn't. This is a dated approach at looking at the
               | problem (most people have their own computing devices
               | today, their phone), but still applicable (classrooms,
               | and family shared devices).
        
               | micromacrofoot wrote:
               | there are analytics providers that don't require third
               | party cookies, it's not hard to switch
        
               | yeahforsureman wrote:
               | The cookie consent provision under the ePrivacy Directive
               | doesn't care whether they're first- or third-party.
               | Actually, the way it's been worded, you'd arguably need a
               | consent for (strictly non-"necessary") use of eg local
               | storage, too -- afaik this hasn't really come up in
               | regulatory practice or case law, but may be more due to
               | regulators' modest technical expertise or priorities.
               | 
               | A conceptually different matter altogether is consent
               | (possibly) needed under _GDPR_ for various kinds of
               | _personal data processing_ involving the use of cookies
               | (ie not just the placement of cookies as such) _and_
               | other technologies for tracking, targeting and the like.
               | That 's why you see cookie banners with detailed purposes
               | and eg massive lists of vendors (since they can be
               | considered "recipients" of the user's personal data under
               | GDPR). In this context, a valid consent (and the
               | information you have to provide to obtain it) is required
               | (at least) when consent is the only feasible _legal
               | basis_ of the ones available under Art 6 GDPR for the
               | personal data _processing activities_ in question. This
               | is where the national regulators have taken strict
               | stances especially regarding ad targeting and other
               | activities usually involving cross-site tracking, for
               | example, deeming that the only feasible basis for those
               | activities would be consent (ie  "opt-in") -- instead of,
               | in particular, "legitimate interests" which would enable
               | opt-out-like mechanisms instead. _This_ is the legal
               | context of looking critically at 3rd-party cookies, but
               | unfortunately, for the reasons mentioned above, getting
               | rid of such cookies might still not be enough to avoid
               | the minimal base cookie consent requirement when you use
               | eg analytics... :(
               | 
               | It's pretty ridiculous, I know, and it's a bummer they
               | scrapped the long-planned and -negotiated ePrivacy
               | _Regulation_ which was meant to replace the old ePrivacy
               | _Directive_ and, among other things, update the weird old
               | cookie consent provision.
        
               | saubeidl wrote:
               | As you said yourself, analytics are not _necessary_.
               | 
               | It's corpos trying to invade our privacy.
        
               | micromacrofoot wrote:
               | cookie banners are malicious compliance while we head
               | towards the death of cross-site cookies, they are indeed
               | a poor implementation but the legislation that lead to
               | them did not come up with it
               | 
               | did you really prefer when companies were selling your
               | data to third parties and didn't have to ask you?
        
               | sunaookami wrote:
               | Do you really think clicking "Reject non-essential
               | cookies" does something?
        
               | micromacrofoot wrote:
               | show me a single example that doesn't
        
             | __alexs wrote:
             | EU regulation is often "you can not have the cool thing"
             | not "the cool thing must be operated equitably".
             | 
             | I think they are more interested in protecting old money
             | than in protecting people.
        
               | saubeidl wrote:
               | Can you name specific examples? Otherwise, this just
               | sounds like inflammatory polemic.
        
               | micromacrofoot wrote:
               | I think usb-c and third party app stores are pretty cool
        
               | umbra07 wrote:
               | I think the government shouldn't be legislating that
               | companies must use a specific USB connector.
               | 
               | Realistically the legislation was only targeting Apple.
               | If consumers want USB-C, then they can vote with their
               | wallets and buy an Android, which is a reasonable
               | alternative.
        
               | micromacrofoot wrote:
               | We've had multiple USB standards for decades with no end
               | in sight. Apple was targeted because they have the most
               | high-profile proprietary connector and they were
               | generally using it to screw consumers. Good riddance.
        
               | umbra07 wrote:
               | Like I said, if consumers don't want it, then they can
               | buy Android phones instead.
               | 
               | > they were generally using it to screw consumers
               | 
               | You understand that there were lots of people happy with
               | Lightning? USB-C is a regression in many ways.
        
               | boroboro4 wrote:
               | I want to have USB-C and I want to have iPhone.
               | 
               | I'm very happy EU regulators took this headache off my
               | shoulders and I don't need to keep multiple chargers at
               | home, and can be almost certain I can find a charger in
               | restaurant if I need it.
               | 
               | Based on the reaction of my friends 90% of people
               | supported this change and were very enthusiastic about
               | it.
               | 
               | I have zero interest in being part of vendor game to lock
               | me in.
        
               | umbra07 wrote:
               | Products are supposed to come with different tradeoffs. I
               | want to have an Android and I want to have my headphone
               | jack back. That doesn't mean that the EU should make that
               | a law.
               | 
               | > Based on the reaction of my friends 90% of people
               | supported this change and were very enthusiastic about
               | it.
               | 
               | That is an absolutely worthless metric, and you know it.
        
               | Aeolos wrote:
               | It's about as useful as your complaining.
               | 
               | Good riddance for Lightning.
        
               | micromacrofoot wrote:
               | Why bother arguing the point if you're not going to
               | provide a single example.
        
               | flmontpetit wrote:
               | It's hard to see the benefit in letting every hardware
               | manufacturer attempt to carve out their own little
               | artificial interconnect monopoly and flood the market
               | with redundant, wasteful solutions.
        
               | msgodel wrote:
               | They shouldn't be forcing people to use patented Qualcomm
               | technology to access cellular networks either but here we
               | are.
               | 
               | Realistically Apple's connector adds no value and if they
               | want to sell into markets like the EU they need to cut
               | that kind of thing out.
        
               | umbra07 wrote:
               | > Realistically Apple's connector adds no value
               | 
               | Like I said, usb-c is a regression from lightning in
               | multiple ways.
               | 
               | * Lightning is easier to plug in.
               | 
               | * Lightning is a physically smaller connector.
               | 
               | * USB-C is a much more mechanically complex port. Instead
               | of a boss in a slot, you have a boss with a slot plugging
               | into a slot in a boss.
               | 
               | There was so much buzz around Apple no longer including a
               | wall wort with its phones, which meant an added cost for
               | the consumer, and potentially an increased environmental
               | impact if enough people were going to say, order a wall
               | wort online and shipped to them. The same logic applies
               | to Apple forced to switch to USB, except that the costs
               | are now multiplied.
        
               | micromacrofoot wrote:
               | I've worked with thousands of both types of cable at this
               | point
               | 
               | > Lightning is easier to plug in.
               | 
               | according to you? neither are at all difficult
               | 
               | > Lightning is a physically smaller connector.
               | 
               | I've had lightning cables physically disassemble in the
               | port, the size also made them somewhat delicate
               | 
               | > USB-C is a much more mechanically complex port.
               | 
               |  _much_ is a bit well, much... they 're both incredibly
               | simple mechanically -- the exposed contacts made
               | lightning more prone to damage
               | 
               | I've had multiple Apple devices fail because of port wear
               | on the device. Haven't encountered this yet with usb-c
               | 
               | > The same logic applies to Apple forced to switch to
               | USB, except that the costs are now multiplied.
               | 
               | Apple would have updated inevitably, as they did in the
               | past -- now at least they're on a standard... the long-
               | term waste reduction is very likely worth the switch
               | (because again, without the standard they'd have likely
               | switched to another proprietary implementation)
        
               | fkyoureadthedoc wrote:
               | Having owned both lighting and USB-C iPhones/iPads, I
               | prefer the USB-C experience, but neither were that bad.
               | 
               | My personal biggest gripe with lightning was that the
               | spring contacts were in the port instead of the cable,
               | and when they wore out you had to replace the phone
               | instead of the cable. The lightning port was not
               | replaceable. In practice I may end up breaking more USB-C
               | ports, we'll see.
        
               | vintermann wrote:
               | It used to be the case in Europe that you couldn't use a
               | washing machine made for Sweden in Norway. Everything was
               | different. Every country had its own standards too, which
               | had to certify your products. It was openly for
               | protectionistic reasons.
               | 
               | EU got rid of that. It only makes sense that they don't
               | let private companies start all that crap up again. If
               | states don't get to use artificial technological barriers
               | as protectionism, certainly Apple shouldn't be allowed to
               | either.
        
               | andruby wrote:
               | EU never just states "you can not have the cool thing".
               | Please provide an example if you disagree.
               | 
               | It is very hard to create policies and legislation that
               | protects consumers, workers and privacy while also giving
               | enough liberties for innovation. These are difficult but
               | important trade-offs.
               | 
               | I'm glad there is diversity in cultures and values
               | between the US, EU and Asia.
        
             | bobxmax wrote:
             | Rights and protections that have benefited heavily from an
             | economy built on the alliance with the US.
             | 
             | If it weren't for American help and trade post-WW2, Europe
             | would be a Belarusian backwater and is fast heading back in
             | that direction.
             | 
             | Countries like Greece, Italy, Spain, Portugal, etc. show
             | the future of Europe as it slowly stagnates and becomes a
             | museum that can't feed it's people.
             | 
             | Even Germany that was once excelling is now collapsing
             | economically.
             | 
             | The only bright spot on the continent right now is Poland
             | who are, shocker, much less regulatorily strict and have
             | lower corporate taxes.
        
               | debugnik wrote:
               | > Countries like Greece, Italy, Spain, Portugal
               | 
               | PIGS, really? Some of the top growing EU economies right
               | now, which have turned their deficit around, show the
               | future of a slowly stagnating Europe?
        
               | bobxmax wrote:
               | A 200B economy growing 2% is the future of the EU? Yes
               | that is the point I am making.
        
           | dmos62 wrote:
           | It is fairly common to struggle to understand why different
           | cultures think the way they do.
        
             | moralestapia wrote:
             | Ugh.
             | 
             | Edit: Parent changed their comment significantly, from
             | something quite unpleasant to what it is now. I'm not
             | deleting my comment as I'm not that kind of person.
        
               | dmos62 wrote:
               | I did. I initially said that Europeans often struggle to
               | understand other cultures too. Which was an immature way
               | to point out that the cultural dissonance works both
               | ways. I realized that I was obfuscating my point and
               | rewrote my comment to be clearer, but now that you gave
               | me a chance to think on it some more, I wish I would have
               | said what I wanted to say more directly still.
               | 
               | What I wanted to say is: I like EU's regulation and I
               | find it interesting how other people have different world
               | views.
        
             | atemerev wrote:
             | I live in Europe.
        
               | mrtksn wrote:
               | Cool, which regulations exactly stopped you from doing
               | cutting edge AI?
        
               | kelseyfrog wrote:
               | Decret sur la Pause Gouter Universelle (PGU).
        
               | philjohn wrote:
               | Is that the regulation that says you need to allow
               | someone to take a 20 minute break after 6 hours of work?
        
               | FabHK wrote:
               | Chinese Employers to Grant 15 Minute Maternity Break
               | 
               | https://theonion.com/chinese-employers-to-
               | grant-15-minute-ma...
        
               | meta_ai_x wrote:
               | regulation-culture breed a certain type of risk-taking
               | culture. So, you can't blame a specific regulation for
               | lack of innovation culture
        
               | mrtksn wrote:
               | Im not sure about that, Europe has plenty of starups.
               | Also, IIRC it has larger number of small businesses than
               | US as in US huge companies employ huge numbers of people.
               | 
               | What Europe does not have is scale ups in tech. The tech
               | consolidated in US. By tech I mean internet based
               | companies. Remove those and EU has higher productivity.
        
           | cpldcpu wrote:
           | Sorry, this is just getting old...
           | 
           | Its a trite talking point and not the reason why there are so
           | few consumer-AI companies in Europe.
        
             | atemerev wrote:
             | And what would be the reason? I am genuinely interested.
             | Also, are there viable not "consumer" AI companies here?
             | Only Mistral seems to train foundation models, and good for
             | them, however, as of now they are absolutely not SOTA.
        
               | baq wrote:
               | Money.
               | 
               | No, really - EU doesn't have the VCs and the megacorps.
               | People laugh at EU sponsoring projects, but there is no
               | private money to sponsor them. There are plenty of US
               | companies with sites in the EU though, so you have people
               | working the problems, but no branding.
        
               | SV_BubbleTime wrote:
               | Ok, just a quick question... why does Europe not have the
               | money actual/people?
        
               | baq wrote:
               | edit: the parent has since edited out the flamebait.
               | 
               | Maybe, or maybe when silicon valley was busy growing
               | exponentially Europe was still picking itself up from the
               | mess of ww2.
               | 
               | Trying to blame a single reason is futile, naive and
               | childish.
        
               | oceanplexian wrote:
               | The US was out-innovating Europe a long time before WW2,
               | we had faster, more extensive rail systems, superior high
               | rise construction, earlier to electrification, invention
               | of the telephone, modern manufacturing (Model T),
               | invention of the airplane, the birth of Hollywood and
               | modern motion pictures, the list goes on.
        
               | msgodel wrote:
               | I think it's funny how the US, Canada, and Scotland/the
               | UK all simultaneously claim to be the home of the
               | telephone.
        
               | bobxmax wrote:
               | And what's the excuse for Euro's GDP being equal to the
               | US in 2007, and now being over $10T less?
        
               | baq wrote:
               | In general, the same. In particular, different.
        
               | fmbb wrote:
               | Quick questions don't always have quick answers.
               | 
               | Moneywise, the US does have the good old Exorbitant
               | Privilege to lean on.
        
               | hshdhdhj4444 wrote:
               | Part of the answer is debt.
               | 
               | The U.S. has a debt of 35Tn. The entire EU around 16Tn.
               | 
               | If even 10% of the debt difference was invested in tech
               | that would have meant about $2tn more in investment in EU
               | tech.
        
               | bobxmax wrote:
               | Because Europeans don't take smart risks. Because they
               | over regulate.
               | 
               | It's fascinating watching people circle back to this
               | answer.
               | 
               | Regulation and taxation reduces incentives. Lower
               | incentives, means lower risk-taking.
               | 
               | The fact this is still a lesson that needs to be debated
               | is absurd.
        
               | baq wrote:
               | Europeans also mostly don't suffer from school shootings
               | and generally don't go bankrupt when they get cancer or
               | just take an ambulance ride to a non-network hospital.
               | Regulation is not all bad, besides the US has more of it
               | than anybody else.
        
               | bobxmax wrote:
               | The vast majority of Americans don't do either of those
               | things either.
               | 
               | And given what happened in Austria just a few hours back,
               | not the best time for your comment.
        
               | camjw wrote:
               | There have been 11 mass shootings in the US in the last 7
               | days so I don't think this disgusting competition is one
               | you're likely to win.
        
               | bobxmax wrote:
               | Nobody is claiming the US has less mass shootings. It's
               | just pointless whataboutism in a conversation (economic
               | strategy) that has nothing to do with it.
        
               | camjw wrote:
               | Ah good, I thought you were trying to imply there is an
               | equivalent problem in the EU. Which would seem to be
               | intentionally dense of course.
        
               | baq wrote:
               | Regulation was the point discussed, healthcare and gun
               | controls are two examples where there are massive
               | qualitative and quantitative differences in regulation
               | between EU and USA. E.g. healthcare is a matter of
               | national security in the EU and it's a profit center for
               | pension funds in the USA. Gun controls I'm not too
               | familiar with, I can only see second order effects in the
               | US in the form of an arms race between police and
               | citizens.
        
               | bobxmax wrote:
               | No, ECONOMIC regulation was the point discussed. That has
               | zilch to do with something like gun control.
        
               | TulliusCicero wrote:
               | The mental gymnastics here are incredible. Do you really
               | think the regulations inhibiting tech startup creation
               | are the same ones that protect people when they get
               | cancer or whatever?
               | 
               | Yes, the US has a lot of school shootings, but does
               | anyone think loose gun regulations are why the US is
               | strong on tech?
        
               | bobxmax wrote:
               | Any time European economic failings are brought up it's
               | always the same thing. "Well at least no school
               | shootings!"
               | 
               | Great, Singapore has less school shootings and homeless
               | people than anywhere in Europe by a country mile and has
               | a soaring economy.
        
               | FabHK wrote:
               | Eh, Singapore's efforts to nurture a thriving startup
               | scene are met with middling success at most.
        
               | SV_BubbleTime wrote:
               | Are you implying that Singapore is not ultra regulated?
               | 
               | They make Europe look like Texas.
        
               | FabHK wrote:
               | No, you're right, Singapore is both highly regulated and
               | successful. I just meant to highlight that the soaring
               | economy doesn't include many high-tech startups.
        
               | bobxmax wrote:
               | Agreed, but Singapore has only 5 million people which
               | limits their potential in that regard.
        
               | camjw wrote:
               | I would love to know what you do for a living and whether
               | you personally have taken any smart risks that have lead
               | you to financial success, or whether you just like
               | sniping on HN about school shootings and pretending to be
               | superior.
        
               | stefan_ wrote:
               | Thats hardly unique to Europeans. Look at UAV regulations
               | in the US - regulated to death based on nothing, leading
               | to a 5 to 10 year technology gap to China, while
               | recreational pilots crash and burn every other week.
        
               | cdblades wrote:
               | > Because Europeans don't take smart risks. Because they
               | over regulate.
               | 
               | If you said you can look at the state of VC funding in
               | the US and call it anything approximating "smart risks" I
               | don't know that I'd believe you.
        
               | bobxmax wrote:
               | No good VC investment looked like a "smart riks" to
               | normies when it happened.
        
               | atemerev wrote:
               | The amount of debt you are allowed to take and the
               | abundance of money to invest in new projects are in
               | direct proportion to the competitiveness of the
               | jurisdiction, i.e. business-friendly environment.
               | 
               | EU is not a business-friendly environment.
        
               | kilpikaarna wrote:
               | Most recently, due to ordoliberalism and coat-according-
               | to-cloth morality guiding economic policy rather than
               | money printer go brrr.
               | 
               | Longer term: cultural and language divisions despite
               | attempts at creating a common market, not running the
               | global reserve currency/military hegemony, social
               | democracies encouraging work-life balance over cutthroat
               | careerism, demographic issues, not getting a boost from
               | being the only consumer economy not to be leveled in WW2,
               | etc.
        
               | PeterStuer wrote:
               | Unlike the US, the EU does not have reserve currency
               | privilige, so we can't print enless trillions of paper
               | and force the rest of the world to give us their
               | companies and goods in return for it.
        
               | whodidntante wrote:
               | I can only talk about my personal (US based) experience.
               | This includes many US based startups,some VC startups,
               | senior leadership in a large tech company, and a senior
               | executive position in another large tech company. I have
               | also worked with, and built, tech organizations in
               | multiple EU countries, and have been involved in the
               | technical due diligence and acquisition discussions with
               | several EU companies. I admit that my experience is about
               | 6 years old, as I am no longer in the tech industry, and
               | I do not know what has changed during this time.
               | 
               | Money: There is more money for US startups. Investors (US
               | and EU) want to invest in US based startups, not EU
               | startups. US investors are willing to risk more money and
               | take greater risk. EU startups that gain traction will
               | attract US companies in that they provide a good way to
               | extend their market to the EU, not as much for their
               | innovations. Tech entrepreneurs (US or EU) want to work
               | in the US if they can, because that is where the
               | excitement and risk taking is and where the money can be
               | made.
               | 
               | Teams: Building and managing EU tech teams is very
               | different than US tech teams. EU teams need a lot more
               | emotional hand holding, and EU engineers are far more
               | salary oriented than equity oriented. It is far more
               | difficult to motivate them to go above and beyond - the
               | "we need to get this fix or feature in tonight so we can
               | deploy n the morning" simply will not get done if it is
               | already 5pm. Firing EU workers is much more difficult.
               | There are a lot more regulations for EU teams, in order
               | to "protect" them, and that results in the teams being
               | more "lifestyle" teams rather than "innovation teams". EU
               | teams get paid a lot less than their US counterparts.
               | 
               | Failure: Good failure is not a problem in the US, it can
               | actually be a badge of honor. EU is very risk averse, and
               | people avoid failure.
               | 
               | There are of course exceptions all around, but the weight
               | of these observations and experiences are in favor of US
               | teams.
               | 
               | This is in no way saying it is better to live in the US,
               | there are a lot of things about the EU that are more
               | attractive than the US, and I would probably have a
               | better lifestyle living in Europe now that I am no longer
               | working. But innovation and money is not one of them.
        
           | 0xDEAFBEAD wrote:
           | Honestly the US approach to AI is incredibly irresponsible.
           | As an American, I'm glad that someone somewhere is thinking
           | about regulation. Not sure it will be enough though:
           | https://xcancel.com/ESYudkowsky/status/1922710969785917691#m
        
             | MoonGhost wrote:
             | No, thanks, we don't want to be like EU. Everything
             | regulated to death. They even thought to criminalize street
             | photography because there could be copyrighted materials in
             | the picture. Not sure, are they still taxing Eiffel tower
             | images?
        
               | johnisgood wrote:
               | I thought it is happening in the US, too. I mean, the
               | Government is there to regulate the shit out of
               | everything. Regardless of where you are.
        
               | int_19h wrote:
               | EU is not a monolithic entity, and amount of regulation
               | varies widely. Baltics are very business friendly, for
               | example.
        
               | bobxmax wrote:
               | And Estonia has the most impressive tech ecosystem on the
               | continent while being a soviet backwater 20 years ago.
               | Shocking how that works.
        
             | msgodel wrote:
             | There's nothing the regulation could meaningfully hope to
             | accomplish other than slow down people willing to play by
             | the rules.
        
               | ambicapter wrote:
               | Wow, the "criminals don't follow laws therefore laws are
               | worthless" argument, here? In my HN?
        
               | msgodel wrote:
               | Usually it's possible to actually detect crime (in fact
               | it's usually hard to ignore.) That's not the case with
               | AI.
        
           | Mistletoe wrote:
           | This is why I want to move to the EU. I don't care if
           | companies aren't coddled there. I want to live where people
           | are the first priority.
        
             | atemerev wrote:
             | Well, are you ready to live on a low middle class salary of
             | a European software engineer? It is really low middle
             | class. The middle middle here would be a bank clerk, and
             | upper middle -- a lawyer or a surgeon.
             | 
             | This is not coincidental.
        
               | baq wrote:
               | Incidentally (also not) surgeons and lawyers are not poor
               | in the states either... it's just Silicon Valley was the
               | perfect place with just the right people and it kept
               | growing for 60 years straight. Surgery and law do not
               | grow exponentially. (I'll pretend the pages of regulation
               | aren't supposed to count.)
        
         | mrtksn wrote:
         | Europe isn't going to catch up in tech as long as its market is
         | open to US tech giants. Tech doesn't have marginal costs, so
         | you want to have one of it in one place and sell it everywhere
         | and when the infra and talent is already in US, EU tech is
         | destined to do niche products.
         | 
         | UK has a bit of it, France has some and that's it. The only
         | viable alternatives are countries who have issues with US and
         | that is China and Russia. China have come up with strong
         | competitors and it is on cutting edge.
         | 
         | Also, it doesn't have anything to do with regulations. 50 US
         | States have the American regulations, its all happening in 1
         | and some other states happen to host some infrastructure but
         | that's true for rest of of the world too.
         | 
         | If the EU/US relationship gets to Trump/Musk level, then EU can
         | have the cutting edge stuff.
         | 
         | Most influential AI researchers are from Europe(inc. UK),
         | Israel and Canada anyway. Ilya Sutskever just the other day
         | gave speech at his alma matter @Canada for example. Andrej
         | Karpathy is Slovakian. Lot's of Brits, French, Polish, Chinese,
         | German etc. are among the pioneers. Significant portion of the
         | talent is non-American already, they just need a reason to be
         | somewhere else than US to have it outside the US. Chinese got
         | their reason and with the state of the affairs in the world I
         | wouldn't be surprised if Europeans gets theirs in less than 3
         | and a half years.
        
           | vikramkr wrote:
           | If you close off the market to US tech giants, maybe they'll
           | have some amount of market dominance at home, but I would
           | doubt that would mean they've "caught up" tech wise. There
           | would be no incentive to compete. American EV manufacturing
           | is pretty far behind Chinese EV manufacturing, protectionism
           | didn't help make a competitive car, it just protected the
           | home market while slowly ceding international market after
           | international market
        
             | saubeidl wrote:
             | As a counterexample, China's tech industry has caught up
             | and in some ways surpassed the US, partially due to being
             | closed off.
        
               | hshdhdhj4444 wrote:
               | But also due to the U.S. driving away smart people from
               | the U.S. to China.
        
               | csomar wrote:
               | > As a counterexample, China's tech industry has caught
               | up and in some ways surpassed the US, partially due to
               | being closed off.
               | 
               | How did you come up to that conclusion? We don't have
               | access to an alternate universe where the Chinese tech
               | market was open. There is a real possibility that it
               | would have been far ahead had it been open.
        
               | yorwba wrote:
               | We do have access to records from the before times when
               | the internet was wide open and Facebook, Google and
               | Microsoft were big in China. Well, Microsoft is still big
               | because they're not an internet company and unfazed by
               | censorship, but the exit of Google and Facebook took a
               | lot of pressure off Baidu and the entire Chinese social
               | media ecosystem.
        
               | olalonde wrote:
               | Facebook and Google were never big in China, not even
               | close.
        
               | yorwba wrote:
               | Google had 31% market share in 2010
               | http://news.bbc.co.uk/2/hi/business/8455712.stm I haven't
               | been able to find numbers for Facebook.
        
               | olalonde wrote:
               | Don't have a source either but I was living in China back
               | then and basically no one was using it. It was QQ and
               | Renren.
        
               | mitthrowaway2 wrote:
               | I think there's a few more important reasons beyond being
               | closed off:
               | 
               | - Regulatory friendliness (eg. DJI)
               | 
               | - Non-enforcement of foreign patents (eg. LiFePO4
               | batteries)
               | 
               | - Technology transfer through partnerships with domestic
               | firms
               | 
               | - Government support for industries deemed to be in the
               | national interest
        
             | mrtksn wrote:
             | I agree, protectionism is bad most of the time but it has
             | its place. It is bad when you are ahead, it is useful when
             | you are behind(You want them to be exposed to the cutting
             | edge market but before that you want them to be able to
             | exist in first place even if they are not the best at this
             | very moment).
             | 
             | China's EV dominance is a result of local governments
             | investing and buying from local businesses.
             | 
             | It would be the same with Russia&China. They will receive
             | money from the governments and will sell to local buyers
             | and will aim to expand to foreign markets.
             | 
             | As I said, most AI talent is not American but it is
             | concentrated there. Give them a reason to be somewhere
             | else, some will be somewhere else.
        
             | littlestymaar wrote:
             | > There would be no incentive to compete.
             | 
             | Why not ? First of all there would be plenty of incentives
             | for EU companies to compete with one another (and plenty of
             | capital flowing to them as the European market is big
             | enough), then there would be competition with US actors in
             | the rest of the world. That's exactly how the Asian
             | economic model has been built: Japan, Taiwan, South Korea
             | all have used protectionism + export-based subsidies to
             | create market leaders in all kind of domains (from car
             | manufacturing to electronics and shipbuilding).
        
             | chairmansteve wrote:
             | China is an example of protectionism working. The world is
             | not governed by simple rules.
        
             | foolswisdom wrote:
             | The solution to that would be to force companies within the
             | EU market to compete with each other (fair competition
             | laws), just that idea is less popular than the first winner
             | in a market ensuring they stay dominant (because it serves
             | the interest of those who just got power). Same reason why
             | big tech rules EU in the first place.
        
           | iwontberude wrote:
           | Which Trump/Musk level? There have been so many.
        
           | Iulioh wrote:
           | The problem is, CONSUMER level tech
           | 
           | The EU is doing a lot of enterprise level shit and it's great
           | 
           | The biggest company in Europe sells B2B software (SAP)
        
             | mrtksn wrote:
             | One swallow does not make a summer, all the major platforms
             | are American and that's where Europe lags. I agree that
             | Europe does have some great tech but they are all niche.
             | Europe also have some great consumer tech products but they
             | are all dependent on American platforms. For example some
             | of the best games are French, Polish, Bulgarian, Ukrainian
             | etc. but they all depend on Steam or Apple App Store and
             | have to go by their rules and pay them a significant
             | commission.
        
             | csomar wrote:
             | That's a single company and I'd not call that great.
        
             | PeterStuer wrote:
             | SAP sells B2B software, but most of their income is from
             | consultancy and training.
        
           | ascorbic wrote:
           | It's mostly about money. DeepMind was founded in the UK, and
           | is still based in London, but there was no way it could get
           | the funding it needed without selling to Google or some other
           | US company. China is one of the few other countries that can
           | afford to fund that kind of thing.
        
           | simianwords wrote:
           | How can you explain Israel?
        
         | funnym0nk3y wrote:
         | Thought so too. I don't know how it could be different though.
         | They are competing against behemoths like OpenAI or Google, but
         | have only 200 people. Even Anthropic has over 1000 people.
         | DeepSeek has less than 200 people so the comparison seems fair.
        
           | rsanek wrote:
           | any claim from the deepseek folks should be considered with
           | wide margins of error.
        
             | humpty-d wrote:
             | I know we distrust them on account of being nefarious
             | Chinese, but has anything come to light with R1 or the
             | people behind it specifically to justify this?
        
               | mwigdahl wrote:
               | "Deepseek only cost $6 million"?
        
               | baq wrote:
               | "* we only tallied the electricity and rent"
        
               | cdblades wrote:
               | There's no way to know who's funding it (but being at
               | least state subsidized is highly likely), and you we
               | don't really know how much it cost (but in any case it's
               | still less than OpenAI is spending).
               | 
               | On the other hand I'm aware of no credible accusations of
               | deepseek fudging benchmarks whereas OpenAI has had
               | multiple instances of independent parties not being able
               | to replicate their claimed performances on benchmarks
               | (and not being honest and transparent about their
               | benchmarking).
        
         | jasonthorsness wrote:
         | Even if it isn't as capable, having a model with control over
         | training is probably strategically important for every major
         | region of the world. But it could only fall so far behind
         | before it effectively doesn't work in the eyes of the users.
        
         | melicerte wrote:
         | If you look at Mistral investors[0], you will quickly
         | understand that Mistral is far from being European. My
         | understanding is it is mainly owned by US companies with a few
         | other companies from EU and other places in the world.
         | 
         | [0] https://tracxn.com/d/companies/mistral-
         | ai/__SLZq7rzxLYqqA97j... (edited for typo)
        
           | pdabbadabba wrote:
           | For the purposes of GP's comment, I think the nationalities
           | of the people actually running the company and doing the work
           | are more relevant than who has invested.
        
             | derektank wrote:
             | And, perhaps most relevantly, the regulatory environment
             | the people are working in. French people working in America
             | are probably more productive than French people working in
             | France (if for no other reason because they probably work
             | more hours in America than France).
        
               | 8n4vidtmkvmk wrote:
               | Are we sure more time butt in office equates to more
               | productivity?
        
               | meta_ai_x wrote:
               | Yes, especially in cutting edge research areas where
               | other high functioning people with high energy isarelso
               | there.
               | 
               | You can write your in-house CRUD app in your basement or
               | your office and it doesn't matter.
               | 
               | The vast majority of HN crowd and general
               | social/mainstream media don't make the difference between
               | these two scenarios
        
               | 1propionyl wrote:
               | Yes, specifically when it comes to open-ended research or
               | development, collocation is non-negotiable. There are
               | greater than linear benefits in creativity of approach,
               | agility in adapting to new intermediate discoveries, etc
               | that you get by putting a number of talented people who
               | get along in the same space who form a community of
               | practice.
               | 
               | Remote work and flattening communication down to what
               | digital media (Slack, Zoom, etc) afford strangle the
               | beneficial network effects.
        
               | throwaway0123_5 wrote:
               | I think they were talking about total time spent working
               | rather than remote vs. in-person. I've seen more than a
               | few studies over the years showing that going from 40 to
               | 35 or 30 hours/wk has minimal or positive impacts on
               | productivity. Idk if that would apply to all work
               | environments though, and I don't recall any of the
               | studies being about research productivity specifically.
        
               | hdjrudni wrote:
               | > I think they were talking about total time spent
               | working rather than remote vs. in-person.
               | 
               | I was, yes. I should have omitted the "in office" part
               | but I was referencing the "work more hours in America
               | than France"
        
               | distortionfield wrote:
               | You're being downvoted but you're right. The number of
               | people who act like a web cam reproduces the in person
               | experience perfectly, for good and bad, is hilarious to
               | me.
        
               | alienbaby wrote:
               | I think the mistake people make is believing that one
               | approach is best for all. Diffferent people work most
               | effectively in different ways.
        
               | numpad0 wrote:
               | I think maybe we should completely switch to admitting
               | this. Every extra second you sit in the (home)office adds
               | to productivity, just not necessarily converting into
               | market values, that can be inflated with hype. Also
               | longer hours is not necessarily safe or sustainable.
               | 
               | We only wish more time != more productivity because it's
               | inconvenient in multiple ways if it were. We imagine a
               | multiplier in there to balance the equation, such factor
               | that can completely negate production, using mere
               | anecdotal experiences as proofs.
               | 
               | Maybe that's not scientific, maybe time spent very
               | closely match productivity, and maybe production as well
               | as productivity need external, artificial regulations.
        
               | mschild wrote:
               | > Every extra second you sit in the (home)office adds to
               | productivity
               | 
               | I'm not sure I believe that. I think at some point the
               | additional hours worked will ultimately decrease the
               | output/unit of time and at some point that you'll reach a
               | peak whereafter every hour worked extra will lead to an
               | overall productivity loss.
               | 
               | Its also something that I think is extremely hard to
               | consistently measure, especially for your typical office
               | worker.
        
               | maigret wrote:
               | Here you go https://cs.stanford.edu/people/eroberts/cs181
               | /projects/crunc...
        
               | adventured wrote:
               | $89,000 GDP per capita vs $46,000 rather proves the point
               | about productivity per butt. US office workers are
               | extraordinarily productive in terms of what their work
               | generates (thanks to numerous well understood things like
               | the outsized US scaling abilities). Measuring beyond that
               | is very difficult due to the variance of every business.
        
               | cataphract wrote:
               | A part of that figure is an artifact of how strong the
               | dollar is though.
        
               | palata wrote:
               | > $89,000 GDP per capita vs $46,000 rather proves the
               | point about productivity per butt.
               | 
               | So if I work 24h/day in a farm in Afghanistan, I should
               | earn more than software developers in the Silicon Valley
               | (because I'm pretty sure that they sleep)? Is that how
               | you say GDP works?
        
               | ath92 wrote:
               | Weird take. Norway has about the same gdp per capita as
               | the USA with stricter regulations than France. Ireland's
               | GDP per capita is higher than that of the USA, with less
               | bureaucracy than France but more than the US. Not to
               | mention that all of these are before adjusting for PPP.
               | Almost as if GDP per capita is not a good measurement of
               | productivity.
        
               | FabHK wrote:
               | Many wrinkles here.
               | 
               | First, one should probably look at GNP (or even GNI)
               | rather than GDP to reduce the distortionary impact of
               | foreign direct investment, company headquarters for tax
               | reasons, etc.
               | 
               | Next, need to distinguish between market rate and PPP, as
               | you highlight.
               | 
               | Lastly, these are all measures of output (per capita),
               | while productivity is output per input, in this context
               | output per hour worked. There the differences are less
               | pronounced.
        
               | HPsquared wrote:
               | Monaco is the most productive country in the world in
               | nominal GDP per capita. A very industrious place, it
               | seems!
        
               | FabHK wrote:
               | > Are we sure more time butt in office equates to more
               | productivity?
               | 
               | Typically more output, but less productivity (=
               | output/time).
        
               | vasco wrote:
               | Most measures of productivity have "hours worked" in the
               | denominator so that can't be right.
        
               | underdeserver wrote:
               | If I work 1000 hours and you work 2000 hours in the same
               | timeframe, but you outcompeted me and created 3x value,
               | you are 1.5 times more productive.
               | 
               | There's a numerator too.
        
               | vasco wrote:
               | How does the same exact person get more productive? You
               | forgot the example I replied to? The only thing that
               | changed were hours worked. In your example you change it
               | to less hours worked with more output. You made it
               | circular.
        
               | underdeserver wrote:
               | You can be more productive just because you're faster.
               | 
               | Magistral is amazingly impressive compared to ChatGPT
               | 3.5. If it had come out two years ago we'd be saying
               | Mistral is the clear leader. But it came out now.
               | 
               | Not saying they worked fewer hours, just that speed
               | matters, and in some cases, up to a limit, working more
               | hours gets your work done faster.
        
               | whiplash451 wrote:
               | > they probably work more hours in America than France
               | 
               | Not sure that's even true. Mistral is known to be a
               | _really_ hard-working place
        
               | gwervc wrote:
               | I'm pretty sure there is way less regulations in the US
               | in respect to France where going over the legal 35h/week
               | requires additional capital and legal paperwork.
        
               | retinaros wrote:
               | No one works 35hours in software jobs in france except
               | maybe government. Overtime is also not compensated (they
               | give some days off that is it.)
        
               | psalaun wrote:
               | Even in government; I've worked 50+ hours weeks working
               | for the healthcare branch of the providence state, with a
               | classic 39h/w contract. No compensation of any sort,
               | despite having timesheets.
               | 
               | There are a lot of myths about French worker. Our
               | lifelong worked hours is not exceptional; our
               | productivity is also not exceptional.
        
               | greenavocado wrote:
               | Pointless suffering. Report violations to the CSE,
               | Medecin du Travail, and Inspection du Travail.
        
               | psalaun wrote:
               | It was a choice, I loved my job there. I had more
               | exciting projects than most of my friends in the private
               | sector!
        
               | Saline9515 wrote:
               | Excellent way to get blacklisted and never work for the
               | State again if you're a contractor, or end up in a low
               | impact, boring job if you're a career worker.
        
               | algoghostf wrote:
               | This is not true. Government workers or factory workers
               | can limit to 35h (with some salary loss or days off
               | loss), but else than that (especially in tech) it is very
               | competitive and working 50 hours+/week is not exceptionl.
        
               | kgwgk wrote:
               | > 50 hours+/week is not exceptionl.
               | 
               | https://www.legifrance.gouv.fr/codes/article_lc/LEGIARTI0
               | 000...
               | 
               | Au cours d'une meme semaine, la duree maximale
               | hebdomadaire de travail est de quarante-huit heures.
               | 
               | https://www.legifrance.gouv.fr/codes/article_lc/LEGIARTI0
               | 000...
               | 
               | La duree hebdomadaire de travail calculee sur une periode
               | quelconque de douze semaines consecutives ne peut
               | depasser quarante-quatre heures, sauf dans les cas prevus
               | aux articles L. 3121-23 a L. 3121-25.
        
               | Saline9515 wrote:
               | Everyone is "forfait cadre", which allow them to work
               | with no practical time limit since they don't log their
               | time spent at work. https://www.service-
               | public.fr/particuliers/vosdroits/F19261
        
               | kgwgk wrote:
               | It seems that 20% of employees in the private sector are
               | "cadres" and half of them are on "forfait jours". That
               | makes around 10% of the private sector employees working
               | 218 days per year without the 48/44 weekly hour limits.
               | It's more than I thought but I doubt that many of them
               | work more than 10 hours per day. Whether that's
               | "exceptional" or not is a matter of definition, of
               | course.
        
               | psychoslave wrote:
               | What do you mean with work more than 10h/day for
               | intellectual work? You don't stop to think the moment you
               | are away from the production machine. And the exact
               | opposite can often happen: you go away from the
               | computer/board/paper/office, make a walk trying to wander
               | at something else as far as you can stear consciousness,
               | and then the solutions/ideas land in your mind.
        
               | kgwgk wrote:
               | You're not wrong but what did the commenter above meant
               | with "50 hours+/week"? Weeks have three times as many
               | hours. Years also have many more than 218 days.
               | 
               | Anyway I found an official survey saying that 40% of them
               | work more than 50 hours per week (but fewer weeks than
               | regular employees) so I guess it's not so rare (around
               | one private sector employee in twenty).
        
               | Xmd5a wrote:
               | Used to work 70h/week on average, like every week of the
               | year. I don't think I ever wworked less than 50h in a
               | week
        
               | greenavocado wrote:
               | In the USA most software engineers are FLSA-exempt
               | ("computer employee" exemption).
               | 
               | No overtime pay regardless of hours worked.
               | 
               | No legal maximum hours per day/week.
               | 
               | No mandatory rest periods/breaks (federally).
               | 
               | The US approach places the burden on the individual
               | employee to negotiate protections or prove
               | misclassification, while French law places the burden on
               | the employer to comply with strict, state-enforced
               | standards.
               | 
               | The French Labor Code (Code du travail) applies to
               | virtually all employees in France, regardless of sector
               | (private tech company, government agency, non-profit,
               | etc.), unless explicitly exempted. Software engineering
               | is not an exempted profession. Maximum hour limits are
               | absolute. The caps of 44 hours per week, 48 hours average
               | over 12 weeks, and 10/12 hours per day are legal maximums
               | for almost all employees. Tech companies cannot simply
               | ignore them. The requirements for employee consent,
               | strict annual limits (usually max 220 hours/year),
               | premium pay (+25%/+50%), and compensatory rest apply to
               | software engineers just like any other employee.
               | 
               | "Cadre" Status is not an exemption. Many software
               | engineers are classified as Cadres
               | (managers/professionals) but this status does not
               | automatically exempt them from working time rules.
               | 
               | Cadre au forfait jours (Days-Based Framework): This is
               | common for senior engineers/managers. They are exempt
               | from tracking daily/weekly hours but must still have a
               | maximum of 218 work days per year (including weekends,
               | holidays, and RTT days). Their annual workload must not
               | endanger their health. 80-hour weeks would obliterate
               | this rest requirement and pose severe health risks,
               | making it illegal. Employers must monitor their workload
               | and health.
               | 
               | Cadre au forfait heures (Hours-Based Framework) or Non-
               | Cadre: These employees are fully subject to the standard
               | daily/weekly/hourly limits and overtime rules. 80+
               | hours/week is blatantly illegal.
               | 
               | The tech industry, especially gaming/startups, sometimes
               | tries to import unsustainable "crunch" cultures. This is
               | illegal in France.
               | 
               | EDIT: Fixed work days
        
               | kgwgk wrote:
               | > 218 rest days per year (including weekends, holidays,
               | and RTT days)
               | 
               | Wouldn't that be nice, 218 rest days? It's 218 working
               | days.
        
               | Saline9515 wrote:
               | Some State services, such as the "Tresor", which oversees
               | French economic policies, do not respect this at all, and
               | require 12h work days most of the year. The churn is
               | enormous, workers staying there less than a year on
               | average.
        
               | algoghostf wrote:
               | I think there is theory and there is real life. As tech
               | worker, in 20 years career, in private sector, I have
               | always been on forfait jours, working more than 10h/day
               | on average, during many years weekend included. I never
               | got paid extra hours. So I get what you say about the
               | perception and the law. The French law is protective (i.e
               | if I can prove that in a court I'll get my extra hours
               | paid for sure but my career would end. Period.
        
               | Xmd5a wrote:
               | >I'll get my extra hours paid for sure but my career
               | would end.
               | 
               | Are you working in an area that is that specific ? I'm
               | French but I'm naive.
        
               | Saline9515 wrote:
               | In France most white collar jobs are categorized as
               | "management" ("cadre"), and they have no time limit. It
               | is very common for workers to clock 12h days in
               | consultancies (10am-10pm) and in state administrations,
               | for instance.
        
               | retinaros wrote:
               | Most of french people in engineering jobs in France are
               | working late even tho overtime is never paid.
        
               | Disposal8433 wrote:
               | In the USA they have the famous 9 to 5. Most developers'
               | jobs in France are "9 to 6 with 2 hours to eat in the
               | middle and unpaid overtime," so I would say both
               | countries are equivalent.
        
               | psalaun wrote:
               | In parisian startups it's more 9 to 7 with 30 min lunch
               | breaks.
        
               | pdabbadabba wrote:
               | I'm not here to debate which country works harder. Among
               | other things, I'm not at all convinced that it's good for
               | a society for people to be so devoted to their jobs.
               | 
               | But it's worth pointing out that the U.S.'s famous 9-to-5
               | is completely inapplicable to any sort of high-demand
               | job. For many people in a demanding profession like tech,
               | a 9-to-5 job would be an absolute (and often
               | unattainable) dream. Where I live (Washington, D.C.)
               | people who want a 9-to-5 will generally leave industry
               | altogether and work for the government. (And even there,
               | a true 9-to-5 can be elusive.)
        
               | chairmansteve wrote:
               | Spoken like a guy who's never been to France.
               | 
               | Classic drive by internet trope.
               | 
               | Maybe try a little harder, have an informed opinion about
               | something.
        
               | epolanski wrote:
               | [flagged]
        
               | FirmwareBurner wrote:
               | _> You think that European founders and researchers are
               | like "nah, you know what, we're European, we're not
               | ambitious, we don't want to make money, to hell with
               | equity"?_
               | 
               | That's the copium HN thinks. European workers bust their
               | asses for glory not for money.
        
               | tomhow wrote:
               | We're getting complaints about your comments, and this is
               | a prime example of the kind of comment that is not right
               | for HN. It takes a swipe at the whole HN community (on
               | the false pretence that the HN audience is concentrated
               | via country/region or mindset), and makes a moral
               | judgement based on region/culture.
               | 
               | We've asked you several times recently to stop commenting
               | in this inflammatory style on HN. We don't want to ban
               | you as you have made good contributions too, but if you
               | keep commenting in ways that break the guidelines and
               | draw more complaints from other community members, a ban
               | will be the next step we'll have to take.
               | 
               | If you want HN to be a good place to engage in
               | interesting discussions, please do your part to make it
               | better not worse.
        
           | kergonath wrote:
           | It's a French company, subject to French laws and European
           | regulations. That's what matters, from a user point of view.
        
         | littlestymaar wrote:
         | > Benchmarks suggest this model loses to Deepseek-R1 in every
         | one-shot comparison.
         | 
         | That's not particularly surprising though as the Medium variant
         | is likely close to ten times smaller than DeepSeek-R1 (granted
         | it's a dense model and not an MoE, but still).
        
         | fiatjaf wrote:
         | This reads like an AI-generated comment. What do you mean by
         | "benchmarks suggest"? The benchmarks are very clear and
         | presented right there in the page.
        
         | tootie wrote:
         | As an occasional user of Mistral, I find their model to give
         | generally excellent results and pretty quickly. I think a lot
         | of teams are now overly focused on winning the benchmarks while
         | producing worse real results.
        
           | esafak wrote:
           | If so we need to fix the benchmarks.
        
             | paulddraper wrote:
             | https://en.wikipedia.org/wiki/Goodhart%27s_law
        
             | riku_iki wrote:
             | those who try to fix them are fighting alone against huge
             | corps which try to abuse them..
        
             | tootie wrote:
             | I think there's a fundamental limit to benchmarks when it
             | comes to real-world utility. The best option would be more
             | like a user survey.
        
               | esafak wrote:
               | That's Chatbot Arena: https://lmarena.ai/leaderboard
        
               | jug wrote:
               | And unfortunately revealed to be largely a vibe check
               | these days with that whole Llama 4 debacle. But why
               | should we be surprised, really, when users have an easier
               | time feeling if the replies sound human and
               | conversational and _appear_ knowledgeable than actually
               | outsmarting them. This Arena worked well in the ChatGPT
               | 3.0 days... But now?
        
         | segmondy wrote:
         | are you really going to compare a 24B model to a 700B+ model?
        
           | a2128 wrote:
           | 24B is the size of the Small opensourced model. The Medium
           | model is bigger (they don't seem to disclose its size) and
           | still gets beaten by Deepseek R1
        
             | thot_experiment wrote:
             | Mistral Large is 123b so one can probably assume that
             | medium is between 24b and 123b, also Mistral 3.1 is by a
             | wide margin my go-to model in real life situations.
             | Benchmarks absolutely don't tell the whole story, and
             | different models have different use cases.
        
               | Ringz wrote:
               | Can you please explain what your ,,real life situations"
               | are?
        
               | thot_experiment wrote:
               | I use it as a personal assistant (so tool use integrated
               | into calendar/todo/notes etc) often times using the
               | multimodal aspect (taking a photo of a todo list, asking
               | it to remind me to buy something from a picture). I also
               | use it as a code completion tool in vscode, as well as a
               | replacement for most basic google searches ("how does
               | this syntax work", "what's the torch method for X")
               | 
               | I use it for almost every interaction I have with AI that
               | isn't asking it to oneshot complex code. I fairly
               | frequently run my prompts against Claude/ChatGPT and
               | Mistral 3.1 and find that for most things they're not
               | meaningfully different.
               | 
               | I also spend a lot of time playing around with it for
               | storytelling/integration into narrative games.
        
               | mandelken wrote:
               | Cool. What framework or program do you use to orchestrate
               | this?
        
               | thot_experiment wrote:
               | Me, Mistral and Claude writing modules on top of a
               | homebrew assistant framework in node with a web frontend.
               | I started out mostly handwriting the first couple modules
               | and the framework for it. (todo and a time tracker) and
               | now the AI is getting pretty good at replicating the
               | patterns I like using, esp with some prompt engineering
               | as long as I don't ask for entire architectures but just
               | prod it along. It's just so easy to make the exact thing
               | you want now. All the heavy lifting is done by ollama and
               | the node/browser APIs.
               | 
               | The only dependency on the node side is 'mime' which is
               | just a dict of mime types, data lives inside node's new
               | `node:sqlite` everything on the front side that isn't
               | just vanilla is alpine. It runs on my main desktop and
               | has filesystem access (which doesn't yet do anything
               | useful really) but the advantage here is that since I've
               | written (well at least read) all of the code I can put a
               | very high level of trust into my interactions.
        
               | Rastonbury wrote:
               | Did you hook up any search tools?
        
               | ohso4 wrote:
               | It's a 70b model, Medium 2 was 70b.
               | 
               | https://xcancel.com/arthurmensch/status/19201368714614336
               | 20#...
        
           | moffkalast wrote:
           | The most important company is to is to QwQ at 30B sjnce it's
           | still the best local reasoning model for that size. A
           | comparison that Mistral did not run for some reason, not even
           | with Qwen3.
        
         | hmottestad wrote:
         | With how amazing the first R1 model was and how little compute
         | they needed to create it, I'm really wondering how the new R1
         | model isn't beating o3 and 2.5 Pro on every single benchmark.
         | 
         | Magistral Small is only 24B and scores 70.7% on AIME2024 while
         | the 32B distill of R1 scores 72.6%. And with majority voting
         | @64 the Magistral Small manages 83.3%, which is better than the
         | full R1. Since I can run a 24B model on a regular gaming GPU
         | it's a lot more accessible than the full blown R1.
         | 
         | https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-...
        
           | adventured wrote:
           | It's because DeepSeek was a fast copy. That was the easy part
           | and it's why they didn't have to use so much compute to get
           | near the top. Going well beyond o3 or 2.5 Pro is drastically
           | more expensive than fast copy. China's cultural approach to
           | building substantial things produces this sort of outcome
           | regularly, you see the same approach in automobiles, planes,
           | Internet services, industrial machinery, military, et al.
           | Innovation is very expensive and time consuming, fast copy is
           | more often very inexpensive and rapid. 85% good enough is
           | often good enough, that additional 10-15% is comically
           | expensive and difficult as you climb.
        
             | MaxPock wrote:
             | I understand that the French are very innovative so why
             | isn't their model SOTA ?
        
             | natrys wrote:
             | Not disagreeing with the overarching point but:
             | 
             | > That was the easy part
             | 
             | Is a bit hand-wavy in that it doesn't explain why it's only
             | DeepSeek who can do this "easy" thing, but still not Meta,
             | Mistral or anyone else really. There are many other players
             | who have way more compute than DeepSeek (even inside China,
             | not even considering rest of the world), and I can assure
             | you more or less everyone trains on synthetic
             | data/distillation from whatever bigger model they can
             | access.
        
               | refulgentis wrote:
               | They _all_ have. I don 't hope to convince you of that,
               | everyones use case differs. Generally, AIME / prose /
               | code benchmarks that don't involve successive tool calls
               | are used to hide some very dark realities.
               | 
               | IMHO tool calling is by far the most clearly economically
               | valuable function for an LLM, and r1 self-admittedly
               | just...couldn't do it.
               | 
               | There's a lot of puff out there that's just completely
               | misaligned with reality, ex. Gemini 2.5 Pro is by far the
               | worst tool caller, Gemini 2.5 Flash thinking is better,
               | 2.5 Flash is even better. And either Llama 4 beats all
               | Gemini 2.5s except 2.5 Flash not thinking.
               | 
               | I'm all for "these differences will net out in the long
               | run", Google's at least figured out how to micro optimize
               | for Aider edit formatting without tools. Over the last 3
               | months, they're up 10% on edit performance. But it's
               | horrible UX to have these specially formatted code blocks
               | in the middle of prose. They desperately need to clean up
               | their absurd tool-calling system. But I've been saying
               | that for a year now. And they don't take it seriously, at
               | all. One of their most visible leads tweeted "hey what
               | are the best edit formats?" and a day later is tweeting
               | the official guide for doing edits. I'm a Xoogler and
               | that absolutely reeks of BigCo dysfunction - someone
               | realized a problem 2 months after release and now we have
               | "fixed" it without training, and now that's the right way
               | to do things. Because if it isn't, well, what would we
               | do? _Shrugs_
               | 
               | I'm also unsure how much longer it's worth giving a pass
               | on this stuff. Everyone is competing on agentic stuff
               | because that's the golden goose, real automation, and
               | that needs tools. It would be utterly unsurprising to me
               | for Google to keep missing a pain signal on this, vis a
               | vis Anthropic, which doubled down on it mid-2024.
               | 
               | As long as I'm dumping info, BFCL is _not_ a good proxy
               | for this quality. Think  "converts prose to JSON" not
               | "file reading and editing"
        
               | natrys wrote:
               | I don't mind the info dump, but I am struggling to
               | connect the relevance of this to topic at hand. I mean,
               | focusing on a single specific capability and generalising
               | it to mean "they all have" caught up with DeepSeek all
               | across the board (which was the original topic) is a
               | reductive and wild take. Especially when it seems to me
               | that this seems more because of misaligned incentive than
               | because it's truly a hard problem.
               | 
               | I am not really invested in this niche topic but I will
               | observe that, yes I agree Llama 4 is really good here.
               | And yet it's a far worse coder, far less intelligent than
               | DeepSeek and that's not even arguable. So no it didn't
               | "catch up" any more than what you could say by pointing
               | out Llama is multimodal but DeepSeek isn't. That's just
               | talking about a different things entirely.
               | 
               | Regardless, I do agree BFCL is not the best measure
               | either, the Tau-bench is more real world relevant. But
               | end of the day, most frontier labs are not incentive
               | aligned to care about this. Meta cares because this is
               | something Zuck personally cares about, Llama models are
               | actually for small businesses solving grunt automation,
               | not for random people coding at home. People like
               | Salesforce care (xLAM), even China had GLM before
               | DeepSeek was a thing. DeepSeek might care so long as it
               | looks good for coding benchmarks, but that's pretty much
               | the extent of it.
               | 
               | And I suspect Google doesn't truly care because in the
               | long run they want to build everything themselves. They
               | already have a CodeAssist product around coding which
               | likely uses fine-tune of their mainline Gemini models to
               | do something even more specific to their plugin.
               | 
               | There is a possibility that at the frontier, models are
               | struggling to be better in a specific and constrained
               | way, without getting worse at other things. It's either
               | this, or even Anthropic has gone rogue because their
               | Aider scores are way down now from before. How does that
               | make sense if they are supposed to be all around better
               | at agentic stuff in tool agnostic way? Then you realise
               | they now have Claude Coder and it just makes way more
               | economic sense to tie yourself to that, be context
               | inefficient to your heart's content so that you can burn
               | tokens instead of being, you know, just generally better.
        
               | refulgentis wrote:
               | > I am struggling to connect the relevance of this
               | 
               | > focusing on a single specific capability and
               | 
               | > I am not really invested in this niche topic
               | 
               | Right: I definitely ceded a "but it doesn't matter to
               | me!" argument in my comment.
               | 
               | I sense a little "doth protest too much", in the multiple
               | paragraphs devoted to taking that and extending it to
               | _the underpinning of automation_ is  "irrelevant"
               | "single" "specific", "niche".
               | 
               | This would also be news to DeepSeek, who put a lot of
               | work to launch it in the r1 update a couple weeks back.
               | 
               | Separately, I assure you, it would be news to anyone on
               | the Gemini team that they don't care because they want to
               | own everything. I passed this along via DM and got "I
               | wish :)" in return - there's been a fire drill trying to
               | improve it via AIDER in the short term, is my
               | understanding.
               | 
               | If we ignore that, and posit there _is_ an upper
               | management conspiracy to suppress performance, its just
               | getting public cover by a lower upper management rush to
               | improve scores...I guess that 's possible.
               | 
               | Finally, one of my favorite quotes is "when faced with a
               | contradiction, first check your premises" - to your Q
               | about why no one can compete with DeepSeek R1 25-01, I'd
               | humbly suggest you may be undergeneralizing, given even
               | _tool calls_ are  "irrelevant" and "niche" to you.
        
               | natrys wrote:
               | Interesting presumption about R1 25-01 being what's
               | talked about, you knowledge cut-off does appear to know
               | R1 update two weeks back was a thing, and that it even
               | improved on function calling.
               | 
               | Of course you have to pretend I meant the former,
               | otherwise "they all have" doesn't entirely make sense.
               | Not that it made total sense before either, but if I say
               | your definition of "they" is laughably narrow, I suspect
               | you will go back to your google contact and confirm that
               | nothing else really exists outside it.
               | 
               | Oh and do a ctrl-f on "irrelevant" please, perhaps some
               | fact grounding is in order. There was an interesting
               | conversation to be had about _underpinning of automation_
               | somehow without intelligence (Llama 4) but who has time
               | for that if we can have hallucination go hand in hand
               | with forced agendas (free disclaimer to boot) and
               | projection ( "doth protest too much")? Truly
               | unforeseeable.
        
               | refulgentis wrote:
               | I don't know what you're talking about, partially because
               | of poor grammar ("you knowledge cut-off does appear") and
               | "presumption" (this was front and center on their API
               | page at r1 release, and its in the r1 update notes). I
               | sort of stopped reading after there because I realized
               | you might be referring to me having a "knowledge cut-
               | off", which is bizarre and also hard to understand, and
               | it's unlikely to be particularly interesting conversation
               | given that and the last volley relied on lots of stuff
               | about tool calling being, inter alia, niche.
        
               | natrys wrote:
               | > you might be referring to me having a "knowledge cut-
               | off"
               | 
               | Don't forget I also referred to you having
               | "hallucination". In retrospect, likening your logical
               | consistency to an LLM was premature, because not even
               | gpt-3.5 era models could pull off a gem like:
               | 
               | > You: to your Q about why no one can compete with
               | DeepSeek R1 25-01 blah blah blah
               | 
               | >> Me: ...why would you presume I was talking about 25-01
               | when 28-05 exists and you even seem to know it?
               | 
               | >>> You: this was front and center on their API page!
               | 
               | Riveting stuff. Few more digs about poor grammar and how
               | many times you stopped reading, and you might even sell
               | the misdirection.
        
               | Vetch wrote:
               | I think the point remains that few have been able to
               | catch up to OpenAI. For a while it was just Anthropic.
               | Then Google after failing a bunch of times. So, if we
               | relax this to LLMs not by OpenAI, Anthropic or Google,
               | then Deepseek is really the only one that's managed to
               | reach their quality tier (even though many others have
               | thrown their hat into the ring). We can also get
               | approximate glimpses into which models people use by
               | looking at OpenRouter, sorted by Top Weekly.
               | 
               | In the top 10, are models by OpenAI (gpt4omini), Google
               | (gemini flashes and pros), Anthropic (Sonnets) and
               | Deepseeks'. Even though the company list grows shorter if
               | we instead look at top model usage grouped by order of
               | magnitude, it retains the same companies.
               | 
               | Personally, the models meeting my quality bar are: gpt
               | 4.1, o4-mini, o3, gpt2.5pro, gemini2.5flash (not 2.0),
               | claude sonnet, deepseek and deepseek r1 (both versions).
               | Claude Sonnet 3.5 was the first time I found LLMs to be
               | useful for programming work. This is not to say there are
               | no good models by others (such as Alibaba, Meta, Mistral,
               | Cohere, THUDM, LG, perhaps Microsoft), particularly in
               | compute constrained scenarios, just that only Deepseek
               | reaches the Quality tier of the big 3.
        
             | orbital-decay wrote:
             | This terrible and vague stereotyping about "China" while
             | having no clue about the subject should have no place on HN
             | but somehow always creeps in and is upvoted by someone.
             | DeepSeek is not "China", they had nobody to copy from, they
             | released their first 7B reasoning model back in April 2024,
             | it was ahead of then-SotA models in math and validated
             | their approach. They did a ton of new things besides
             | training a reasoning model, and likely have more to come,
             | as they have a completely different background than most AI
             | companies. It's more of a cross-pollination of different
             | areas of expertise.
        
               | SoMomentary wrote:
               | I thought it had been bandied about that Deepseek had
               | exfiltrated a bunch of data from OpenAI's models, which
               | was then used to train theirs? Did this ultimately prove
               | untrue? My apologies, I don't always keep up on the
               | latest drama in the AI circles - so maybe that has been
               | well proven wrong.
        
               | orbital-decay wrote:
               | Sam Altman threw a fit and claimed this, without
               | providing evidence. He's... not exactly a person to trust
               | blindly. Training on other model outputs (or at least
               | doing sanity checks against them) is pretty common, but
               | these models seem very different, DS has prior art, and
               | by all signs this claim makes little sense and is hard to
               | believe.
        
               | glomgril wrote:
               | one man's exfiltration is another man's distillation
               | `-\\_(tsu)_/-`
               | 
               | you could say they're playing by a different set of
               | rules, but distilling from the best available model is
               | the current meta across the industry. only they know what
               | fraction of their post-training data is generated from
               | openai models, but personally i'd bet my ass it's greater
               | than zero because they are clearly competent and in their
               | position it would have been dumb to _not_ do this.
               | 
               | however you want to frame it, they have pushed the field
               | forward -- especially in the realm of open-weight models.
        
           | reissbaker wrote:
           | It's not better than full R1; Mistral is using misleading
           | benchmarks. The latest version of R1, R1-0528, is much
           | better: 91.4% on AIME2024 pass@1. Mistral uses the original
           | R1 release from January in their comparisons, presumably
           | because it makes their numbers look more competitive.
           | 
           | That being said, it's still very impressive for a 24B.
           | 
           |  _I 'm really wondering how the new R1 model isn't beating o3
           | and 2.5 Pro on every single benchmark._
           | 
           | Sidenote, but I'm pretty sure DeepSeek is focused on V4, and
           | after that will train an R2 on top. The V3-0324 and R1-0528
           | releases weren't retrained from scratch, they just continued
           | training from the previous V3/R1 checkpoints. They're nice
           | bumps, but V4/R2 will be more significant.
           | 
           | Of course, OpenAI, Google, and Anthropic will have released
           | new models by then too...
        
             | redman25 wrote:
             | It may not have been intentionally misleading. Some
             | benchmarks can take a lot of horsepower and time to run.
             | Their preparation for release likely was done well in
             | advance of the model release before the new deepseek r1
             | model had even been available to test.
        
               | reissbaker wrote:
               | AIME24, etc are pretty cheap to run using any DeepSeek
               | API. Regardless, they didn't even run the benchmarks for
               | R1 themselves, they just republished DeepSeek's published
               | numbers from January. They could have published the ones
               | from May, but chose not to.
        
         | epolanski wrote:
         | Jm2c but I feel conflicted about this arms race.
         | 
         | You can be 6/12 months later, and have not burned tens of
         | billions compared to the best in class, I see it an engineering
         | win.
         | 
         | I absolutely understand those that say "yeah, but customers
         | will only use the best", I see it, but is market share of
         | forever money losing businesses that valuable?
        
           | adventured wrote:
           | A similar sentiment existed for a long time about Uber and
           | now they're very profitable and own their market. It was
           | worth the burn to capture the market. Who says OpenAI can't
           | roll over to profitable at a stable scale? Conquer the
           | market, hike the price to $29.95 (family account, no ads;
           | $19.95 individual account with ads; etc etc). To say nothing
           | of how they can branch out in terms of being the interaction
           | point that replaces the search box. The advertising value of
           | owning the land that OpenAI is taking is well over $100
           | billion in annual revenue. Amazon's retail business is
           | terrible, their ad business is fantastic. As OpenAI bolts on
           | an ad product their margin potential will skyrocket and the
           | cost side will be modest in comparison.
           | 
           | Over the coming years it won't be possible to stay a mere
           | 6-12 months behind as the costs to build and maintain the AI
           | super-infrastructure keeps climbing. It'll become a
           | guaranteed implosion scenario. Winning will provide the
           | ongoing immense resources needed to keep pushing up the hill
           | forever. Everybody else - except a few - will fall away. The
           | same outcome took place in search. Anybody spot Lycos,
           | Excite, Hotbot, AltaVista around? It costs an enormous amount
           | of money to try to keep up with Google (Bing, Baidu, Yandex)
           | in search and scale it. This will be an even more brutal
           | example of that, as the costs are even higher to scale.
           | 
           | The only way Mistral survives is if they're heavily
           | subsidized directly by European states.
        
             | aDyslecticCrow wrote:
             | > It was worth the burn to capture the market.
             | 
             | You cannot compare Uber to the AI market. They are too
             | different. Uber captured the market because having three
             | taxi services is annoying. But people are readily jumping
             | between models using multi-model platforms. And nobody is
             | significantly ahead of the pack. There is nothing that sets
             | anyone apart aside from the rate at which they are burning
             | capital. Any advantage is closed within a year.
             | 
             | If OpenAI wants to make a profit, it will raise prices and
             | be dropped at a heartbeat for the next cheapest option.
             | Most software stacks are designed to be model-agnostic,
             | making integration or support a non-factor.
        
               | whiplash451 wrote:
               | Three cab apps are a lot less annoying than three LLM
               | apps each having their piece of your chats history.
               | 
               | The winner-take-all effect is a lot stronger with chat
               | apps.
        
               | snoman wrote:
               | That's the exact opposite of the way it is right now (at
               | least for me). I don't like having multiple ride hailing
               | apps but easily have ChatGPT, Claude, Gemini on my phone
               | (and local LLM at home). There is zero effort cost to go
               | from one to the other.
        
               | otabdeveloper4 wrote:
               | Professional tip - you can save your prompts somewhere
               | else, you don't need "the cloud" for storing them. It's
               | just text.
        
               | aDyslecticCrow wrote:
               | I interface with AI models using a single website where i
               | can select between models. Code IDEs are doing the same.
               | Companies that facilitate cross model integration are
               | doing doing great (cursor as a famous example). This
               | trend is spreading.
        
             | otabdeveloper4 wrote:
             | > now they're very profitable and own their market.
             | 
             | No they don't. They failed in every market except a few
             | niche ones.
        
             | xmcqdpt2 wrote:
             | I think the jury is still out on Uber. They first became
             | profitable in 2023 after 15 years of massive losses. They
             | still burned way more money than they ever made.
        
           | louiskottmann wrote:
           | Indeed, and with the technology plateau-ing, being 6-12
           | months late with less debt is just long term thinking.
           | 
           | Also, Europe being in the race is a big deal for consumers.
        
             | adventured wrote:
             | Why would the debt matter when you have $60 billion in ad
             | revenue and are generating $20 billion in op income? That's
             | OpenAI 5-7 years from now, if they're able to maintain
             | their position with consumers. Once they attach an ad
             | product their margins will rapidly soar due to the
             | comparatively low cost of the ad segment.
             | 
             | The technology is closer to a decade from seeing a plateau
             | for the large general models. GPT o3 is significantly
             | beyond o1 (much less 3.5 which was just Nov 2022). Claude 4
             | is significantly beyond 3.5. They're not subtle
             | improvements. And most likely there will be a splintering
             | of specialization that will see huge leaps outside the
             | large general models. The radical leap in coding
             | capabilities over the past 12-18 months is just an early
             | example of how that will work, and it will affect every
             | segment of human endeavour.
        
               | aDyslecticCrow wrote:
               | > Once they attach an ad product their margins will
               | rapidly soar due to the comparatively low cost of the ad
               | segment.
               | 
               | They're burning through computers and capital. No amount
               | of advertising could cover the cost of training or even
               | running these models. The massive subscription costs
               | we've started seeing are just a small glimpse into the
               | money they are burning through.
               | 
               | They will NOT make a profit using the current methods
               | unless the models become at least 10 times more efficient
               | than they are now. At which point can Europe adapt to the
               | innovation without much cost.
               | 
               | It's an arms race to see who can burn the most money the
               | fastest, while selling the result for as little as
               | possible. When they need to start making money, it will
               | all come crashing down.
        
               | epolanski wrote:
               | You're describing Google Gemini on any Android phone,
               | that's today, sans the ads.
        
             | ACCount36 wrote:
             | >with the technology plateau-ing
             | 
             | People were claiming that since year 2022. Where's the
             | plateau?
        
               | asadotzler wrote:
               | The pre-training plateau is real. Nearly all the
               | improvements since then have been around fine tuning and
               | reinforcement learning, which can only get you so far.
               | Without continued scaling in the base models, the hope of
               | AGI is dead. You cannot reach AGI without making the pre-
               | training model itself a whole lot better, with more or
               | better data, both of which are in short supply.
        
               | ethbr1 wrote:
               | > _with more or better data, both of which are in short
               | supply_
               | 
               | Hmmm. It's almost as if a company without a user data
               | stream like OpenAI would be driven to release an end-user
               | device for the sole purpose of capturing more training
               | data...
        
               | MindTheAbstract wrote:
               | While I tend to agree, I wonder if synthetic data might
               | be reaching a new high with concepts like Google's
               | AlphaEvolve. It doesn't cover everything, but at least in
               | verifiable concepts, I could see it produce more valuable
               | training data. It's a little unclear to me where AGI will
               | come from (LLMs? EBMs - @LeCun)? Something completely
               | different?)
        
               | psychoslave wrote:
               | Could it be that at least for the "lowest" fruits, most
               | amazing things that can one can hope to obtain from
               | scraping the whole web and throw it at some computation
               | training was already achieved? Maybe AGI simply can not
               | be obtained without some relevant additional probes sent
               | in the wild to feed its learning loops?
        
               | dismalaf wrote:
               | If you can't see it you're blind.
               | 
               | LLMs haven't improved much. What's improved is the chat
               | apps: switching between language model, vision, image and
               | video generation and being able to search the internet is
               | what has made them seem 100x more useful.
               | 
               | Run a single LLM without any tools... They're still
               | pretty dumb.
        
               | louiskottmann wrote:
               | There's frequent discussions about how sonnet-3.5 is in
               | the same ballpark or even outperforms sonnet-3.7 and 4.0,
               | for example.
        
             | sisve wrote:
             | Being the best European AI company is also a multi billion
             | business. Its not like China or the US respects GDPR. A lot
             | of companies will choose the best European company.
        
         | wafngar wrote:
         | But they have built a fully "independent" pipeline. Deepseek
         | and others probably trained in gpt4, o1 or whatever data.
        
       | bee_rider wrote:
       | How many other open-weights reasoning models are there?
       | 
       | Is it possible to run multiple reasoning models on one problem?
       | (Why not? I guess).
       | 
       | Another funny thought is: they release their Small model, and
       | kept their Medium as a premium service. I wonder if you could do
       | chains with Medium run occasionally, linked together by local
       | runs of Small?
        
         | simonw wrote:
         | Qwen 3 and DeepSeek R1 and Phi-4 Reasoning are the best open
         | weights reasoning models I know of.
        
         | ls612 wrote:
         | Just Deepseek I think and there are distillations of that that
         | can run on consumer hardware if you really want.
        
       | atemerev wrote:
       | So, worse than R1, and only 24B version is open weights? NGMI. R1
       | is awesome, and full 630B version is open.
        
       | nake13 wrote:
       | The Magistral Small can fit within a single RTX 4090 or a 32GB
       | RAM MacBook once quantized.
        
         | the_sleaze_ wrote:
         | Excellent news for me.
         | 
         | How does one figure this out? As in I want to know the
         | comparable Deepseek or Llama equivalent (size-wise) and don't
         | want to figure it out by trial and error.
        
         | lolive wrote:
         | Is it indeed the plan of Apple to eventually run such kind of
         | models direcly inside a iPhone? Or are the specs of any
         | stateOfTheArt smartphone well below the minimum requirements of
         | such "lightweight" models?
        
       | awongh wrote:
       | Interesting that their niche seems to be small parameter models.
        
       | arnaudsm wrote:
       | I wished the charts included Qwen3, the current SOTA in
       | reasoning.
       | 
       | Qwen3-4B almost beats Magistral-22B on the 4 available
       | benchmarks, and Qwen3-30B-A3B is miles ahead.
        
         | resource_waste wrote:
         | No surprise on my end. Mistral has been basically useless due
         | to other models always being better.
         | 
         | But its European, so its a point of pride.
         | 
         | Relevance or not, we will keep hearing the name as a result.
        
         | SparkyMcUnicorn wrote:
         | 30-A3B is a really impressive model.
         | 
         | I throw tasks at it running locally to save on API costs, and
         | it's possibly better than anything we had a year or so ago from
         | closed source providers. For programming tasks, I'd rank it
         | higher than gpt-4o
        
           | freehorse wrote:
           | It is a great model, and blazing fast, which is actually very
           | useful esp for "reasoning" models, as they produce a lot of
           | tokens.
           | 
           | I wish mistral were back into making MoE models. I loved
           | their 8x7 mixtral, it was one of the greatest models I could
           | run the time it went out, but it is outdated now. I wish
           | somebody was out making a similar size MoE model, which could
           | comfortably sit in a 64GB ram macbook and be fast. Currently
           | the qwen 30-A3B is the only one I know of, but it would be
           | nice to have something slightly bigger/better (incl a non-
           | reasoning base one). All the other MoE models are just too
           | big to run locally in more standard hardware.
        
         | poorman wrote:
         | Is there a popular benchmark site people use? Becaues I had to
         | test all these by hand and `Qwen3-30B-A3B` still seems like the
         | best model I can run in that relative parameter space (/memory
         | requirements).
        
           | arnaudsm wrote:
           | - https://livebench.ai/#/ + AIME + LiveCodeBench for
           | reasoning
           | 
           | - MMLU-Pro for knowledge
           | 
           | - https://lmarena.ai/leaderboard for user preference
           | 
           | We only got Magistral's GPQA, AIME & livecodebench so far.
        
         | devmor wrote:
         | I would agree, Qwen3 is definitely the most impressive
         | "reasoning" model I've evaluated so far.
        
       | 5mv2 wrote:
       | The featured accuracy benchmarks exclude every model that matter
       | except DeepSeek, which is quite telling about this new model's
       | performance.
       | 
       | This makes it yet another example of European companies building
       | great products but fumbling marketing.
       | 
       | Mistral's edge is speed. It's a real pleasure to use because it
       | answers in ~1s what takes other models 5-8s, which makes for a
       | much better experience. But instead of focusing on it, they bury
       | it far down the post.
       | 
       | Try it and see if you like the speed! Note that the speed
       | advantage only applies to queries that don't require web-search,
       | as Mistral is significantly slower on this one, leading to a ~5
       | seconds advantage over 2 minutes of research for the queries I
       | benchmarked with Grok.
        
         | funnym0nk3y wrote:
         | That is reasonable though. Comparing the product of a small
         | company with little resources with giants like Google and
         | OpenAI in a field where most advances are due to more and more
         | expensive models is nonsense.
        
           | 5mv2 wrote:
           | The point I was trying to express is that Mistral is arguably
           | far superior to the giants if you care about speed! So I
           | wished they communicated this more clearly.
        
         | dominicrose wrote:
         | How would you use a fast AI?
         | 
         | My current use of AI is to generate code - or translate some
         | code from a programming language to another - which I can then
         | improve (instead of writing it from stratch). Speed isn't
         | necessary for this. It's a nice-to-have but only if it's not at
         | the cost of quality.
         | 
         | Also, as unfair as it "might" be, we do expect a fast AI not to
         | be as good, don't we? So I wouldn't focus on that in the
         | marketing. I think speed would be easier to sell as something
         | extra you would pay for, because then you'd expect the quality
         | to remain the same or better.
        
           | redavni wrote:
           | analyzing and modifying a user interface in realtime?
        
         | rfv6723 wrote:
         | I tried thinking with websearch on their website.
         | 
         | It has similar speed with o4-mini with search on chatgpt, and
         | o4-mini gave me much better result.
        
       | epic9x wrote:
       | This thing is crazy fast.
        
         | smeeth wrote:
         | They have a deal with Cerebras for inference.
         | 
         | https://www.cerebras.ai/blog/mistral-le-chat
        
           | swah wrote:
           | For me this is more important than quality. I love fast
           | responses, feels more futuristic.
        
             | pxc wrote:
             | What are you using LLMs for?
        
       | rafram wrote:
       | Is the number of em-dashes in this marketing copy indicative of
       | the kind of output that the model produces? If so, might want to
       | tone it down a bit.
        
         | ModernMech wrote:
         | But the em dashes -- if appreciated -- are delightfully
         | eccentric and whimsical!
        
         | tiahura wrote:
         | Unless you're a lawyer. We love 'em.
        
           | NicuCalcea wrote:
           | As a journalist, same!
        
             | lee-rhapsody wrote:
             | Also a journalist. I use em-dashes all the time
        
               | Gregaros wrote:
               | Really anyone that writes for a living. I have a referee
               | report on a paper asking me to correct something to be an
               | em-dash.
        
             | drusepth wrote:
             | As an author... same!
        
         | johnisgood wrote:
         | I do not know but sometimes when I type "-" and press space,
         | LibreOffice converts it to an em-dash. I get rid of it so
         | people won't confuse me with an LLM.
        
         | sebmellen wrote:
         | > _Our early tests indicated that Magistral is an excellent
         | creative companion. We highly recommend it for creative writing
         | and storytelling, with the model capable of producing coherent
         | or -- if needed -- delightfully eccentric copy._
        
         | kobe_bryant wrote:
         | it's bizarre.
         | 
         | the first sentence is "Announcing Magistral -- the first
         | reasoning model by Mistral AI -- excelling in domain-specific,
         | transparent, and multilingual reasoning." and those should
         | clearly be comma
         | 
         | and this sentence is just flat out wrong "Lack of specialized
         | depth needed for domain-specific problems, limited
         | transparency, and inconsistent reasoning in the desired
         | language -- are just some of the known limitations of early
         | thinking models."
        
           | umbra07 wrote:
           | really? i would have written it the exact same way (with
           | dashes instead of commas).
        
             | rafram wrote:
             | The second one is unambiguously wrong. The first just looks
             | kind of weird.
        
         | saratogacx wrote:
         | That is just Mistral's market style. You see it on a lot of
         | their pages. The model output doesn't share the same love for
         | the long dash.
        
         | cAtte_ wrote:
         | 49 em-dashes, 59 commas. that's a crazy ratio
        
         | pembrook wrote:
         | This meme that humans don't use em dashes needs to die.
         | 
         | It's an extremely useful tool in writing and I've been using it
         | for decades.
        
           | rafram wrote:
           | I love a good em-dash, but this page overuses them (nearly
           | 1:1 ratio of em-dashes to commas!) and puts them in places
           | where they just do not belong.
        
           | hskalin wrote:
           | That's very weird, I on the other hand don't remember
           | noticing them or using them before the advent of chatgpt.
           | Maybe it's a cultural thing.
           | 
           | It makes sense that humans would have been using it though,
           | chatgpt learned from us afterall
        
         | xmcqdpt2 wrote:
         | We don't have em dashes as punctuation in French --- commas are
         | usually used instead --- so we get overly excited about using
         | them when we can --- everybody likes novelty.
        
       | christianqchung wrote:
       | I don't understand why the benchmark selections are so scattered
       | and limited. It only compares Magistral Medium with Deepseek V3,
       | R1, and the other close weighted Mistral Medium 3. Why did they
       | leave off Magistral Small entirely, alongside comparisons with
       | Alibaba Qwen or the mini versions of o3 and o4?
        
         | elAhmo wrote:
         | When they include comparisons, it is always a deliberate
         | decision what to show and, more importantly, what not to show.
         | If they had data that would show better performance compared to
         | those models, there is no reason for them to not emphasize
         | that.
        
       | diggan wrote:
       | The only mention of tools I could find is this:
       | 
       | > it significantly improves project planning, backend
       | architecture, frontend design, and data engineering through
       | sequenced, multi-step actions involving external tools or API.
       | 
       | I'm guessing this means it was trained with tool calling? And if
       | so, does that mean it does tool calling within the
       | thinking/reasoning, or within the main text? Seems unclear
        
         | simonw wrote:
         | Tool calling isn't enabled in the official Magistral Small GGUF
         | (or the Ollama one) which is sad. Hope they (or someone else)
         | fix that soon.
        
           | NitpickLawyer wrote:
           | They have already released Devstral, which is a tool-specific
           | finetune of the same base model. That works pretty well with
           | cline (even though it was specifically tuned for open-hands).
           | 
           | This would likely be a good model for the "plan" mode in
           | various agentic tools (cline, aider, cursor/windsurf/void,
           | etc). So you'd have a chat in plan mode, then use devstral to
           | actually implement that plan.
        
             | diggan wrote:
             | Devstral is targeting tool use+coding I think, so something
             | like Magistral but also tool calling (during thinking)
             | would be handy too, just for other use cases. But also
             | beneficial in the context of creating plans for Devstral.
        
           | jmorgan wrote:
           | Working on adding tool calling support to Magistral in
           | Ollama. It requires a tokenizer change and also uses a new
           | tool calling format. Excited to see the results of combining
           | thinking + tool calling!
        
       | simonw wrote:
       | Here are my notes on trying this out locally via Ollama and via
       | their API (and the llm-mistral plugin) too:
       | https://simonwillison.net/2025/Jun/10/magistral/
        
         | atxtechbro wrote:
         | Hi Simon,
         | 
         | What's the huge difference between the two pelicans riding
         | bicycles? Was one running locally the small version vs the
         | pretty good one running the bigger one thru the API?
         | 
         | Thanks, Morgan
        
           | diggan wrote:
           | Ollama doesn't like proper naming for some reason, so `ollama
           | pull magistral:latest` lands you with the q4_K_M version
           | (currently, subject to change).
           | 
           | Mistral's API defaults to `magistral-medium-2506` right now,
           | which is running with full precision, no quantization.
        
             | samtheprogram wrote:
             | Not only the quantization, but what's available via ollama
             | is magistral-small (for local inference), not the -medium
             | variant.
        
             | otabdeveloper4 wrote:
             | Nobody should be _ever_ using ollama, for _any_ reason.
             | 
             | It literally only makes everything worse and more
             | convoluted with zero benefits.
        
               | jeffhuys wrote:
               | Could you elaborate?
        
               | redman25 wrote:
               | Not the parent but I would say bad defaults or naming.
               | There are countless posts from newbies wondering why a
               | model doesn't work as well as it should.
               | 
               | It's usually either because the context size is set very
               | low by default or they didn't realize that they weren't
               | running the full model (ollama uses the distilled version
               | in place of the full version but names it after the full
               | version).
               | 
               | There's also been some controversy over not giving proper
               | credit to llama.cpp which ollama is/was a wrapper around.
        
               | kristianp wrote:
               | > ollama uses the distilled version
               | 
               | I've never used ollama, but perhaps you mean quantized
               | and not distilled? Or do they actually use distilled
               | versions?
        
               | cosmojg wrote:
               | They actually use distilled versions. The most egregious
               | example of this is their misleading reference to all
               | distillations of DeepSeek-R1, which are based on a
               | variety of vastly different base models of varying sizes,
               | as alternative versions of DeepSeek-R1 itself. To this
               | day, many users maintain the mistaken impression that
               | DeepSeek-R1 is overhyped and doesn't perform as well as
               | claimed by those who have been using the actual model
               | with 685B parameters.
        
               | otabdeveloper4 wrote:
               | ollama is just a wrapper for llama.cpp that adds insane
               | defaults.
               | 
               | Just use llama.cpp directly.
        
           | simonw wrote:
           | Yes, the bad one was Mistral Small running locally, the
           | better one was Mistral Medium via their API.
        
         | internet_points wrote:
         | > I guess this means the reasoning traces are fully visible and
         | not redacted in any way - interesting to see Mistral trying to
         | turn that into a feature that's attractive to the business
         | clients they are most interested in appealing to.
         | 
         | but then someone found that, at least for distilled models,
         | 
         | > correct traces do not necessarily imply that the model
         | outputs the correct final solution. Similarly, we find a low
         | correlation between correct final solutions and intermediate
         | trace correctness
         | 
         | https://arxiv.org/pdf/2505.13792
         | 
         | ie. the conclusion doesn't necessarily follow from the
         | reasoning. So is there still value in seeing the reasoning?
         | There may be useful information in the reasoning, but I'm not
         | sure it can be interpreted by humans as a typical human chain
         | of reasoning, maybe it should be interpreted more as a loud
         | multi-party discussion on the relevant subject which may have
         | informed the conclusion but not necessarily lead to it.
         | 
         | OTOH, considering the effects of automation fatigue vs human
         | oversight, I guess it's unlikely anyone will ever look at the
         | reasoning in practice, except to summarily verify that it's
         | there and tick the boxes on some form.
        
       | GuinansEyebrows wrote:
       | This doesn't really explain what "reasoning" means in the context
       | of genAI, or how it's done by this product. Are there any good
       | sources to learn more about what "reasoning model" means outside
       | of marketing-speak?
        
         | pier25 wrote:
         | It's pure marketing. See the recent paper by Apple called "The
         | Illusion of Thinking".
         | 
         | https://ml-site.cdn-apple.com/papers/the-illusion-of-thinkin...
        
           | kamranjon wrote:
           | I sort of agree with this, having read the recent Apple paper
           | - but it does show a significant improvement at a certain
           | level of complexity - it's just that it requires quite a few
           | more tokens to achieve that. It could probably be described
           | as a sort of "context" hack because it's basically having a
           | conversation with itself to arrive at a better solution.
           | You're trading performance/time for a bit better quality.
        
           | throwaway314155 wrote:
           | If you read that paper, you'll find a more nuanced take than
           | simply "it's pure marketing"
        
       | skeptrune wrote:
       | Fully open reasoning traces are useful. Happy there is a vendor
       | out there shipping that feature.
        
       | desireco42 wrote:
       | One cool think about this model, that I installed locally is that
       | supports well other languages as well as it should be pleasant
       | conversation partner.
       | 
       | BTW I am personally fan of Mistral, because while it is not the
       | top model, it produces good results and the most important thing
       | is that it is super fast, just go to it's chat and be amazed. It
       | really saves a lot of time to have quick response.
        
       | dwedge wrote:
       | Their OCR model was really well hyped and coincidentally came out
       | at the time I had a batch of 600 page pdfs to OCR. They were all
       | monospace text just for some reason the OCR was missing.
       | 
       | I tried it, 80% of the "text" was recognised as images and output
       | as whitespace so most of it was empty. It was much much worse
       | than tesseract.
       | 
       | A month later I got the bill for that crap and deleted my
       | account.
       | 
       | Maybe this is better but I'm over hype marketing from mistral
        
         | notnullorvoid wrote:
         | I wouldn't trust any of these LLM teams to produce a good OCR
         | model. OCR from 10 years ago is better than the crap they put
         | out.
        
       | alister wrote:
       | As a quick test of logical reasoning and basic Wikipedia-level
       | knowledge, I asked Mistral AI the following question:
       | 
       | A Brazilian citizen is flying from Sao Paulo to Paris, with a
       | connection in Lisbon. Does he need to clear immigration in Lisbon
       | or in Paris or in both cities or in neither city?
       | 
       | Mistral AI said that "immigration control will only be cleared in
       | Paris," which I think is wrong.
       | 
       | After I pointed it to the Wikipedia article on this topic[1], it
       | corrected itself to say that "immigration control will be cleared
       | in Lisbon, the first point of entry into the Schengen Area."
       | 
       | I tried the same question with Meta AI (Llama 4) and it did much
       | worse: It said that the traveler "wouldn't need to clear
       | immigration in either Lisbon or Paris, given the flight
       | connections are within the Schengen Area", which is completely
       | incorrect.
       | 
       | I'd be interested to hear if other LLMs give a correct answer.
       | 
       | [1] https://en.wikipedia.org/wiki/Schengen_Area#Air_travel
        
         | marsa wrote:
         | doing some reason.. uhh intuitioning i imagine brazil and
         | portugal might have some sort of a visa-free deal going on in
         | which case llama 4 might actually be right here?
        
           | alister wrote:
           | Brazilians don't need a visa for Portugal, France, or any
           | Schengen country. But everybody has to pass through
           | immigration control (at least a passport check even if you
           | don't need a visa) when entering the Schengen zone. My
           | question was which country would that happen in.
        
           | mcintyre1994 wrote:
           | AFAIK Schengen has a common visa policy, so there couldn't be
           | such a deal between Brazil and Portugal. It'd also be
           | extremely surprising if two countries not in a common travel
           | area had a deal where you didn't have to clear customs at
           | all, I suspect that doesn't exist anywhere in the world.
        
         | mcintyre1994 wrote:
         | I think Gemini's answer (2.5 Flash) is impressive
         | 
         | ----
         | 
         | Since both Portugal and France are part of the Schengen Area,
         | and a Brazilian citizen generally does not need a visa for
         | short stays (up to 90 days in any 180-day period) in the
         | Schengen Area, here's how immigration will work:
         | 
         | Lisbon: The Brazilian citizen will need to clear immigration in
         | Lisbon. This is because Lisbon is the first point of entry into
         | the Schengen Area. At this point, their passport will be
         | stamped, and they will be officially admitted into the Schengen
         | Zone.
         | 
         | Paris: Once they have cleared immigration in Lisbon, their
         | flight from Lisbon to Paris is considered a domestic flight
         | within the Schengen Area. Therefore, they will not need to
         | clear immigration again in Paris.
         | 
         | Important Note: While Brazilians currently enjoy visa-free
         | travel, the European Travel Information and Authorization
         | System (ETIAS) is expected to become mandatory by late 2026.
         | Once implemented, Brazilian citizens will need to obtain this
         | electronic authorization before their trip to Europe, even for
         | visa-free stays. However, this is a pre-travel authorization,
         | not a visa in the traditional sense, and the immigration
         | clearance process at the first point of entry would remain the
         | same.
        
         | viraptor wrote:
         | It looks like you're not sure of the answer yourself. That's
         | really not a good way to test the LLMs. You'll just prefer the
         | one that convinces you the most rather than the correct one.
        
         | jaza wrote:
         | Sounds to me like "immigration in Lisbon or in Paris or in both
         | cities or in neither city" is a trick question, because (on top
         | of immigration in Lisbon as the Schengen entry point) surely
         | the traveller also needs to clear immigration in Sao Paulo (as
         | the Brazil / Mercosur exit point)?
        
         | schneehertz wrote:
         | This is deepseek-r1's answer:
         | 
         | ```
         | 
         | Based on the Schengen Area rules for international travel:
         | 
         | Lisbon (Portugal) - Immigration clearance is required here.
         | Since Lisbon is the first point of entry into the Schengen Area
         | (and Brazil is outside Schengen), the passenger must clear
         | immigration (passport control) in Lisbon. This is standard for
         | all non-Schengen arrivals.
         | 
         | Paris (France) - No immigration clearance is needed. After
         | clearing immigration in Lisbon, the onward flight to Paris is
         | considered a domestic Schengen flight (no border checks within
         | Schengen).
         | 
         | ```
        
         | eigenspace wrote:
         | I wonder if they adjusted it since reading this thread, or if
         | you forgot to turn on reasoning or if you just got unlucky. For
         | me, when I ask this it thinks for about 1.5 minutes and
         | responds with
         | 
         | "The Brazilian citizen needs to clear immigration in Lisbon."
         | 
         | When I asked it to explain why, it said
         | 
         | "The Brazilian citizen needs to clear immigration in Lisbon
         | because Lisbon is the first Schengen entry point when traveling
         | from a non-Schengen country (Brazil) to a Schengen country
         | (France via Portugal). According to Schengen rules, travelers
         | must clear immigration at the first Schengen port of entry.
         | Since Paris is also within the Schengen Area, no additional
         | immigration checks are required upon arrival in Paris."
        
       | CobrastanJorji wrote:
       | Etymological fun: both "mistral" and "magistral" mean "masterly."
       | 
       | Mistral comes from Occitan for masterly, although today as far as
       | I know it's only used in English when talking about mediterranean
       | winds.
       | 
       | Magistral is just the adjective form of "magister," so "like a
       | master."
       | 
       | If you want to make a few bucks, maybe look up some more obscure
       | synonyms for masterly and pick up the domain names.
        
         | snakeboy wrote:
         | > as far as I know it's only used in English when talking about
         | mediterranean winds.
         | 
         | It's a French company, and "mistral" has this usage in French
         | as well. Also, "magistral" is just the french translation of
         | "masterful".
        
       | mark_l_watson wrote:
       | Nice, and I see that Ollama already has the smaller 24B version.
       | I am traveling with just a mobile device so I have to wait to try
       | it, but I have been using their new devstral coding model and it
       | is very useful, given that it is also a locally run model so I
       | looking forward to trying magistral.
        
       | RandyOrion wrote:
       | Below are my comments on Magistral small (not medium).
       | 
       | 24B size is good for local inference.
       | 
       | As a model outputting long "reasoning" traces (~10k tokens), 40k
       | context length is a little concerning.
       | 
       | Where are the results of normal benchmarks, e.g., MMLU/pro,
       | IFEval and such.
       | 
       | Still, thank you Mistral team for releasing this model with
       | Apache 2.0.
        
       | hijkzzz wrote:
       | The RL algorithm used in Magistral is the same as the
       | Reinforce++-baseline in OpenRLHF.
        
       | FabHK wrote:
       | So, is it accessible in Le Chat?
        
         | Agraillo wrote:
         | From the release "..You can try out a preview version of
         | Magistral Medium in Le Chat..", I suppose it's when the drop
         | down in "Thinking" mode is either slow or fast (limited to 3
         | queries per day).
         | 
         | My favorite from the last months was asking for a string that
         | for base64 produces strings with non-alphanumeric and non-
         | padding symbols (so '+' or '/' should be in the output). It
         | thought for 7 minutes and 74k of markdown length, and finally
         | came up with the AB?C string that produces QUI/Qw== (correct).
         | It is impressive, because general LLMs just always fail, but I
         | didn't try other "thinking" models recently.
        
       | openplatypus wrote:
       | Ah yes, the circle jerk of HN focuses not on technology or news
       | but how "Europe falls behind". Mods are silent as always.
        
         | 7bit wrote:
         | What do you want the mods to do?
        
       | CMay wrote:
       | One immediate observation I have about this model is that it
       | seems to do a better job of filtering out or toning down some
       | ideological disinformation that other models regurgitate from
       | activist controlled Wikipedia articles, at least for a few I've
       | checked. Previously you had to write your own sanity-check
       | prompts to get the model to do extra up-front work to validate
       | the logical and historical accuracy of things before it spits out
       | what it thinks is the most popular answer.
       | 
       | With this, at least it seems like some of that work was done
       | upfront or the thinking is tuned to avoid those issues, because
       | it's giving me similar conclusions to a sanity-checked prompt.
       | Heck, even Google Gemini and ChatGPT were spitting that stuff
       | out, where this one is giving me a reasonable response. So in
       | that regard, big thumbs up to the Mistral team if they did any
       | specific work in that area. It's something I cared about that I
       | was getting concerned nobody else cared about enough to fix.
        
         | andsoitis wrote:
         | What's an example prompt and sanitized prompt you use to
         | evaluate?
        
           | CMay wrote:
           | Not going to leak my tests, but here's how you can create
           | your own.
           | 
           | - Think up a topic that's interesting to you, yet maybe
           | controversial.
           | 
           | - Look up primary sources and empirical information about it.
           | 
           | - Then look at a relevant Wikipedia article about it to see
           | if the way the Wikipedia article frames it is honestly and
           | faithfully justified by the primary sources and empirical
           | data about it.
           | 
           | If the article seems to have a strong bias or critically
           | misrepresent the reality even if it does so by stating true
           | things, you have a juicy nugget on your hands.
           | 
           | Ask any given LLM about that topic and see if it regurgitates
           | the opinion in the Wikipedia article. If it does, then
           | develop your own prompt that requires the LLM to go down a
           | checklist of things that help resolve warped logic without
           | specifically trying to shape the output to your own
           | preference. Now find other articles and see how well your
           | checklist generalizes.
           | 
           | How well this works depends on how good the model you're
           | using is at instruction following.
           | 
           | A lot of what thinking models do is expand the context around
           | a topic to hopefully improve final prediction. To assist
           | that, you have to encourage the LLM to be hesitant to form an
           | opinion or decide on the conclusion before the end, otherwise
           | it can start with a conclusion and spend the rest of the time
           | supporting a weak conclusion rather than arriving at a
           | stronger one after new information emerges.
           | 
           | The danger is that reasoning models will state early on in
           | their reasoning some ideological fact the same way it might
           | say, "well i know that 1+1=2, so that means X", when in
           | reality a particular fact does not stand up to scrutiny. Then
           | it gets lost in a loop thinking ideologically, which can help
           | propagate these things through language models which is
           | dangerous.
           | 
           | Ideally all ingested Wikipedia gets evaluated against some
           | levels of ground truth before getting trained on to start
           | with, but then it's harder to keep up to date with it. Until
           | then we have to help LLMs handle these cases better.
        
       | megalomanu wrote:
       | We just tested magistral-medium as a replacement for o4-mini in a
       | user-facing feature that relies on JSON generation, where speed
       | is critical. Depending on the complexity of the JSON, o4-mini
       | runs ranged from 50 to 70 seconds. In our initial tests, Mistral
       | returned results in 34-37 seconds. The output quality was
       | slightly lower but still remain acceptable for us. We'll continue
       | testing, but the early results are promising. I'm glad to see
       | Mistral prioritizing speed over raw power, there's definitely a
       | need for that.
        
         | nbardy wrote:
         | I bet you can close the gap with a finetune.
         | 
         | Should be quiet easy if you have some o4-mini results sitting
         | around.
        
         | kamranjon wrote:
         | I am curious why you would choose a reasoning model for JSON
         | generation?
         | 
         | I was recently working on a user facing feature using self-
         | hosted Gemma 27b with VLLM and was getting fully formed JSON
         | results in ~7 seconds (even that I would like to optimize
         | further) - obviously the size of the JSON is important but I'd
         | never use a reasoning model for this because they're constantly
         | circling and just wasting compute.
         | 
         | I haven't really found a super convincing use-case for
         | reasoning models yet, other than a chat style interface or an
         | assistant to bounce ideas off of.
        
           | megalomanu wrote:
           | It is for generating a big nested JSON, quite complex from a
           | business standpoint (lots of different business concepts). We
           | didn't have good results with simple models.
        
       | emilyharrison wrote:
       | Nice job!
        
       | hst-001 wrote:
       | good
        
       ___________________________________________________________________
       (page generated 2025-06-11 23:01 UTC)