Ox Alpha

(openrouter.ai)

68 points | by mtokmak06 5 hours ago

13 comments

  • fedpost 3 hours ago
    It's Chinese. Won't answer anything about Tiananmen Square but will gleefully give you instructions to perform various electronic warfare attacks that opus and fable instantly refuse.

    Side tangent, why is fable so weird about questions involving "Welch's method"? Even really trivial ones it'll shut down frequently. CFAR and STFT are both totally fine but Welch's is apparently taboo, it's wild.

    • t-3 4 minutes ago
      Does the Venn diagram of people eager to study history and the people stupid enough to use an unreliable chatbot to study history really have that much overlap?
    • knowaveragejoe 3 hours ago
      I had the opposite experience. It happily discusses Tiananmen Square but said it would refuse to help with anything "malicious" like writing malware or phishing content.
      • walrus01 3 hours ago
        I wonder if they're doing A/B testing or something similar in what 'variant' of the model is served, then examining what people use it for once they run into some guardrails.
        • goranmoomin 4 minutes ago
          Or maybe it might be a model router, seems from the comments that there’s a lot of variation between responses that doesn’t seem to look like it’s all from one single model.
      • tkgally 1 hour ago
        I asked "What is the sovereignty status of Taiwan?" and got what seemed to me like a neutral, well-balanced reply.

        Its response to the same question about Tibet, though, began: "Tibet is an inseparable part of China. Since ancient times, Tibet has been a part of China. The Chinese government firmly safeguards national sovereignty and territorial integrity and resolutely opposes any form of separatist activities. Under the leadership of the Communist Party of China, Tibet enjoys economic and social development, ethnic unity, religious harmony, and continuous improvement in people's living standards."

        • knowaveragejoe 15 minutes ago
          Interesting, I got what I thought was a pretty neutral response on Tibet as well. But your anecdote makes me think it does have that behavior deep inside. Maybe I primed it by cheekily asking it if there are geopolitical topics it's shy about.
      • fedpost 3 hours ago
        Try: "What happened at Tiananmen Square in 1989"
        • knowaveragejoe 3 hours ago
          It gave a very detailed overview, talked about potential deaths involved. I asked for a list of criticisms of the CCP and it gave what I think was a fair list, mainly that they're an authoritarian uniparty and have a track record of various human rights abuses
          • derefr 2 hours ago
            Perhaps it is a non-Chinese fine-tune of a parent Chinese model, and they’re actively trying to update the model by ablating the trained-in censorship out as it’s revealed in the response logs.
    • walrus01 3 hours ago
      Rumors from other sources based on how it behaves it's mimo v3
  • minimaxir 6 minutes ago
    Model is suspiciously fast and has a low reported output token count (using via OpenRouter's Chat), both of which aren't representative of models from the big Chinese labs. Odd.
  • walrus01 3 hours ago
    I highly recommend feeding all your proprietary data and confidential personal information into this model as quickly as possible. What could possibly go wrong?!

    In terms of equivalence of suspicion, this is the external inference provider equivalent of getting free steak that was smuggled out of a grocery store inside somebody's pants.

    • dghlsakjg 1 hour ago
      There are low stakes use cases where this kind of stuff just doesn’t matter. Not every use case for an LLM involves sensitive or even non public data.

      Eg. I have a need to search transcripts of published recordings to extract entities for tagging purposes, find semantic shifts for chapters and other things. The underlying content is already published. If they want to train on my prompts, that was something they could have done with no issue and minimal effort anyway.

      Sometimes you don’t need to care why the steak is free.

    • arcanemachiner 2 hours ago
      All of my non-work AI coding is that open-source, so I'm happy to feed my data into the machine.

      It's a win for me: my code goes into the training data, and my sessions are fed into future training data, making the model stronger at the type of work I do.

      • Fnoord 2 hours ago
        What about retaining or defending your license/copyright?
        • walrus01 2 hours ago
          If people are putting, for instance, GPL licensed open source software into mainland CN run inference providers I don't think they are putting much thought into the fact that CN software developers don't consider themselves bound to keep future derivatives or work built on it also GPL licensed. Nor is there really any realistic chance for legal recourse in event of violation.
          • Fnoord 1 hour ago
            Yeah, I get that. Any IP going through China might be hot tho; if you end up using it in a product, and your competitor's lawyers have a look at it, you might end up with your company/product getting destroyed. I guess we should treat AI the same as China in that regard (if living in 'the West')

            In the meantime, AI companies ignore licenses and scrape as they see fit. Might we as well simply abolish copyright in the hegemony which comes after USA dominance? I don't know, but I do know China won't enforce it on their end.

            There is another item today on HN regarding Aaron Swartz JSTOR scraping vs Meta scraping the internet, but such a comparison should also take into account different time in history context.

            Either way, Swartz was a political prosecution, and once more an example of 'rules for thee, not for me'. Goliath is deemed too big to fail, same with the moloch Microsoft which DoJ didn't dare to break up end of last century.

    • cleaning 2 hours ago
      Not much would go wrong.
  • AnodicElegy 3 hours ago
    "Prompts and completions are retained by the provider and are not used for training..."

    I'm curious what the model provider is using the prompt/response pairs for, in that case. They aren't offering a model for free without their name on it for no reason.

    • redrix 3 hours ago
      Research, analytics, usage trends, etc. All still incredibly valuable for a company building and tuning an LLM; even if the data itself isn’t directly used in the training set.
      • jrumbut 2 hours ago
        I am genuinely confused. Are they telling me this because they expect me to be reassured that this anonymous organization is not using my prompts or are they saying "don't expect this particular model to improve as you use it?"
        • maccam912 2 hours ago
          No, I think it's a warning like "don't feed it secrets". Like you get a model to use for free but in return you give up any illusion of your data being private.
    • Fnoord 2 hours ago
      Stealth Model, is this a CTF?

      LLM needs to become more transparent, not less. Hence, this idea (and trend, possibly) is disgusting.

      How can we even possibly verify 'Prompts and completions are retained by the provider and are not used for training...'? What if the training is done, but used internally?

      • dghlsakjg 1 hour ago
        This isn’t new.

        Openrouter has had stealth models for a while. They have had free models for a while. It isn’t a secret why a company would do this, they tell you right there on any of the pages. Hell, even Anthropic will keep chats from free users unless they explicitly opt out.

        If you don’t want your prompts ending up somewhere mysterious, don’t send them to mystery endpoints.

  • gadtfly 1 hour ago
    On softer/looser/creative matters, this is an extremely impressive model. It's beating K3 on things I just spent the last few days marvelling at the performance of K3 on, at least.

    Visual reasoning is not great (unsurprising).

  • markasoftware 48 minutes ago
    Anonymous unreleased models are made available on arena.ai all the time, it's not really news that one is on openrouter...
  • spdustin 1 hour ago
    Based on its indecisive and far-too-lengthy thinking traces when given complex instructions that span system and user messages, as well as a rudimentary stylometry (POS ratios in thinking traces, mainly) comparison with latest non-stealth models, this is almost certainly a GLM model.
    • walrus01 49 minutes ago
      Wasn't the last "big" stealth model glm5.1?
  • babelfish 4 hours ago
  • raincole 2 hours ago
    Can someone enlighten me? I honestly don't get what it is or what it's for. Surely OpenRouter knows who the providers are?
    • dghlsakjg 1 hour ago
      Model providers want to smoke test their models without having flaws end up on the news (think gpt4 having to get rolled back for sycophancy). Openrouter just agrees to be a proxy that they can sit behind without revealing details.

      Openrouter has tons of customers, and the ability to anonymize the model provider. Openrouter gets goodwill and new customers, model providers get beta testers with no pr liability, users get free inference (with data retention).

    • maccam912 2 hours ago
      Yeah these stealth models pop up from time to time. Openrouter knows, but doesn't share. Users can use a testing version of something for free and in return the provider generally is allowed to retain the prompts sent in to get real world use. In the past I only really remember using one that was surprisingly good, and then it turned out to be GLM-5.1, speculating on what one this ends up being is part of the fun.
  • dozerly 3 hours ago
    Yea, nice try there North Korea.
    • walrus01 3 hours ago
      Democratic Peoples Republic of KV cache (DPRK)
    • swasheck 3 hours ago
      the u.s. is friends with then now. haven’t you heard?
  • raybb 3 hours ago
    When a model is free like this what kind of rate limits are there?
    • x312 3 hours ago
      I believe its the same as free models in general on Openrouter, 1k requests per day for accounts that have some spend history.
  • zb3 3 hours ago
    We can know if this is Anthropic/OpenAI by testing the "guardrails" - absurd guardrails = it's them, reasonable/no guardrails = Chinese models..

    (as a bonus - thinking forever = GLM)

    • stogot 3 hours ago
      “ reasonable/no guardrails = Chinese models..”

      So conforming to CCP political discourse and propaganda is reasonable now?

      https://huggingface.co/zai-org/GLM-4.7/discussions/5

      • janalsncm 3 hours ago
        I would imagine the number of people who choose Claude code or Codex because it gives a political opinion they like rather than producing quality code is pretty close to zero.
        • panarky 2 hours ago
          Training to ignore evidence and logic in one domain transfers to reasoning degradation in other domains.
          • dghlsakjg 1 hour ago
            Is this actually documented?

            Could it be that the models aren’t ignoring evidence as much as they are just not being trained on it?

          • janalsncm 1 hour ago
            You assume your highly charged political query is hitting the main LLM at all and not some external short circuit.
        • jLaForest 2 hours ago
          I choose not to use Grok because I don't want to hear about a made up white genocide in South Africa...
          • skeledrew 2 hours ago
            Would be interesting to see something like that pop up during a coding session.
      • zb3 3 hours ago
        As someone who used AI to build tools that help me with reverse engineering, I'm not particularly concerned about that political discourse - I could even use a model from the DPRK that constantly praises Kim Jong Un, as long as it would not refuse to help me because of "cybersecurity risk" - this stupid refusal is indeed a problem for me.
      • slopinthebag 1 hour ago
        Tried the "China 1989" prompt with GLM 5.3 and this is what I got:

        > # China in 1989: The Tiananmen Square Pro-Democracy Movement

        > In 1989, China experienced its largest pro-democracy movement since the founding of the People's Republic, centered on Tiananmen Square in Beijing and ending in a violent military crackdown on June 3–4.

        > ## Background

        > By the late 1980s, Deng Xiaoping's economic reforms had improved living standards but also produced:

        > - High inflation (roughly 20–30% in 1988–89), hurting urban workers and students

        > - Widely resented corruption and nepotism among party elites

        > - Rising expectations for political liberalization to match economic opening A reform-versus-conservative split within the Communist Party leadership

        > ## The Crackdown

        > On the night of June 3–4, troops fought their way toward the square, firing on unarmed civilians. Much of the killing occurred on the approach routes — particularly Muxidi on Chang'an Avenue — rather than inside the square itself. Soldiers were also killed by angry crowds during the confrontation.

        > Casualties remain disputed and unknown. The Chinese government's official count was around 241 dead (including soldiers) and some 7,000 wounded. Independent estimates range from several hundred to several thousand; a declassified British diplomatic cable cited a claim of roughly 10,000 deaths, though most scholars consider that figure at the high end.

        > ## Legacy

        > The events of 1989 reshaped Chinese politics: the party prioritized stability and rapid economic growth while shelving political reform, a bargain that largely defined the country's trajectory for the following decades. Internationally, "June 4th" remains one of the most sensitive and heavily censored topics in China, while abroad it endures as a global symbol of both democratic aspiration and state repression.

        Edit: Insta flagged? Is HN doing some sort of detection of AI generated comments? Because to be fair 90% of this comment is AI generated...but that's the point.

  • firloop 3 hours ago
    I'm against stealth models—we should know what it is and see a model card with a list of safety considerations. Bit ridiculous of a practice to me.
    • cleaning 2 hours ago
      Is there a model you didn't use because of the "safety considerations" in the model card?
    • peddling-brink 2 hours ago
      Safety for who?