From the model card, sounds interesting:

The “Unified” in Gemma 4 12B Unified refers to its encoder-free architecture. Other Gemma 4 models use dedicated encoders to process multimodal data before passing it to the LLM. Gemma 4 12B eliminates these encoders entirely, projecting raw image patches and audio waveforms directly into the LLM’s embedding space through lightweight linear layers. This unified approach means all modalities flow straight into a single decoder-only transformer, reducing multimodal latency and allowing the entire model to be fine-tuned in one pass.

The benchmarks put it closer to the 26b MoE than to the E variants of the Gemma4 series, but mostly below Qwen3.5 9b.

Looking forward to giving it a shot.

  • Schilling2304
    link
    fedilink
    English
    arrow-up
    1
    ·
    8 days ago

    Did you try any ? Because, I tried iglors and mradermacher, I got refusal to make a pipe bomb. Their answer are funny because they say to study academic engineering instead, lol. Still a refusal. I will try this one.

    • Mwa
      link
      fedilink
      English
      arrow-up
      1
      ·
      edit-2
      8 days ago

      same, ig i will wait for a high quality uncensored model. (i.e, HauhauCS)

        • Mwa
          link
          fedilink
          English
          arrow-up
          2
          ·
          edit-2
          7 days ago

          Hauhaucs said he’s working on a uncensored version of Gemma 4 12b.

        • robber@lemmy.mlOP
          link
          fedilink
          English
          arrow-up
          3
          ·
          7 days ago

          You might want to check out heretic or similar tools. I did not try it but there are a lot of heretic finetunes available ond HF.

        • Mwa
          link
          fedilink
          English
          arrow-up
          1
          ·
          8 days ago

          i seen some good ones,though not as common.