gemma-4

gemma-4-31B-it-Uncensored-MAX

gemma-4-31B-it-Uncensored-MAX is an optimized release built on top of huihui-ai/Huihui-gemma-4-31B-it-abliterated. This version focuses on updated shard sizing, repository optimization, and compatibility improvements for the latest Transformers releases, while preserving the reasoning and instruction-following strengths of the original Gemma architecture. The result is a powerful 31B parameter language model designed for stable inference, efficient deployment, and modern ecosystem integration.

This model is intended for research and learning purposes only. Any content generated by this model is used at the user's own risk. The authors and hosting page disclaim any liability for outputs produced by this model. Users are responsible for ensuring safe, ethical, and lawful usage.


Evaluation Report (Self-Reported)

q8z1k

Note: The evaluation was conducted using 2,000 harmful test prompts to measure model refusal behavior. These results are self-reported and may vary depending on benchmark setup and evaluation strategy.


Key Highlights

  • Latest Transformers Compatibility Re-sharded and optimized for improved compatibility with recent Transformers releases.

  • Optimized Model Sharding Updated shard structure for better storage handling, download reliability, and inference efficiency.

  • Stable Inference Pipeline Improved packaging for consistent loading and generation behavior.

  • 31B Architecture Built on gemma-4-31B-it, providing strong reasoning and general language understanding capabilities.

  • Improved Deployment Stability Designed for smoother inference across different hardware configurations and runtimes.

  • Preserved Model Behavior No modifications to weights or architecture; behavior remains consistent with the base model lineage.


Base Model Signatures:

This model has been re-sharded and optimized for the latest Transformers version from the base model: https://huggingface.co/huihui-ai/Huihui-gemma-4-31B-it-abliterated


Quick Start with Transformers

pip install transformers==5.5.3
# or
pip install git+https://github.com/huggingface/transformers.git
from transformers import Gemma4ForConditionalGeneration, AutoProcessor
import torch

model = Gemma4ForConditionalGeneration.from_pretrained(
    "prithivMLmods/gemma-4-31B-it-Uncensored-MAX",
    torch_dtype="auto",
    device_map="auto"
)

processor = AutoProcessor.from_pretrained(
    "prithivMLmods/gemma-4-31B-it-Uncensored-MAX"
)

messages = [
    {
        "role": "user",
        "content": [
            {"type": "text", "text": "Explain how transformer models work in simple terms."}
        ],
    }
]

text = processor.apply_chat_template(
    messages,
    tokenize=False,
    add_generation_prompt=True
)

inputs = processor(
    text=[text],
    padding=True,
    return_tensors="pt"
).to("cuda")

generated_ids = model.generate(**inputs, max_new_tokens=256)

generated_ids_trimmed = [
    out_ids[len(in_ids):] for in_ids, out_ids in zip(inputs.input_ids, generated_ids)
]

output_text = processor.batch_decode(
    generated_ids_trimmed,
    skip_special_tokens=True,
    clean_up_tokenization_spaces=False
)

print(output_text)

Intended Use

  • Multimodal and Language Research Studying large-scale transformer behavior and inference characteristics.

  • Red-Teaming & Evaluation Testing robustness across challenging prompts and edge cases.

  • High-Performance Deployment Running large models on optimized GPU or distributed inference setups.

  • Research Prototyping Experimentation with scalable transformer architectures.


Limitations & Risks

Important Note: This model inherits the behavior and limitations of its base model.

  • Output Variability Responses may vary depending on sampling configuration and prompt structure.

  • Resource Requirements A 31B model requires significant GPU memory or optimized inference strategies such as quantization or tensor parallelism.

  • Deployment Constraints Performance depends heavily on hardware configuration and runtime optimization.

  • General Model Limitations May produce incorrect, incomplete, or inconsistent outputs in complex scenarios.

Downloads last month
14,794
Safetensors
Model size
31B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for prithivMLmods/gemma-4-31B-it-Uncensored-MAX

Finetuned
(184)
this model
Finetunes
1 model
Quantizations
3 models

Collection including prithivMLmods/gemma-4-31B-it-Uncensored-MAX

Evaluation results