KansenSakura-Symbiosis-12B

You know how in some video games your starting gear or character can get a huge upgrade if you bring it all the way to the end of the game? This is sort of like that.

Experimental. Use at your own risk.

GGUF:

Standard
Q6_K_XL

Merge Details

Merge Method

This model was merged using the Multi-SLERP merge method using Retreatcost/KansenSakura-Zero-RP-12b as a base.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: Retreatcost/KansenSakura-Eclipse-RP-12b
    parameters:
      weight: 0.5
  - model: Retreatcost/KansenSakura-Radiance-RP-12b
    parameters:
      weight: 0.5
  - model: Retreatcost/KansenSakura-Erosion-RP-12b
    parameters:
      weight: 0.5
base_model: Retreatcost/KansenSakura-Zero-RP-12b
merge_method: multislerp
tokenizer:
  source: base
chat_template: chatml
parameters:
  normalize: true
dtype: bfloat16