dmx.compressor.advanced_recipe.DmxSLaNCRecipe

class dmx.compressor.advanced_recipe.DmxSLaNCRecipe(hp_gen, **kwargs)

SLaNC norm tuning for LayerNorm|RMSNorm recipe Paper: https://arxiv.org/abs/2410.10553

__init__(hp_gen, **kwargs)

Methods

__init__(hp_gen, **kwargs)

applied_to(_model[, save_checkpoint_to])