dmx.compressor.advanced_recipe.DmxSLaNCRecipe
- class dmx.compressor.advanced_recipe.DmxSLaNCRecipe(hp_gen, **kwargs)
SLaNC norm tuning for LayerNorm|RMSNorm recipe Paper: https://arxiv.org/abs/2410.10553
- __init__(hp_gen, **kwargs)
Methods
__init__(hp_gen, **kwargs)applied_to(_model[, save_checkpoint_to])