Issues

• 能否增加对qwen3的支持？或者如何在其他框架中使用（ada）lomo优化器？

  OpenMOSS/CoLLiE#191 · Filter by author LRC-bit opened on Jun 24, 2025
  7

• 如果想应用更多的模型，例如InstructBLIP，请问应该怎么修改呢？

  OpenMOSS/CoLLiE#181 · Filter by author Listever opened on May 20, 2024
  1

• lomo训练65b llama实测 Lomo is incompatible with pipeline parallelism

  OpenMOSS/CoLLiE#152 · Filter by author zlh1992 opened on Feb 4, 2024
  1

• 能否增加一个从头预训练的例子？

  help wanted
  OpenMOSS/CoLLiE#151 · Filter by author liujuncn opened on Jan 26, 2024
  1

• 支持 RLHF

  OpenMOSS/CoLLiE#145 · Filter by author KYLN24 opened on Dec 19, 2023

• 你好，怎么让保存的模型能够分片，而不是保存一个几十G的大模型

  enhancement
  OpenMOSS/CoLLiE#143 · Filter by author 459737087 opened on Dec 14, 2023
  2

• 关于 adalomo 没有 loss_scaler 只有 loss_scale 的问题

  OpenMOSS/CoLLiE#139 · Filter by author HappyLynn opened on Nov 29, 2023
  1

• chatGLM2 好像目前不支持ptuning训练，有计划什么时候支持么

  bug
  OpenMOSS/CoLLiE#136 · Filter by author BlueSkyyyyyy opened on Nov 15, 2023
  2

• AdaLomo optimizer step method

  OpenMOSS/CoLLiE#132 · Filter by author winglian opened on Oct 30, 2023
  3

• 使用数据类_ShardContainer遇到错误

  OpenMOSS/CoLLiE#123 · Filter by author xuguohai opened on Sep 21, 2023
  1

• How to convert parallel state_dict to normal state_dict?

  OpenMOSS/CoLLiE#122 · Filter by author JinchaoLove opened on Sep 18, 2023
  3

• [BUG] Evaluation 时使用并行可能不会完整地遍历一遍数据

  OpenMOSS/CoLLiE#119 · Filter by author KYLN24 opened on Sep 14, 2023
  1

  

• Could Lomo class support param_groups?

  OpenMOSS/CoLLiE#117 · Filter by author JinchaoLove opened on Sep 12, 2023
  

• Llama2 70B 训练报错

  OpenMOSS/CoLLiE#104 · Filter by author xiaopqr opened on Aug 14, 2023
  3

• tensor parallel + zero3 error

  help wanted
  OpenMOSS/CoLLiE#99 · Filter by author LZY-the-boys opened on Jul 31, 2023
  1

  

• Error： llama2 70B LlamaForCausalLM.from_pretrained 开启Zero3，会消耗大量内存导致 OOM

  bug
  OpenMOSS/CoLLiE#98 · Filter by author xiaopqr opened on Jul 31, 2023
  5

  

• Whether lr_scheduler for Lomo is implemented now?

  bug
  OpenMOSS/CoLLiE#93 · Filter by author DesperateExplorer opened on Jul 26, 2023
  4

  

• Support for LLaMA-2 70B with Grouped-Query Attention

  bug
  OpenMOSS/CoLLiE#91 · Filter by author kaiwang13 opened on Jul 21, 2023
  18

  

• llama-2-7b拓展词表报错

  bug
  OpenMOSS/CoLLiE#87 · Filter by author skepsun opened on Jul 19, 2023
  4

• deep_speed initialization for models in the transformers library

  help wanted
  OpenMOSS/CoLLiE#85 · Filter by author DesperateExplorer opened on Jul 19, 2023
  6