Skip to content

Issues: hpcaitech/ColossalAI

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

405 Open 1,268 Closed
405 Open 1,268 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[FEATURE]: Consider integrating the pretraining process of the llama3-405B model？ enhancement New feature or request
#6170 opened Dec 25, 2024 by JiadiLee
[BUG]: RuntimeError: mat1 and mat2 must have the same dtype, but got Float and BFloat16 bug Something isn't working
#6169 opened Dec 25, 2024 by balcklive
1 task done
[BUG]: Size Mismatch Issue When Loading Model Checkpoints Trained with Tensor Parallel if vocab_size % tp_size != 0 bug Something isn't working
#6167 opened Dec 24, 2024 by Lemon-412
1 task done
1
2
Hybrid Parallel Plugin下TP显存比同配置下deepspeed要高？？？
#6161 opened Dec 17, 2024 by duomicoding
3
[BUG]: Gemini saved an additional portion of the weights while using tie_word_embeddings=True bug Something isn't working
#6160 opened Dec 13, 2024 by ericxsun
1 task done
update shardformer for transformers=4.46
#6157 opened Dec 10, 2024 by duomicoding
[FEATURE]: Lora/QLora in GeminiPlugin and TorchFSDP enhancement New feature or request
#6138 opened Nov 16, 2024 by ericxsun
1
[FEATURE]: support google/gemma-2-2b for Tensor Parallelism enhancement New feature or request
#6120 opened Nov 9, 2024 by jing-4369
2
[BUG]: ColossalAI Inference example response empty result without error bug Something isn't working
#6112 opened Nov 4, 2024 by GuangyaoZhang
1 task done
@ver217
2
[BUG]: why duplicate PID appears on rank 0 bug Something isn't working
#6111 opened Nov 3, 2024 by ericxsun
1 task done
3
[BUG]: Llama3.1 HybridParallelPlugin train failed when pp_size>1 bug Something isn't working
#6110 opened Nov 2, 2024 by cingtiye
1 task done
17
[PROPOSAL]: FP8 with block-wise amax enhancement New feature or request
#6105 opened Oct 28, 2024 by Edenzzzz
1 task
[FEATURE]: Windows wheel needed enhancement New feature or request
#6103 opened Oct 27, 2024 by nitinmukesh
[BUG]: weird stuck while training bug Something isn't working
#6095 opened Oct 19, 2024 by ericxsun
1 task done
@ver217
8
[BUG]: Got nan during backward with zero2 bug Something isn't working
#6091 opened Oct 16, 2024 by flymin
1 task done
@ver217 @botbw
9
[BUG]: Unable to train on H20 machine bug Something isn't working
#6079 opened Oct 6, 2024 by kaixinbear
1 task done
1
FasterMoE shadow expert implement
#6076 opened Sep 29, 2024 by Guodanding
1
[DOC]: 环境安装失败 documentation Improvements or additions to documentation
#6066 opened Sep 21, 2024 by eccct
16
[FEATURE]: Is it Possible to integrate Liger-Kernel? enhancement New feature or request
#6047 opened Sep 6, 2024 by ericxsun
@ver217
7
[BUG]: remove .github/workflows/submodule.yml bug Something isn't working
#6039 opened Aug 28, 2024 by BoxiangW
1 task done
[FEATURE]: Support Zerobubble pipeline enhancement New feature or request
#6037 opened Aug 28, 2024 by duanjunwen
[BUG]: errror Colossalai 0.4.0/0.4.2 /usr/bin/supervisord bug Something isn't working
#6032 opened Aug 23, 2024 by Storm0921
1 task done
2
[BUG]: AttributeError: 'GeminiDDP' object has no attribute 'module' bug Something isn't working
#6021 opened Aug 20, 2024 by dheerj188
1 task done
1
[BUG]: Torch compile causes multi-process to hang with python 3.9 bug Something isn't working
#5987 opened Aug 10, 2024 by Edenzzzz
1 task done
[FEATURE]: How to skip a custom node from generating strategies in colossal-auto? enhancement New feature or request
#5983 opened Aug 8, 2024 by robotsp
ProTip! Type g i on any issue or pull request to go back to the issue listing page.