Skip to content

qwen27 CUDA: pack weight tensors into 128 MiB blocks (~1 GiB back on a 24 GB card) - #5

Closed
CanadaApollo6 wants to merge 1 commit into
machinegenieorg:see-4347-qwen27-cudafrom
CanadaApollo6:qwen27-weight-pool
Closed

qwen27 CUDA: pack weight tensors into 128 MiB blocks (~1 GiB back on a 24 GB card)#5
CanadaApollo6 wants to merge 1 commit into
machinegenieorg:see-4347-qwen27-cudafrom
CanadaApollo6:qwen27-weight-pool

qwen27 CUDA: weight tensors packed into 128 MiB blocks, not one cuMem…

549653b
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs