impl_group() — pytorch Function Reference

Architecture documentation for the impl_group() function in generate_kernels.py from the pytorch codebase.

Function python ComputeKernels QuantizedCPU calls 1 called by 1

Entity Profile

ComputeKernels→ QuantizedCPU→ impl_group() — pytorch Function Reference

Dependency Diagram

graph TD
  da9f1d69_6a83_0980_5c2d_53bb3275c796["impl_group()"]
  64aa982a_0123_4197_c44d_853e324346a3["impl_group()"]
  64aa982a_0123_4197_c44d_853e324346a3 -->|calls| da9f1d69_6a83_0980_5c2d_53bb3275c796
  64aa982a_0123_4197_c44d_853e324346a3["impl_group()"]
  da9f1d69_6a83_0980_5c2d_53bb3275c796 -->|calls| 64aa982a_0123_4197_c44d_853e324346a3
  style da9f1d69_6a83_0980_5c2d_53bb3275c796 fill:#6366f1,stroke:#818cf8,color:#fff

Relationship Graph

Source Code

aten/src/ATen/native/transformers/cuda/mem_eff_attention/kernels/generate_kernels.py lines 211–214

    def impl_group(self) -> str:
        # Maps to file which will contain the implementation
        dropout_suffix = "_dropout" if self.apply_dropout else ""
        return f"{self.dtype}_{self._aligned_suffix}_k{self.max_k}{dropout_suffix}"