cpp_class() — pytorch Function Reference

Architecture documentation for the cpp_class() function in generate_kernels.py from the pytorch codebase.

Function python ComputeKernels QuantizedCPU calls 1 called by 1

Entity Profile

ComputeKernels→ QuantizedCPU→ cpp_class() — pytorch Function Reference

Dependency Diagram

graph TD
  a8e20f8a_af7c_0de9_f90c_676b733830c2["cpp_class()"]
  a19035f6_8189_b8f7_6a21_4dbaf2229779["cpp_class()"]
  a19035f6_8189_b8f7_6a21_4dbaf2229779 -->|calls| a8e20f8a_af7c_0de9_f90c_676b733830c2
  a19035f6_8189_b8f7_6a21_4dbaf2229779["cpp_class()"]
  a8e20f8a_af7c_0de9_f90c_676b733830c2 -->|calls| a19035f6_8189_b8f7_6a21_4dbaf2229779
  style a8e20f8a_af7c_0de9_f90c_676b733830c2 fill:#6366f1,stroke:#818cf8,color:#fff

Relationship Graph

Source Code

aten/src/ATen/native/transformers/cuda/mem_eff_attention/kernels/generate_kernels.py lines 87–100

    def cpp_class(self) -> str:
        template_args = ", ".join(
            [
                DTYPES[self.dtype],
                f"cutlass::arch::Sm{self.sm_range[0]}",
                "true" if self.aligned else "false",
                str(self.q),
                str(self.k),
                str(self.max_k),
                "true" if self.supports_dropout else "false",
                "true" if self.supports_bias else "false",
            ]
        )
        return f"AttentionKernel<{template_args}>"