Module Name: {{currentModule}}
Peak memory allocation: {{peakHeapSizeMiB}} MiB, {{totalBufferAllocationMiB}} MiB (with fragmentation)
{{paddingOverhead}} MiB total padding overhead
{{totalArgumentSizeBytes}} MiB total argument size
{{hloTempSizeWithoutFragmentationMiB}} MiB stack simulated HLO temporary variables
{{hloTempSizeWithFragmentationMiB}} MiB HLO lifetime temporary variables with fragmentation (fragmentation {{hloTempFragmentation}}%)
{{maxScopedVmemAllocationMiB}} MiB max scoped VMEM allocation ({{maxScopedVmemInstructionName}})
Modifying your model's architecture, batch size and data dimensions may help reduce the memory footprint.

Buffer Allocation Timeline

HLO Ops at Peak Memory Allocation Time

There is no data to display.
Show Source Code info