Hello! Thank you for finding my code useful! I have a question though. Does your code also calculate the FLOPS of a Transformer model that you have coded yourself? For example, some FLOPS calculation codes do not include the matmul part in the Transformer model.
Hello! Thank you for finding my code useful! I have a question though. Does your code also calculate the FLOPS of a Transformer model that you have coded yourself? For example, some FLOPS calculation codes do not include the matmul part in the Transformer model.