FPS drop when in build fights

I average about 180 fps when in game but not fighting. If I’m fighting people like any sort of build fight I drop down to 40fps. Here are my specs:

CPU: Ryzen 3700x 8-Core Processor GPU: NVIDIA RTX 3060 SSD: WD Blue 3D NAND 1 TB Internal SSD RAM: G.SKILL Ripjaws V Series 32 GB Motherboard: MSI MPG X570 GAMING EDGE WIFI

I am also on performance mode, need help badly. Thanks.