Bug Editor stutters after being open for a few minutes

I'm not sure if this only happens to me but I assume it doesn't.
Few minutes after opening unity, the editor starts to stutter for a few seconds every 5 to 10 seconds.
Sometimes it freezes for a second and sometimes for 5 or more.

I have an i5-9400f and 16gb so I'm confident the issue is not related to my setup. ( I'm also not running out of ram when this happens )

A quick fix seems to be changing the script editor in prefences. Not sure how it's related, but it stops the freezing momentarily before it happens again a few minutes later.

Is this a common thing? If so, It really has to be sorted out I think

EDIT:
There's no background task such as light baking or occlusion baking running. It doesn't matter the scene is empty or full of objects, and the longer the stutters the unbareable the experience is as any input made during the sttuters isn't read. ( Thus resulting in buttons no being pressed etc )

 

Is it busy doing anything, like lightmap baking?

 

nope it's completely idle. Happens in empty scenes, in play mode, anywhere.
At its worst, it becomes impossible to press buttons and link nodes in shader graph because any input during the stutter isn't read.

 

Here's a video that showcases the issue

 

Does it still happen when you create a new, fresh project?

 

It starts happening after a while. The one in the video is actually freshly made and doesn't have any extra plugins installed