I have significant noise from vial cap.
It is PTFE with silicon septa. I just tip off the septa and noise level goes down significantly.
Which vendor and which material you used for SPME without significant silicon noise.