Agilent chem station software starting with E02.02 has a bake out macro. We use it after source cleaning.
As Peter said, it will do nothing for the nitrogen if you have a leak. I monitor M/Z 28 with the calibration valve closed, if it is <25000 counts, I feel there is no leak.
I use this on our Agilent systems and it will help lower N2 a little more quickly if you are putting in new insulators or something like that which has never been under vacuum before, but pumping down over a weekend will also have the same effect. Heating it up just helps it desorb faster. It helps most with water contamination and can remove some buildup of sample residues to give you a little more run time between source cleanings.
In the N2 is constantly high, they you have a leak. If N2, O2 and CO2 are high it could be a leak at the analyzer or column fitting, if the O2 and CO2 are low, but N2 high then could be in gas line before any gas traps, which should remove everything but N2. Also if your helium tank is down to the last 500psi you can see N2 begin to increase as it settles to the bottom of gas cylinders and becomes more concentrated in the mix as you remove Helium especially down at the very last of the tank.