Well since you don't use it so often it doesn't matter whether you have it left running or not. Because this process doesn't hog all your memory resources even if it is left running. So if you don't use it then you can get rid of it, but it won't make a lot of difference though.

Basically what to want to get rid of is programs like Quicktime (if you have it on your computer) and so on that automatically start up, even if you don't want it to. And when you get rid of programs like this, your start up is surely going to get faster.