Would ingesting a tablespoon or two of sugar slowly over a day, for ten years, cause my metabolism to slow ...?

...or to speed up? Doesent sugar mess with insulin production and other stuff on a chemical level in the glands and such? How would it effect the figure, even if there are no excess daily calories from it...would it speed or slow the basal metabolism? I've been drinking coffee with cream and sugar daily for years now...I sip slowly, long after the coffee is cold, lol!