actually, aforetime, before, before now, beforetime, certainly, earlier, erenow, erewhile, erst, factually, formerly, forsooth, heretofore, hitherto, in fact, in reality, in the past, in times past, in truth, in very sooth, indeed, indeedy, nothing else but, of a truth, only yesterday, prehistorically, previously, priorly, really, really-truly, recently, then, truly, undoubtedly, verily, veritably, whilom, with truth, yesterday

For further exploring for "historically" in Webster Dictionary Online