what make is the replacement alternator? It sounds like you might have a dud.

(Even without an external supply via the warning light I have found that "Traditional" alternators will useually still come on charge if you give the engine a good hard rev.)