The agency, along with the FBI, is investigating Tuesday's armed robbery at Wells Fargo, which is offering a $5,000 reward for information leading to the suspect's arrest.
The suspect is described as a white male who stands between 5'9 and 6 feet tall and weighs between 175 and 190 pounds.
Alpharetta police believe the suspect on Tuesday entered the bank at 12460 Crabapple Road, "produced a silver-colored firearm" and demanded employees hand over money.
The man, who police say left on foot, was wearing a dark Harley Davidson T-shirt, blue jeans, a dark cap and sunglasses.
He was believed to be wearing the same shirt when he allegedly tried to rob CVS, located at 12070 Crabapple Road in Roswell on Monday.
The Roswell Police Department wrote on its Facebook page that the man "brandished" a weapon and tried to rob the store, but was not successful.
Anyone who wishes to report what he or she knows regarding the location and/or identity of the suspect can remain anonymous by calling Alpharetta's tip line at (678) 297-6307 or contact Detective Jakai Braithwaite at (678) 297-6322.
Roswell police detective Joe Ruff can be reached at (770) 640-4494.