As details surrounding Assembly Speaker Sheldon Silver's arrest make their way across the city and state, New Yorkers living in his district and elected officials are voicing their thoughts as to whether he should stay or go.

Even with pages of evidence in front of them, it's tough to convince Democratic leaders in the state to turn away from the longtime leader.

Many top Democrats are either defending Silver or at least allowing him some time to explain himself. 

Silver surrendered to federal authorities Thursday on corruption charges.

He appeared in court where he was freed on $200,000 bond.

Silver did not enter a plea, but maintained his innocence outside court.

"I'm happy the issue is coming to be aired in the legal process and I am confident when all issues are aired I will be vindicated. Thank you," Silver said.

Silver is accused of taking nearly $4 million in bribes and kickbacks.

"It's a little premature. But I'm really disappointed after all these years of trusting him," noted one Manhattan resident.

Prosecutors say he covered up the payments by claiming they were "referral fees" from work as a personal injury lawyer.

U.S. Attorney Preet Bharara says Silver never did any legal work at all.

"For many years, New Yorkers have asked the question, 'How could Speaker Silver, one of the most powerful men in all of New York, earn millions of dollars in outside income without deeply compromising his ability to honestly serve his constituents?' Today we provide the answer. He didn't," Bharara said.

The five counts against Silver each carry a sentence of up to 20 years in prison.

Outside Silver's building, the tone from some of his neighbors was, at worse, understanding. Lou Blatt has lived in the building 60 years and says he knows Silver to be a "honest man."

A reference librarian at a law firm also came to Silver's defense and said the U.S. Attorney is overreaching. 

"Taking referral fees, that is okay in New York," he said. "I really don't understand what Preet Bharara is doing, it's frankly federal meddling in state politics. He should definitely not resign."

If convicted, Silver would have to resign from the Assembly.

Meantime, the city's top Democrat has rushed to Silver's defense.

Mayor Bill de Blasio considers Silver a major ally in Albany.

He has been a strong supporter of the mayor's agenda and was instrumental in securing funding for the expansion of universal pre-kindergarten. 

Speaking about the matter Thursday, the mayor rejected calls for Silver to step down. 

"Although the charges announced today are certainly very serious, I want to not that I have always known Shelly Silver to be a man of integrity, he certainly has due process rights and I think it's important to let the judicial process play out here," De Blasio said.

Governor Andrew Cuomo did not defend Silver but held off on saying whether Silver should step down.

He later told the Daily News the situation is a bad reflection on government.