Hundreds of supporters and opponents of a proposed Islamic center and mosque near the World Trade Center site voiced their opinions Sunday on the streets of Lower Manhattan.

Both groups held competing rallies for and against the $100 million project planned at 45 Park Place.

While the two groups gathered blocks from each other, police ramped up their presence and tried to keep the rallies separate and peaceful.

At the rally against the center, some rode motorcycles while others draped themselves in the American flag. They say the project is insensitive to the families of September 11th victims.

"That's what they're building for the terrorists, it's a trophy for them. Since they you know, a memorial right next to the 9/11 memorial," said one opponent.

"What this is is just a slap in the face. It's a monument to their one terror success day in this country and it's cost so many hundreds of thousands of lives -- Muslims, American soldiers, as a result of that one day," said another.

Protesters also raised questions about Imam Feisal Abdul Rauf, who is spearheading the project. They say the imam -- who is on a two-week U.S. State Department sponsored trip to the Middle East -- has not been open about where the financing for the project is coming from.

Many who spoke with NY1 say they believe Muslims are free to build a mosque anywhere they want, just not so close to what many consider sacred land.

Supporters, however, say the project needs to go forward as a sign of America's support for religious freedom.

"They should be trying to put, to take away other people's freedom of religion, it's guaranteed to them under the First Amendment," said one mosque supporter.

"It's intolerance. It's pandering to popular belief and people speaking very loudly. It doesn't account for any kind of education or thought," said another.

Debate over the plan took a national turn when President Barack Obama weighed in on the subject last weekend, saying Muslims have the right to build on land they own.

Mayor Michael Bloomberg -- who supports the plan -- later praised the president for his comments.

Meanwhile, Governor David Paterson continues to hold out hope that an alternative site for the mosque could be worked out.

The developers insist they have no plans to relocate, but Paterson says he still wants to meet with them about the possibility.

The governor said the World Trade Center site is hallowed ground, and should be treated with special consideration and sensitivity.

"Whatever reasons people may have to oppose this -- there are always bigoted people who will oppose things. But leaving them out there is a sizable population that is really just reacting to the whole spectacle of this situation," said the governor.

Paterson also said local politicians who support the site are thinking "clinically" by focusing on the fact that the developers have every right to build there, and disregarding its emotional impact.