Advocates gathered on the steps of City Hall Tuesday as part of the national "Equal Pay Day."
They cited statistics that show women make 77 percent as much as a man for the same job in the U.S.
That number is higher in the city, but City Council Speaker Melissa Mark-Viverito said it's still unacceptable.
She also said there's more the state can do to bridge the gap.
"We believe that we should be able to raise our own wage, considering the cost of living here in New York, considering the reality that the largest number of jobs that are growing and impacts women, in particular, are low-wage jobs," Mark-Viverito said. "The cost of living in New York, you cannot survive here on minimum wage."
The rally comes as a new study from the city comptroller's office finds similar discrepancies.
It does, however, have better news that women in the city under the age of 35 are earning 96 cents for every dollar young men earn.
Meanwhile, President Barack Obama is also tackling the issue of pay inequality.
He spoke Tuesday about steps being taken while signing two executive orders.
One would direct the Labor Department to come up with new rules to require federal contractors to provide pay data that includes a breakdown by gender and race.
The other bans government contractors from retaliating against employees who discuss pay with their co-workers.
Obama said more needs to be done on the federal level to even the playing field.
"A woman's got to work about three more months in order to get what a man's got," Obama said. "But it's not a myth. It's math. You can look at the paychecks. You can look at the stubs."
The issue is expected to make its way to Capitol Hill this week, as the Senate is set to take up legislation that would make it easier for workers to sue companies for paying women less than men because of gender.