PORT HOPE, Ont. - A day after an anti-nuclear activist warned radioactive waste has contaminated beaches and water in Port Hope, many in the community fear her speech may have tarnished the historic Ontario town's image.

On Tuesday, Dr. Helen Caldicott told a large crowd at a nearby Oshawa hotel that radioactive waste is leaking into Lake Ontario and, in time, will get into the town's food and water supply, and cause epidemics of cancer and genetic disease.

She even suggested people should flee the area.

But some people in the town said on Wednesday that Caldicott's remarks have tainted the picturesque community, a popular tourist spot just an hour outside of Toronto.

"Those comments are really unfounded," said Mayor Linda Thompson, after reviewing the notes from Caldicott's speech.

"Our community has taken on this issue head on and has for over 30 years. They've identified the issue. They've been proactive in dealing with the issue," she said.

Atomic Energy Canada Ltd. has begun a project to dig up buried radioactive waste in the town -- the product of years of radium and uranium refining at the Cameco refinery.

Thompson said Caldicott's speech has already begun to affect the community. Real estate agents worry that deals will fall through and people will cancel showings.

She also fears Caldicott's warnings will stop bus tours from coming to the town.

David Maksymuik, the owner of the Hillcrest Inn and Spa in Port Hope said he's concerned for business.

"(The comments) are negative to tourism, to the area we're in and to attracting tourism," said Maksymuik.

Stephen Hodge, a realtor with Chestnut Park in Port Hope, said he's already cancelled his winter vacation, fearing he won't be able to afford it as he anticipates a backlash.

"It is going to slow down real estate sales in Port Hope for a short period of time, and I think that's unfortunate because it's like throwing the community under the bus that you came in on," said Hodge about Caldicott.

While not opposed to a discussion on the issue of radioactive waste in the area, Hodge said he disagreed with the hyperbolic way in which the topic was tackled.

"A speaker like this comes along and make it sound as though we're swimming in barrels of toxic muck everyday, and it's just not true," he said.

"We're all aware that low-level radioactive waste is an issue," said Hodge. "It's just not necessarily the fearful, terrifying issue that has been portrayed."

Caldicott is an Australian-born physician who travels the world speaking about the medical hazards of nuclear technology.

On Tuesday she advised Port Hope residents to sue the government for "millions and millions" of dollars and move away.

A YouTube video captured Caldicott's speech.

"You are passive victims of their criminal negligence," she told the crowd.

"Check my facts, check the data and make up your own mind if you want to stay in Port Hope," she said.

The Canadian Nuclear Safety Commission, which will oversee Port Hope's cleanup, has argued there is no health risk and that the town's cancer rates are no higher or lower than other areas.

While no one was available for comment from the agency, a spokesman pointed out there have been reviewed findings from more than 30 environmental and 13 epidemiological studies on the issue, and the community has been involved in many discussions.

In a phone interview on Wednesday, Caldicott said those in disagreement with her did not listen to her speech or read her book and are ignoring the facts.

"I feel actually quite annoyed with those people who didn't come to hear what I have to say. You can't comment about something so important as this in a vacuum," said Caldicott.

Caldicott said there have been no scientific studies that have been peer-reviewed for cases of disease.

"We have to tell people unpleasant truths to help them," said Caldicott.