MINNEAPOLIS -- Fountains froze over, a 200-foot Ferris wheel in Atlanta shut down, and Southerners had to dig out winter coats, hats and gloves they almost never have to use.

The brutal polar air that has made the Midwest shiver over the past few days spread to the East and the Deep South on Tuesday, shattering records that in some cases had stood for more than a century.

The mercury plunged into the single digits and teens from Boston and New York to Atlanta, Birmingham, Nashville and Little Rock - places where many people don't know the first thing about extreme cold.

"I didn't think the South got this cold," said Marty Williams, a homeless man, originally from Chicago, who took shelter at a church in Atlanta, where it hit a record low of 6 degrees. "That was the main reason for me to come down from up North, from the cold, to get away from all that stuff."

(MORE: Updated Snow Totals from Winter Storm Ion)

The morning weather map for the eastern half of the U.S. looked like an algebra worksheet: lots of small, negative numbers. In fact, the Midwest and the East were colder than much of Antarctica.

In a phenomenon that forecasters said is actually not all that unusual, all 50 states saw freezing temperatures at some point Tuesday. That included Hawaii, where it was 18 degrees atop Mauna Kea, a dormant volcano.

The big chill started in the Midwest over the weekend, caused by a kink in the "polar vortex," the strong winds that circulate around the North Pole. By Tuesday, the icy air covered about half the country, and records were shattered like icicles up and down the Eastern Seaboard.

It was 1 degree in Reading, Pa., and 2 in Trenton, N.J. New York City plummeted to 4 degrees; the old record for the date was 6, set in 1896.

(WATCH: Prep Your Pets for Bitter Cold)

Authorities in Indiana and Kentucky - where temperatures dropped into the single digits and below, with wind chills in the minus 20s and worse - warned people not to leave their homes at all unless they needed to go someplace safer.

The company that operates the power grid supplying energy to more than 61 million people in parts of the Mid-Atlantic, Midwest and South asked Monday night that users conserve electricity because of the cold, especially in the morning and mid-afternoon.

Meanwhile, utility crews worked to restore power to more than 40,000 Indiana customers affected by the weekend storm and cautioned that some people could be in the cold and dark for days.

Ronald G. Smith Sr. took shelter at an Indianapolis Red Cross after waking up the previous night with the power out and his cat, Sweet Pea, agitated in the darkness.

"The screen door blew open and woke me up, and it was cold and dark. I got dressed and I was scared, thinking, `What am I going to do? My cat knew something was wrong. He was jumping all over the place," Smith said. "This is brutal cold. The cold is what makes this so dangerous."

Even after Indianapolis lifted a travel ban, officials urged residents to stay home for their own safety and that of police and other emergency workers.

"It's still slick out there," said Marc Lotter, a spokesman for the mayor. "It's just not safe for people to be out on the streets."

"It's brutal out here," said Spunkiy Jon, who took a break from her sanitation job in New York to smoke a cigarette in the cab of a garbage truck. "Your fingers freeze off after three minutes, your cheeks feel as if you're going to get windburn, and you work as quick as you can."

Farther south, Birmingham, Ala., dipped to a low of 7, four degrees colder than the old mark, set in 1970. Huntsville, Ala., dropped to 5, Nashville, Tenn., got down to 2, and Little Rock, Ark., fell to 9. Charlotte, N.C., reached 6 degrees, breaking the 12-degree record that had stood since 1884.

The deep freeze dragged on in the Midwest as well, with the thermometer reaching minus 12 overnight in the Chicago area and 14 below in suburban St. Louis. More than 500 Amtrak passengers were stranded overnight on three Chicago-bound trains that were stopped by blowing and drifting snow in Illinois. Food ran low, but the heat stayed on.

The worst should be over in the next day or two, when the polar vortex is expected to straighten itself out. Warmer weather - that is, near or above freezing - is in the forecast for much of the stricken part of the country.

On Tuesday, many schools and day care centers across the eastern half of the U.S. were closed so that youngsters wouldn't be exposed to the dangerous cold. Officials opened shelters for the homeless and anyone else who needed a warm place.

(MORE:Winter Storm Alerts|Current Driving Conditions)

With the bitter cold slowing baggage handling and aircraft refueling, airlines canceled more than 2,000 flights in the U.S., bringing the four-day total to more than 11,000.

In New Orleans, which reported a low of 26 degrees, hardware stores ran out of pipe insulation. A pipe burst in an Atlanta suburb and a main road quickly froze over. In downtown Atlanta, a Ferris wheel near Centennial Olympic Park that opened over the summer to give riders a bird's eye view of the city closed because it was too cold.

Farther south in Pensacola, Fla., a Gulf Coast city better known for its white sand beaches than frost, streets normally filled with joggers, bikers and people walking dogs were deserted early Tuesday. A sign on a bank flashed 19 degrees. Patches of ice sparkled in parking lots where puddles froze overnight.

Monica Anderson and Tommy Howard jumped up and down and blew on their hands while they waited for a bus. Anderson said she couldn't it recall it ever being so cold.

"I'm not used to it. It is best just to stay inside until it gets better," said Anderson, who had to get out for a doctor's appointment.

The Lower 48 states, when averaged out, reached a low of 13.8 degrees overnight Monday, according to calculations by Ryan Maue of Weather Bell Analytics. An estimated 190 million people in the U.S. were subjected to the polar vortex's icy blast.

Farmers worried about their crops.

Diane Cordeau of Kai-Kai Farm in Indiantown, Fla., about 90 miles north of Miami, had to pick her squash and tomatoes Monday to beat the freeze but said her leafy vegetables, such as kale, will be sweeter and tastier because of the cold.

"I'm the queen of lettuce around here, so the colder the better," said Cordeau, whose farm serves high-end restaurants that request specific produce or organic vegetables.

PJM Interconnection, which operates the power grid that serves more than 61 million people in the Mid-Atlantic, Midwest and South, asked users to conserve electricity because of the cold, especially in the morning and late afternoon.

Across the South, the Tennessee Valley Authority said power demand in the morning reached the second-highest winter peak in the history of the Depression-era utility. Temperatures averaged 4 degrees across the utility's seven-state region.

In South Carolina, a large utility used 15-minute rolling blackouts to handle demand, but there were no reports of widespread outages in the South.

Natural gas demand in the U.S. set a record Tuesday, eclipsing the mark set a day earlier, according to Jack Weixel, director of energy analysis at Bentek Energy.

In Chicago, it was too cold even for the polar bear at the Lincoln Park Zoo. While polar bears can handle below-zero cold in the wild, Anana was kept inside Monday because she doesn't have the thick layer of fat that bears typically develop from feeding on seals and whale carcasses.

MORE ON WEATHER.COM: Photos from the Deep Temperature Plunge

St. Louis

Snow and ice are seen covering up Mississippi River and downtown St. Louis Wednesday, Jan. 8, 2014. (AP Photo/Kiichiro Sato)