Help! Foot problems after 2 years?

I broke my foot 2 years ago on the side of my foot in 3 places. The Dr. put a soft cast on for only a week. 2 years later my foot is swollen where I broke it and I have pain when I put too much pressure on it.My foot also leans inwards wrecking my shoes and causing me to actually fall. I'm scared the dr will have to break it or somehting, Help!