Here's the info on the movie I was searching for
and was found
The Remarkable Mr. Pennypacker (1959)
In early 1900s' Pennsylvania, Mr. Pennypacker has two company offices and two families with a combined total of 17 children. With an office in Harrisburg and an office in Philadelphia, he has successfully kept two separate homes. However, when an emergency requires his oldest son to find him, Mr. Pennypacker's dual life is revealed.
Clifton Webb .... Mr. Horace Pennypacker
Dorothy McGuire .... Ma Pennypacker
Charles Coburn .... Grampa Pennypacker
Jill St. John .... Kate Pennypacker
Ron Ely .... Wilbur Fielding
Here are a few of the people in the movie
Thanks to everyone for helping me out