Hi Scotty,
I think your original plan was the best. If you can make that work, then you can think about making it faster later on. In all honesty you are far better off, while you're learning, to concentrate on the methods and algorithms and solutions and maths than you are worrying about which 3D library to use or whether it's fast or not or needs optimising.
Jim