Create a vector which is the line between you and the object and normalize it, so if the object is at ox,oy,oz and the camera is at cx,cy,cz, that gives you
Z = normalize ( (ox-cx) , (oy-cy), (oz-cz) )
Then pick an up-vector, let's make that Y' = (0,1,0).
Then take the cross product of Y' and Z and normalize it
X = normalize( Y' x Z )
Then take the cross product again to get
Y = Z x X
So now you have 3 vectors, X,Y,Z which form the matrix which will orient the camera to point at the object.
The 3x3 matrix is
X.x X.y X.z
Y.x Y.y Y.z
Z.x Z.y Z.z
The 4x4 matrix is
X.x X.y X.z 0
Y.x Y.y Y.z 0
Z.x Z.y Z.z 0
0 0 0 1
Jim