A brief explanation of what I am trying to do, I am working on an Augmented Reality User interface for controlling a robot. I have a camera that i know its location/orientation at all times in the world. I am using a 3d sensor to find planar regions in the world and making meshes in the scene in the proper locations relative to the camera. Now I want to texture those planar regions with the camera image so that in my 3d view it is easier to see what i am looking at. I first simply tried calculating the UV maps by projecting the mesh verts onto the camera image, but i run into the issue of the textures not lining up along the seams of the triangles in the mesh.
like in this post
I think my answer is I need to do some sort of projection mapping or a custom Shader but I am not sure how to do either of those at the moment and could use some guidance. Or maybe I am completely off course.
I tried to draw up a quick example of what i have and what i am trying to do. i would think this would be an easy problem, but I feel like i am missing something. any help would be greatly appreciated.
What I have
What I want