Thinking of how the video/content appear next to the objects. Could it appear next to them, projected from the ceiling?
Could I project all of the plastic items onto the table from above, and have a few of them placed as objects in amongst the projection?
Version 2 – webcam mounted above the table / surface – this means I don’t have to use a transparent surface / cut holes out of the table
And a very rough idea of what the mixture of projected and real items would look like