Cool, I did not know about pybind11, looks nice!
Now, since we already have boost.python support, maybe you could use that as well? Your project looks non-trivial and will take some thinking to get the c++ part compiled. Please email us your source code files and we will try to make it work. If I understand correctly so far, you have some core function in C++ which you would like to make available to a JeVois module written in Python? This is what we do in the core of JeVois, see files PythonSupport.H / .C and PythonModule.H / .C on the jevois github.