How Can We Help?
If the application is compiled for x86 and/or runs on Windows 32bit OS, only 4GB or RAM is addressable per application, and this may not be enough for the memory requirements of the application + all the video instances.
Recompile the application to target x64, this should fix the problem (but it will then run only on Windows 64bit OS).