Async inference for cpp

Async inference for cpp #902