KvCache Constructor

Constructs KvCache. Generally, this API does not need to be called by users. The KvCache object is returned by KvCacheManager.allocate_cache or KvCacheManager.allocate_blocks_cache.