Remote Module

class ablinfer.remote.DispatchRemote(config=None)

Class for dispatching to an ABLInfer server.

A required base_url key is added to config, which must be the server’s base URL, which will be passed to urllib.parse.urljoin() to construct the query URLs. In addition, a session parameter is added to config which allows the user to provide a requests.Session instance for SSL verification or authentication. An ignore_mismatch parameter has been added to config; if True, any mismatch between the local version and the server version will be ignored.

get_model(model_id: str)

Retrieve a model from the site.

This function assumes that the model received is normalized.

Parameters:model_id – The model’s ID.

get_model_list() → List[str]

Retrieve the list of models available on the site.