Welcome to DistHLO

An automatic parallel training / inference infrastucture for DL.

Here is a introduction video for DistHLO on the BiliBili site.

DistHLO is now developing upon community TensorFlow, while makes the usage of Graph construction and XLA running process.

A new backend is implementted as a service-provider for distributed strategy exploring and real running.

At this time, building DistHLO depends on the basic building framework driven by 'Bazel'. Thus the code needs to be mixed or patched into the basic TF work directory.

Just have fun for it.