Machine Learning - Davz33/tutorials GitHub Wiki
Google/Jax is a XLA-based library that aims to speed up numerical computation.
XLA is a compiler for linear algebra especially devised for accelerating Tensor Flow models with minimal code changes.
- grad
- jit
- pmap
- vmap
- vectorization: makes a single-input function to the equivalent accepting a batch of the same type of input
Already known in the SW. Engineering community, JIT is a common feature of many numeric-computationally intensive libraries, across different programming languages.
Within JAX, jit becomes super-easy, a decorator on top is all that's needed to "jit-compiliify" a function:
@jit
def myfunction(param1, param2, param3):
#something computationally intensive
parallel map function, across multiple cores
batched_fun = vmap(fun, <...>)
Kubeflow is an open-source toolkit to run machine learning workflows on Kubernetes
It's a component within Kubeflow that provides a platform for ML-workflows ("pipelines") structured as directed acyclic graphs (DAGs)
TFX provides a platform to manage and deploy tensorflow-based ML-workflows as pipelines.
It comes with the added feature of reusable components, which can be re-implemented across pipelines.