[HN Gopher] Show HN: Graphsignal - ML profiler to speed up train...
___________________________________________________________________
Show HN: Graphsignal - ML profiler to speed up training and
inference
Hi, Graphsignal founder here. We've launched Graphsignal earlier
this year to make machine learning profiling practical and easy to
use. Basically, it enables the profile-optimize-benchmark loop. For
example, making inference faster by optimizing an ML model, while
still maintaining accuracy. We've make a lot of progress that I
wanted to share. The profiler now natively supports TensorFlow,
Keras, PyTorch, PyTorch Lightning, Hugging Face, XGBoost and JAX
frameworks along with built-in support for distributed workloads.
Profiles now include tracing information in chrome trace format.
Process and GPU utilization data has been extended as well. It is
now possible to monitor all run metrics. Useful for long runs.
Profiled workloads are now sharable across teams and publicly (if
enabled). I'm excited to show it here and appreciate any thoughts,
comments and feedback!
Author : dmitrim
Score : 8 points
Date : 2022-07-04 11:40 UTC (11 hours ago)
(HTM) web link (github.com)
(TXT) w3m dump (github.com)
| dang wrote:
| Related:
|
| _Show HN: Graphsignal - Machine learning profiler for training
| and inference_ - https://news.ycombinator.com/item?id=30628618 -
| March 2022 (8 comments)
| [deleted]
| p1esk wrote:
| Can it measure internode traffic for distributed training runs?
| This is something I needed recently and couldn't achieve using
| nccl-test utilities like mpirun. ib_write_bw also didn't work, I
| suspect because of multiple virtual links.
| dmitrim wrote:
| For now it only tries to extract NCCL time percentage from the
| profile, if available, and show it profile summary. Some hints
| count be in the step trace timeline as well. We are planning to
| record some NCCL related counters separately as well.
___________________________________________________________________
(page generated 2022-07-04 23:01 UTC)