Commit Graph

5 Commits

Author SHA1 Message Date
jjsjann123 df741c589f [NVFuser] Upstream push 0809 (#83067)
Syncing nvfuser devel branch to upstream master. https://github.com/csarofeen/pytorch/

Code changes includes:

- codegen improvements:
  1. removes un-necessary sync from redundant thread compute analysis
  2. symmetric API for BestEffortReplay
  3. support merge on trivial reductions
  4. Ampere async copy improvements
- bug fixes:
  1. vectorization bug fixes
  2. type inference patch : fixes upstream #81725
  3. segmenter bug fix with deterministic iteration ordering
- parser update
  1. added leaky_relu
- scheduler
  1. normalization scheduler clean up.
  2. simplifies matmul scheduling with new transform propagator
  3. merge all dimensions in PW scheduler
  4. various gemm related improvements
- debuggability
  1. nsight compute support
  2. debug dump for InlinePropagator
  3. Add `UnaryOpType::Print`

Squashed commits to WAR github API
Commits that's actually in this PR from the devel branch:

```
dfe02f3fae Merge remote-tracking branch 'csarofeen/devel' into HEAD
16173732ec Add `TensorViewBuilder::shape(std::vector<Val*> shape)` (#1884)
7cfb7796bd Merge pull request #1887 from csarofeen/upstream_merge_0803
3399f6de62 Merge remote-tracking branch 'origin/viable/strict' into HEAD
01208f5bba Add `UnaryOpType::Print` which can be helpful for debugging (#1878)
0646522454 Remove redundant TORCH_INTERNAL_ASSERT in lower_magic_zero.cpp (#1881)
7bc76aa219 Fix most inlined propagator for mismatched dims (#1875)
501f4aa270 Nonaffine swizzle formulation ep.2: Loop swizzle variant. (#1826)
d863d690f9 Ampere async copy ep.2: circular buffering extension to support pipelined matmul operand load (#1827)
e0ae11a61c Larger sized mma instructions to support full vectorization (#1824)
9bb4cf7a66 fragment iteration to support fully unrolled mma ops (#1823)
a48270a18d Merge all dims in pointwise scheduler (#1872)
172fb3673f Make MostInlined and BestEffort inline propagation no longer assert replayed (#1868)
a64462a5ac Allow trivial reduction to be merged (#1871)
440102bcda Symmetric API for BestEffortReplay (#1870)
d1caf330c0 Some misc cleanups/refactor split out from #1854 (#1867)
1013eda50b Remove some welford specific logic. (#1864)
51589d36be Some cleanups on tests and heuristics params (#1866)
a6b3e70da5 Segmenter bug fix, and deterministic iteration ordering.  (#1865)
1b665b9b5e Add nullptr checks to IrBuilder (#1861)
1cd9451d74 Simplify matmul scheduling with the new transform propagator.  (#1817)
bbc1fb9b8c Add leaky_relu operation (#1852)
e842a9bab5 Minor cleanup in pointwise scheduler (#1858)
9ee850ca2f Fix stringstream usage (#1857)
20a36c1e4f Improve nsight compute support (#1855)
4059103083 Remove debugging `true ||` from getPointwiseHeuristics (#1822)
01117bfe8f Misc cleanup (#1853)
5cc64943dc Apply the magic-zero protection to each indexed domain individually for predicate indexing (#1846)
92e6f0207e Cleanup normalization scheduler (#1845)
db89c6591a Type inference patch (#1848)
102fe93a46 Add debug dump for InlinePropagator (#1847)
b7a4d93d37 Redundant thread compute analysis to avoid un-necessary sync insertion (#1687)
942be5b256 Upstream ci build fixes (#1842)
0b83645915 Fix vectorization bug introduced in #1831 (#1840)
63630f1ae0 Move MaxProducerPosUpdater into InlinePropagator::tearDown (#1825)
9135a963c0 Fix transpose benchmark dtype (#1839)
2c9a6c0231 Add extra configurability to `parallelizeAllLike` (#1831)
```

RUN_TORCHBENCH: nvfuser

Differential Revision: [D38543000](https://our.internmc.facebook.com/intern/diff/D38543000)
Pull Request resolved: https://github.com/pytorch/pytorch/pull/83067
Approved by: https://github.com/davidberard98
2022-08-10 21:02:56 +00:00
jjsjann123 c9c402eae9 [nvfuser_upstream_push] Reland: nvfuser code base bump 060822 (#79406)
Landing reverted PR #79147.

Syncing nvfuser devel branch to upstream master. https://github.com/csarofeen/pytorch/

Bug fixes and minor refactor

Squashed commits to WAR github API
Commits that's actually in this PR from the devel branch:

```
4c60e7dff2 Add examples infrastructure for using nvFuser in a standalone program (#1725)
02a05d9833 Fix issue #1751 (#1753)
8a69aa320b Refactor NvFuser transpose API to match eager mode behavior (#1746)
ffdf6b7709 Remove BroadcastWithoutStride. (#1738)
02bab16035 Fix flipping of a boolean flag (#1745)
465d66890c cleanup (#1744)
26d354e687 fixing noncontig broadcast (#1742)
856b6b2f90 Add IterDomainBuilder (#1736)
1fd974f912 fixing warning for gcc7 (#1732)
de2740a43a disabling complex in python tests for #1730 (#1733)
fbbbe0a2e7 fixing MSVC build (#1728)
b5feee5e2b Fix the fused reduction runtime kernel (#1729)
5247682dff Re-entrant GroupedGridReduction (#1727)
```

RUN_TORCHBENCH: nvfuser
Pull Request resolved: https://github.com/pytorch/pytorch/pull/79406
Approved by: https://github.com/davidberard98
2022-06-16 17:52:21 +00:00
PyTorch MergeBot d28e9e145b Revert "[nvfuser_upstream_push] nvfuser code base bump 060822 (#79147)"
This reverts commit 49c41b87a2.

Reverted https://github.com/pytorch/pytorch/pull/79147 on behalf of https://github.com/janeyx99 due to Broke 11.3 builds on trunk https://hud.pytorch.org/pytorch/pytorch/commit/49c41b87a28848655d7fe8168e9a717d53508609
2022-06-10 20:55:10 +00:00
jjsjann123 49c41b87a2 [nvfuser_upstream_push] nvfuser code base bump 060822 (#79147)
Syncing nvfuser devel branch to upstream master. https://github.com/csarofeen/pytorch/

Bug fixes and minor refactor

Squashed commits to WAR github API
Commits that's actually in this PR from the devel branch:

```
4c60e7dff2 Add examples infrastructure for using nvFuser in a standalone program (#1725)
02a05d9833 Fix issue #1751 (#1753)
8a69aa320b Refactor NvFuser transpose API to match eager mode behavior (#1746)
ffdf6b7709 Remove BroadcastWithoutStride. (#1738)
02bab16035 Fix flipping of a boolean flag (#1745)
465d66890c cleanup (#1744)
26d354e687 fixing noncontig broadcast (#1742)
856b6b2f90 Add IterDomainBuilder (#1736)
1fd974f912 fixing warning for gcc7 (#1732)
de2740a43a disabling complex in python tests for #1730 (#1733)
fbbbe0a2e7 fixing MSVC build (#1728)
b5feee5e2b Fix the fused reduction runtime kernel (#1729)
5247682dff Re-entrant GroupedGridReduction (#1727)
```

RUN_TORCHBENCH: nvfuser
Pull Request resolved: https://github.com/pytorch/pytorch/pull/79147
Approved by: https://github.com/davidberard98
2022-06-10 19:37:42 +00:00
jjsjann123 a2802ad0b9 Upstream master bump 0513 (#77471)
Updating nvfuser code base.

This should fix the indexing issue observed in https://github.com/pytorch/vision/issues/6015.

Running tests locally as well. Will update the description here at a later point

@bypass-github-export-checks
Pull Request resolved: https://github.com/pytorch/pytorch/pull/77471
Approved by: https://github.com/seemethere, https://github.com/eellison
2022-05-18 11:48:50 -07:00