Simplify autoformat facilities in preparation for removal #17896
Conversation
ayerofieiev-tt
requested review from
bbradelTT,
sjameelTT,
vsureshTT,
edwinleeTT,
patrickroberts,
ntarafdar,
dchenTT,
jaykru-tt,
yugi957,
jvegaTT,
llongTT,
nardoTT,
cfjchu,
dmakoviichuk-tt and
TT-BrianLiu
as code owners
ttnn/cpp/ttnn/operations/experimental/auto_format/auto_format.cpp
Outdated
Show resolved
Hide resolved
| ttnn::Shape(unpadded_shape), pad_c, pad_n, pad_h, pad_w); | ||
| [](const std::array<uint32_t, 4>& unpadded_shape) -> std::vector<uint32_t> { | ||
| auto result = | ||
| ttnn::operations::experimental::auto_format::AutoFormat::pad_to_tile_shape(ttnn::Shape(unpadded_shape)); |
There was a problem hiding this comment.
I'd create a standalone function. might be usefull in c++ too.
There was a problem hiding this comment.
this thing must get removed. tile shape is not constant.. no need for ttnn::operations::experimental::auto_format::AutoFormat when there is a TensorSpec
| ttnn::Shape AutoFormat::pad_to_tile_shape(const ttnn::Shape& unpadded_shape) { | ||
| using namespace tt::constants; | ||
| auto rank = unpadded_shape.rank(); | ||
| TT_ASSERT(rank >= 1, "rank of shape to pad to tile shape must be at least 1."); |
There was a problem hiding this comment.
TT_FATAL might be better.
There was a problem hiding this comment.
agree, but not changing in this PR.
- just moved from hpp to cpp
- ideally want to remove this func
ttnn/cpp/ttnn/tensor/tensor_ops.cpp
Outdated
| @@ -100,6 +100,11 @@ Tensor tensor_to_device( | |||
|
|
|||
| Tensor tensor_cpu(const Tensor& input_tensor, bool blocking, QueueId cq_id) { | |||
| ZoneScoped; | |||
There was a problem hiding this comment.
you can move zonescoped down or graph tracekr up.
| auto a_pad_shape = ttnn::operations::experimental::auto_format::AutoFormat::pad_to_tile_shape( | ||
| temp.get_padded_shape(), false, false, true, true); | ||
| auto a_pad_shape = | ||
| ttnn::operations::experimental::auto_format::AutoFormat::pad_to_tile_shape(temp.get_padded_shape()); |
There was a problem hiding this comment.
nit: can we do something like using ttnn::operations::experimental::auto_format::AutoFormat autoformat and avoid all this long line?
There was a problem hiding this comment.
aim is to remove, so not changing in this PR yet.
ttnn/cpp/ttnn/operations/experimental/auto_format/auto_format.cpp
Outdated
Show resolved
Hide resolved
Ticket
Link to Github Issue
Problem description
Autoformat is a convoluted mechanism which we want to remove.
But because its convoluted its hard to make in one step.
Want to clean it up a bit as I am trying to better understand how it works.
What's changed
Added comments, removed things which clearly should not be needed.
Checklist