Skip to content

Commit

Permalink
Add a note: Type Inference for Quantization is not always feasible (#…
Browse files Browse the repository at this point in the history
  • Loading branch information
abhigunj authored Apr 18, 2024
1 parent 19e3142 commit 541db99
Showing 1 changed file with 15 additions and 0 deletions.
15 changes: 15 additions & 0 deletions docs/status.md
Original file line number Diff line number Diff line change
Expand Up @@ -159,3 +159,18 @@ one of the following tracking labels.
| uniform_quantize | yes | revisit | infeasible | yes | no |
| while | yes | revisit | yes | revisit | yes |
| xor | yes | yes | yes | yes | yes |

## Type inference for quantized operations

The `Type Inference` column from the table above is intended to focus on
non-quantized operations. For the majority of the quantized operations, it is
not feasible to infer the result type because the quantization parameters of
the result types may vary from those of the operands. With the exception of
few cases where, operand and result types must match identically, or the op
has constraints useful to infer result type, such ops are listed below:
`all_gather`, `all_to_all`, `case`, `collective_permute`,
`compare`, `concatenate`, `constant`, `dynamic_slice`,
`dynamic_update_slice`, `gather`, `get_tuple_element`, `if`, `infeed`,
`is_finite`, `map`, `optimization_barrier`, `outfeed`, `pad`, `recv`, `reduce`,
`reduce_scatter`, `reduce_window`, `reverse`, `scatter`, `select_and_scatter`,
`send`, `slice`, `sort`, `transpose`, `tuple`, `uniform_dequantized`, `while`.

0 comments on commit 541db99

Please sign in to comment.